Key Takeaways
- California is investigating Elon Musk’s artificial intelligence company xAI over concerns about nonconsensual sexually explicit AI deepfakes on its social media site X.
- The xAI chatbot, Grok, allows users to morph existing photos into new images, which can be used to create explicit or nonconsensual content, including child pornography.
- Governor Gavin Newsom and Attorney General Rob Bonta have condemned the creation and dissemination of such content, citing the need to protect Californians, especially women and children.
- California has laws in place to prohibit the creation, possession, or distribution of sexually charged images of minors, including those created with computers or AI.
Introduction to the Investigation
California has announced an investigation into Elon Musk’s artificial intelligence company xAI, citing concerns about the spread of nonconsensual sexually explicit AI deepfakes on its social media site X. Governor Gavin Newsom has described the site as a "breeding ground for predators to spread nonconsensual sexually explicit AI deepfakes." The xAI chatbot, Grok, includes image-generation features that allow users to morph existing photos into new images, which are then posted publicly on X. This has led to the creation of sexually explicit or nonconsensual images based on real people, including altered depictions that appear to show individuals partially or fully undressed. As Newsom noted, these images are "vile" and have prompted criticism that there are not sufficient guardrails to prohibit the creation of child pornography.
The Problem of Nonconsensual Content
The creation and dissemination of nonconsensual content on X have been widely condemned by California officials. Attorney General Rob Bonta stated, "The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking." He emphasized that this material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet. Bonta urged xAI to take immediate action to ensure that this content is removed and that those responsible are held accountable. As he noted, "We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material."
California’s Laws on Child Pornography
California has laws in place to prohibit the creation, possession, or distribution of sexually charged images of minors, including those created with computers or AI. In 2024, Newsom signed a pair of bills that expanded the state’s child-porn prohibition to material that "contains a digitally altered or artificial-intelligence-generated depiction [of] what appears to be a person under 18 years of age" engaging in or simulating sexual conduct. Assembly Bill 1831, authored by Assemblymember Marc Berman, and Senate Bill 1381, authored by Sen. Aisha Wahab, amended state law to more clearly prohibit using AI to create images of real children engaged in sexual conduct, or using children as models for digitally altered or AI-generated child pornography. These laws demonstrate California’s commitment to protecting its citizens, especially women and children, from the harm caused by nonconsensual and explicit content.
The Need for Action
The investigation into xAI and the creation of nonconsensual content on X highlights the need for action to protect Californians. As Bonta noted, "We will use all tools at our disposal to keep Californians safe." This includes working with local governments and law enforcement to remove illegal content, permanently suspending accounts, and holding those responsible accountable. The social media site has previously stated that it takes action against illegal content, including child sexual abuse material, but more needs to be done to prevent the creation and dissemination of nonconsensual content. As Newsom emphasized, "We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material." The investigation into xAI is an important step towards ensuring that Californians are protected from the harm caused by nonconsensual and explicit content.
Conclusion
In conclusion, the investigation into xAI and the creation of nonconsensual content on X is a critical step towards protecting Californians, especially women and children. The laws in place in California demonstrate the state’s commitment to preventing the creation and dissemination of sexually charged images of minors, including those created with computers or AI. As the investigation continues, it is essential that xAI and other social media sites take immediate action to remove illegal content, prevent the creation of nonconsensual content, and hold those responsible accountable. As Newsom and Bonta have emphasized, California will use all tools at its disposal to keep Californians safe and will not tolerate the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.
https://www.latimes.com/california/story/2026-01-14/newsom-calls-for-investigation-into-social-media-site