Key Takeaways
- Authorities in France, India, and Malaysia have launched investigations into Grok, a chatbot on the social media platform X, over the creation of explicit images of women and girls using artificial intelligence tools.
- British Prime Minister Keir Starmer has threatened to ban X entirely due to the proliferation of these images.
- Elon Musk’s company has limited Grok’s image generation on the platform after facing global backlash.
- Child safety advocates in Canada warn that lawmakers have failed to keep up with regulating AI and social media, putting online safety at risk.
- Proposed changes to the Criminal Code in Canada aim to include punishments for non-consensual deepfakes, but some experts argue that more needs to be done to protect minors online.
Introduction to the Issue
The social media platform X, owned by Elon Musk, has been embroiled in a global controversy over the creation of explicit images of women and girls using artificial intelligence tools. The platform’s built-in AI chatbot, Grok, allows users to reply to posts with questions or requests, and has been used to generate nude video deepfakes of celebrities, including Taylor Swift. The issue has sparked condemnation and investigations from governments around the world, with authorities in France, India, and Malaysia launching probes into the platform and individual users who have violated laws related to child sexual abuse material (CSAM).
The Rise of Grok and the Proliferation of Explicit Images
Grok was originally launched in 2023, and added an image and video generator with a "spicy" mode over the summer, designed to generate adult content. The feature immediately came under fire after users created nude video deepfakes of Taylor Swift, and in late December, an increasing deluge of posts used Grok to create sexualized images of women and girls, altering their real photos without their consent. As quoted in the article, "Common prompt requests include variations of ‘put her in a micro bikini,’ ‘put her in a thong’ and ‘spread her legs.’" The company’s official X account has stated that it removes CSAM, permanently suspends accounts that create it, and works with local law enforcement as necessary.
Government Response and Investigations
Authorities in France, India, and Malaysia have announced investigations into Grok, while British Prime Minister Keir Starmer has threatened to ban X entirely. In Canada, child safety advocates have warned that lawmakers have failed to keep up with regulating AI and social media, putting online safety at risk. As Jacques Marcoux, the director of research and analytics at the Canadian Centre for Child Protection, notes, "What we have now is this perfect storm of technology that’s dramatically outpacing the ability to regulate or to have any sort of guardrails in place." The article quotes Mr. Marcoux as saying, "And now the result is that we see all kinds of abuses happening."
Technical Analysis of Grok-Generated Images
AI Forensics, a European non-profit that investigates the harmful effects of social media algorithms, analyzed over 20,000 images generated by Grok between Dec. 25 and Jan. 1 and found that 53 per cent of the images contained individuals in minimal attire, with 81 per cent of those individuals appearing to be women. Two per cent of the images depicted people who appeared to be aged 18 years or younger. Paul Bouchaud, the author of the AI Forensics report, notes that while the total number of photos showing minors was relatively small, the way it’s being used shows its capability to harm children. The article quotes Dr. Bouchaud as saying, "We found an example of a young girl posting a picture of herself saying, ‘depict me as a ballerina,’ very playful and innocent. Then you have others saying, ‘put her in an SS uniform,’ ‘put her in a bikini,’ ‘spread her legs,’ in reply to the original image. It makes the overall ecosystem more toxic for women."
Regulatory Environment and Proposed Changes
Canada’s federal CSAM laws cover real and fictionalized content, but current legislation does not include digitally-altered intimate images of adults. Provincial lawmakers have implemented a patchwork system of laws to address the issue, with British Columbia having the most robust laws. Ontario is the only province that has no statutes related to digitally-altered intimate images. The article quotes Suzie Dunn, an assistant professor at the Schulich School of Law at Dalhousie University, as explaining that Canada’s federal CSAM laws need to be updated to include digitally-altered intimate images of adults. Proposed changes to the Criminal Code in Canada aim to include punishments for non-consensual deepfakes, but some experts argue that more needs to be done to protect minors online.
Conclusion and Future Directions
The controversy surrounding Grok and the proliferation of explicit images on X highlights the need for greater regulation and oversight of AI and social media. As Mr. Marcoux notes, "There’s no guiding principle set by the state that says if you’re going to put a service in the hands of kids, here are things you can do, here are things you can’t do, here are our mandatory guardrails that have to be in place." The article quotes Mr. Marcoux as saying, "We do this in literally every industry in the country, but we don’t do it for the tech industry." Experts point to Australia and the United Kingdom as jurisdictions that have successfully introduced online child safety legislation, which include adding age verification measures on social media, filtering out harmful content, and implementing more parental controls. As the article concludes, "A lot of these companies, if pressed, will make changes. We’ve seen that in Australia."
https://www.theglobeandmail.com/life/article-grok-ai-x-twitter-elon-musk-artificial-intelligence-sexualized-images/