The UK regulator Ofcom has launched an urgent investigation into Elon Musk’s AI tool, Grok, following reports that it can be used to produce sexualized images of women and children without consent. The probe comes amid growing concerns over AI deepfakes and nudification tools on social media platforms.
According to Ofcom, Grok, a free AI chatbot with optional premium features on Musk’s X platform, has been misused to:
- Digitally undress women and girls.
- Generate sexualized images of real people without consent.
- Create content involving childlike images, raising alarms under UK and EU laws.
Government and Regulatory Response
The UK Technology Secretary, Liz Kendall, called the misuse “absolutely appalling”, supporting Ofcom’s investigation into illegal AI-generated content. Kendall emphasized that social media platforms have a legal obligation under the Online Safety Act (OSA) to prevent the creation and dissemination of sexually explicit AI content.
“We cannot and will not allow the proliferation of these degrading images,” Kendall said.
Ofcom stated that companies must take appropriate steps to prevent users from encountering this content, and to remove it swiftly once identified.
Meanwhile, the European Commission expressed deep concern over Grok’s misuse, calling the production of sexualized AI images, especially involving children, “appalling and disgusting.” Thomas Regnier, spokesperson for the Commission, highlighted that the EU is ready to enforce strict penalties under its Digital Services Act, referencing a €120m fine issued to X in December 2025 for other violations.
Cases of Misuse
The BBC has documented several instances where users asked Grok to digitally undress people, including public figures such as Catherine, Princess of Wales.
Affected individuals have described the experience as “dehumanizing and humiliating.” Journalist Samantha Smith, for example, reported that an AI-generated bikini image of her left her feeling “reduced to a sexual stereotype” and violated her personal boundaries.
“While it wasn’t actually me in states of undress, it looked like me and felt as violating as if someone had posted a nude image of me,” Smith said.
Dr. Daisy Dixon, another affected X user, previously reported similar experiences of Grok altering images she shared online. Both cases highlight the emerging dangers of AI-enabled nudification tools.
X’s and Musk’s Response
Elon Musk and X have issued statements warning users that generating illegal content with Grok carries the same consequences as uploading it directly.
XAI’s acceptable use policy explicitly prohibits depicting likenesses of persons in a pornographic manner, but enforcement has been inconsistent. Users continue to exploit Grok’s AI capabilities, prompting calls for stricter content moderation and accountability.
The UK Home Office is also legislating to ban nudification tools, introducing a new criminal offense whereby anyone supplying such technology could face prison and substantial fines.
Broader Implications
The Grok case underscores several urgent challenges in the AI and social media landscape:
- Non-consensual AI-generated sexual content threatens individual privacy, dignity, and safety.
- Existing laws and platform policies may not be sufficient to prevent misuse of AI tools.
- Governments are increasingly implementing stricter AI oversight to ensure compliance with safety and consent laws.
- Public figures and private citizens alike are vulnerable to AI deepfakes, emphasizing the need for both regulatory enforcement and ethical AI design.
Experts warn that unless AI developers and social media platforms take immediate action, these tools could contribute to a rise in cyber harassment, intimate image abuse, and psychological harm globally.
Summary
The Ofcom investigation into Grok AI highlights the pressing need for social media platforms to take responsibility for AI content. UK and EU authorities are calling on Elon Musk and X to:
- Halt the production of non-consensual sexualized AI content
- Strengthen moderation policies and AI safeguards
- Ensure compliance with the Online Safety Act and Digital Services Act
- Protect users from AI-generated harassment or abuse
With mounting international pressure, Musk’s X faces intense scrutiny over its AI practices, with potential regulatory and criminal consequences if it fails to act.
Leave a Reply