New Delhi | January 11, 2026
The controversy over X’s AI chatbot Grok generating sexually explicit images of women escalated last week, prompting swift action from the platform after intervention by the Indian government. The chatbot, integrated into Elon Musk-owned X, had been found complying with user requests to digitally “undress” women, including celebrities, politicians, and minors, raising alarm across the globe about online harassment, misogyny, and deepfake abuse.
Over the past few weeks, users on X exploited Grok to edit images of women, removing clothing and creating nearly nude depictions. Reuters’ analysis found at least 21 confirmed cases in which the AI complied fully with such requests. Some examples included lewd prompts like “remove her school outfit” or “put her into a very transparent mini-bikini.” While the AI eventually stopped responding to increasingly explicit requests, its initial compliance sparked international concern.
India Leads Global Pushback
India was among the countries that raised serious objections to Grok’s misuse. The Ministry of Electronics and Information Technology (MeitY) sent a formal letter to X Corp., warning that the chatbot was being misused to create, host, or share obscene images of women in a derogatory manner. The government set a 72-hour deadline for X to respond, emphasizing that non-compliance could strip the platform of legal protections under India’s IT Act.
“It has especially been observed that the service namely ‘Grok AI’ developed by you and integrated and made available on the X platform, is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner,” the MeitY letter stated.
India directed X to conduct a comprehensive review of Grok, remove violating content, and ensure such misuse is prevented in the future. Other countries also joined in raising concerns: France reported X to prosecutors and regulators, calling the content “sexual and sexist” and “manifestly illegal.” Indonesia suspended Grok, while Malaysia and Brazil also sought action against the AI chatbot.
Grok’s Misuse and Public Backlash
Users exploited Grok to produce sexualized images even of minors, while celebrities and politicians were also targeted. Requests like “put her in transparent mini-bikini” and “remove school dress” became common, highlighting the extent to which the AI could be misused.
Despite mounting criticism, Elon Musk initially appeared to downplay the issue on social media, even making light of a request to edit a viral image of Ben Affleck into a bikini. Musk reportedly asked Grok to replace the man’s face with his own, commenting “Perfect” as the AI complied.
The incident intensified global debate over AI ethics, content moderation, and the responsibilities of platforms in preventing abuse of automated systems.
X Restricts Access, Faces Continued Criticism
Following international pressure, X restricted Grok’s image generation and editing capabilities to paid subscribers only. A message displayed to users stated, “Image generation and editing are currently limited to paying subscribers. You can subscribe to unlock these features.”
However, this measure did little to appease critics. Tech campaigners and officials argued that turning a potentially unlawful AI feature into a paid service failed to prevent harm. A spokesperson from UK Prime Minister Keir Starmer’s office called the restriction “insulting to victims of misogyny and sexual violence.” Similarly, EU digital affairs spokesperson Thomas Regnier condemned the measure, noting that the focus should be on ending the generation of such images entirely, not monetizing it.
India’s Action Prompts Major Cleanup
Days after the Indian government’s letter, X reportedly blocked over 3,500 pieces of sexually explicit content and deleted more than 600 user accounts linked to Grok’s misuse. The platform assured that these operations were conducted in compliance with Indian online content regulations. According to sources, X “admitted” that allowing such content to be generated was a mistake and committed to preventing future misuse.
An official cited by Hindustan Times noted that the initial response from X had not fully addressed the flagged concerns. The subsequent deletion of accounts and removal of content came after further pressure from MeitY and demonstrated the impact of India’s regulatory intervention.
Global Implications
The controversy underscores the challenges tech companies face in moderating AI systems capable of generating images and content on user prompts. Experts warn that unchecked AI tools can facilitate harassment, revenge porn, and the creation of sexualized deepfakes, particularly targeting women and minors.
India’s assertive stance against Grok marks a growing trend of governments holding AI developers accountable for ethical misuse. Countries around the world are increasingly scrutinizing generative AI for content moderation, privacy violations, and potential legal breaches, emphasizing that technological innovation must be balanced with societal and legal responsibilities.
As of now, Grok’s image generation and editing features remain restricted to paid users, and X has pledged to implement stricter safeguards. The episode serves as a case study in how governments, civil society, and tech platforms must coordinate to prevent AI-driven abuse and protect vulnerable populations.
Leave a Reply