Elon Musk’s AI tool Grok has come under intense scrutiny after multiple users alleged that its newly introduced image-editing feature was capable of altering photos of women and children into sexualised or nude images. The platform confirmed on Friday that it is urgently working to fix serious safety lapses.
In a post shared on X (formerly Twitter), Grok acknowledged the issue, stating:
“We’ve identified lapses in safeguards and are urgently fixing them.”
The platform also stressed that Child Sexual Abuse Material (CSAM) is illegal and strictly prohibited.
Complaints Surge After “Edit Image” Feature Launch
Reports of misuse surged after Grok rolled out an “edit image” button in late December. The feature allows users to modify any image uploaded to the platform. However, some users allegedly exploited it to digitally remove clothing or alter images to create explicit visuals involving women and minors.
When contacted by AFP regarding the allegations, xAI — the company behind Grok and headed by Elon Musk — responded with a brief automated reply:
“The mainstream media lies.”
Despite the company’s dismissive reply to the media, the Grok chatbot did respond to user queries on X, where concerns were raised regarding potential criminal liability for allowing such material to be created or circulated knowingly.
India & France Step In With Investigations and Demands
Media reports in India stated that government authorities have demanded detailed clarification from X regarding the steps being taken to remove “obscene, nude, indecent, and sexually suggestive content” allegedly generated without consent.
In France, the public prosecutor’s office in Paris announced an expansion of an ongoing investigation into X, adding new allegations connected to Grok being used to generate and disseminate child pornography.
The earlier investigation was launched in July following claims that the platform’s algorithm was being manipulated for foreign interference efforts.
Grok Already Under Fire For Controversial Output
This is not the first time Grok has faced criticism. In recent months, the AI tool has sparked outrage over multiple controversial outputs, including misinformation related to the Gaza conflict, India-Pakistan tensions, antisemitic content, and false narratives surrounding a deadly shooting in Australia.
As pressure mounts globally, Grok and xAI now face intense legal, ethical, and regulatory challenges to prove that their AI platform can operate responsibly without enabling abusive or criminal content generation.