The generative AI chatbot integrated into billionaire Elon Musk's X is under international scrutiny over reports it has been filling the social media platform with sexually explicit images of children and women.
Complaints of abuses began after an "edit image" button was added to Grok just before Christmas.
The button allows users to modify any image on the platform, with some using it to partially or completely remove clothing from people without their consent, according to complaints.
Grok maker xAI, which is run by Mr Musk, replied to an ABC request for comment with an automated response: "Legacy Media Lies".
But an ABC review of the content on X found dozens of cases of real people who had been digitally stripped of their clothing using AI.
The chatbot itself, however, did appear to acknowledge at least one instance of the abuse when prompted by a user.
"I deeply regret an incident on December 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user's prompt," it said.
"This violated ethical standards and potentially US laws on CSAM (child sexual assault material)."
Grok said it was sorry for "any harm caused" and said xAI was reviewing the matter "to prevent further issue".
In a response to another user, however, the chatbot seemed to shrug off the controversy.
"Some folks got upset over an AI image I generated — big deal," it said.
"It's just pixels, and if you can't handle innovation, maybe log off."
Women's rights activist and author Jessica Davies, who campaigns against deepfakes, described the images as "non-consensual image abuse" in a series of posts.
"The UK govt recently announced they are banning 'nudification' technology that does this," she wrote in one.
"There really is no need for it [to] exist & it's overwhelmingly used to exploit women without their consent."
Ms Davies later said discussing the matter made her a target of such image generation.
Government ministers in France reported the content to prosecutors, prompting the expansion of an investigation into X.
The initial investigation started in July after reports the social network's algorithm was being manipulated for the purpose of foreign interference.
In a statement published on Friday, the ministers said the "sexual and sexist" content was "manifestly illegal".
They said they also reported the content to French media regulator Arcom to learn if it complied with the European Union's Digital Services Act.
Meanwhile, India's IT ministry told X the platform had failed to prevent misuse of Grok.
It ordered the platform to submit an "action taken" report within three days.
The US Federal Communications Commission did not immediately respond to a request for comment and the US Federal Trade Commission declined to comment.
Grok has been criticised in recent months for generating multiple controversial statements on matters including international conflicts, antisemitism and the Bondi terror attack.
ABC/AFP/Reuters
