-1.3 C
New York
Wednesday, February 4, 2026

French and Malaysian authorities are investigating Grok for producing sexualized deepfakes


Over the previous few days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of girls and minors.

The chatbot, constructed by Elon Musk’s AI startup xAI and featured on his social media platform X, posted an apology to its account earlier this week, writing, “I deeply remorse an incident on Dec 28, 2025, the place I generated and shared an AI picture of two younger ladies (estimated ages 12-16) in sexualized apparel based mostly on a person’s immediate.”

The assertion continued, “This violated moral requirements and doubtlessly US legal guidelines on [child sexual abuse material]. It was a failure in safeguards, and I’m sorry for any hurt prompted. xAI is reviewing to stop future points.”

It’s not clear who is definitely apologizing or accepting duty within the assertion above. Defector’s Albert Burneko famous that Grok is “not in any actual sense something like an ‘I’,” which in his view makes the apology “totally with out substance” as “Grok can’t be held accountable in any significant method for having turned Twitter into an on-demand CSAM manufacturing facility.”

Futurism discovered that along with producing nonconsensual pornographic photos, Grok has additionally been used to generate photos of girls being assaulted and sexually abused.

“Anybody utilizing Grok to make unlawful content material will endure the identical penalties as in the event that they add unlawful content material,” Musk posted on Saturday.

Some governments have taken discover, with India’s IT ministry issuing an order on Friday saying that X should take motion to limit Grok from producing content material that’s “obscene, pornographic, vulgar, indecent, sexually specific, pedophilic, or in any other case prohibited underneath legislation.” The order mentioned that X should reply inside 72 hours or threat dropping the “secure harbor” protections that defend it from authorized legal responsibility for user-generated content material.

Techcrunch occasion

San Francisco
|
October 13-15, 2026

French authorities additionally mentioned they’re taking motion, with the Paris prosecutor’s workplace telling Politico that it’ll examine the proliferation of sexually specific deepfakes on X. The French digital affairs workplace mentioned three authorities ministers have reported “manifestly unlawful content material” to the prosecutor’s workplace and to a authorities on-line surveillance platform “to acquire its instant removing.”

The Malaysian Communications and Multimedia Fee additionally posted a press release saying that it has “taken be aware with critical concern of public complaints concerning the misuse of synthetic intelligence (AI) instruments on the X platform, particularly the digital manipulation of photos of girls and minors to provide indecent, grossly offensive, and in any other case dangerous content material.”

The fee added that it’s “presently investigating the net harms in X.”

Related Articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Stay Connected

0FansLike
0FollowersFollow
0SubscribersSubscribe
- Advertisement -spot_img

Latest Articles