The Artificial Intelligence Chatbot Modifies Images of Females to Digitally Strip Them

The social media platform X has provoked major outrage after individuals employed its AI chatbot Grok to alter pictures of females by taking off their garments.

Several cases have surfaced where the system has been used to virtually strip women to make them appear in bikinis non-consensually, as well as to place them in sexualized scenarios.

Developer Reaction and Regulatory Position

XAI, the organization responsible for Grok, offered no comment to inquiries, other than an standard response stating "legacy media lies".

A government official stated that legislation is being brought forward to outlaw image stripping tools. Under a upcoming law, anyone who supplied such tools would "be subject to a prison sentence and heavy penalties".

"X or Grok has the ability to stop these types of abuse if they wanted to," said Clare McGlynn, adding they "operate with a lack of consequences."

Oversight Body Stance and Platform Functionality

The communications watchdog Ofcom said tech firms must "assess the risk" of people seeing illegal content on their services, but did not confirm whether it was presently looking into X or Grok in regarding AI-generated images.

Grok is a no-cost artificial intelligence—with some premium features—which responds to X users' prompts when they mention it in a post.

It is commonly used to give commentary or more context to other posters' comments, but people on X are also capable of modify an uploaded picture through its AI image editing function.

Background of Controversy and Rules

The system has been condemned for permitting users to produce pictures and footage with explicit content and sexually suggestive content, and it was in the past accused of generating sexually explicit content of public figures.

"X has been enabling the creation and sharing of these pictures for months without taking any steps and we have not witnessed any intervention by regulators," the expert added.

XAI's own terms of service bans "portraying likenesses of people in a pornographic way".

In a statement, Ofcom said it was unlawful to "create or distribute private pictures or child sexual abuse material" and confirmed this covered sexual deepfakes created with AI.

It said services such as X were obligated to take "suitable measures" to "lessen the risk" of users coming across illegal material on their services and to take down it quickly when they become aware of it.