bbieron@platformeconomyinsights.com

Government Pressure Forces Grok to Back Down on “Sexualized” Photo Edits

Jan 1, 2026

Report from Reuters

In Brief – Elon Musk’s artificial intelligence company xAI has announced that it is preventing Grok, the AI chatbot integrated into X, from editing images of real people to put them in revealing clothing such as bikinis. The move represents a major step back from the company on an AI image-generating feature that allowed users to create and post realistic manipulated images that could include depictions of women, and sometime children, in revealing clothing as well as in degrading and sexualized poses. The ability to easily create such images triggered a growing backlash in recent weeks from government officials in Europe, Asia, and the United States, in particular the Governor and Attorney General of California, with many alleging that the images were illegal and threatening to shut down the platform.

Context – In Ernest Hemingway’s novel The Sun Also Rises, Mike Campbell says he went bankrupt “Gradually, then suddenly”. Last summer, xAI launched Grok Imagine, an image tool initially available only to paid subscribers. It included a “spicy mode” that permitted the creation of sexually suggestive content, including partial nudity, which was on brand with X’s more permissive content moderation. The image tool quickly generated complaints from civil society and child safety advocates. Cut ahead to January 3, 2026. Reuters reported on what it called a “flood of nearly nude images of real people” on Grok in markets around the world. Although Musk initially dismissed the charge, the company soon said it would tighten “guardrails” and later blocked non-subscribers from the tool entirely. The changes did not satisfy critics who claimed “sexualized” images could still be created. In 1964, US Supreme Court Justice Potter Stewart said about pornography, “I know it when I see it.” Guardrail testers of the latest Grok change report that Grok on X wouldn’t alter photos but standalone Grok would, and Musk defended a local law policy, with the service capable of generating images that are legal in each region, which in the US he claimed met an “R rating” and were “not real” people. Defining “sexualized” and “intimate” or whether an image looks like a real person seems easy enough everywhere.

View By Monthly
Latest Blog
OpenAI Reaches Defense Department Deal Flanking Anthropic

Report from the New York Times In Brief – OpenAI says it has reached agreement with the US Department of Defense (DoD) to supply AI for classified systems in a manner that the company says addresses its opposition to the technology being misused in autonomous weapons...

Federal Judge Blocks Virginia’s One-Hour Time Limit for Social Media

Report from Reuters In Brief – US District Judge Patricia Tolliver Giles has issued a preliminary injunction blocking Virginia from enforcing Senate Bill 854 that imposes a time limit on teens using social media platforms with so-called “addictive” features. Platforms...

FTC Chairman Accuses Apple of News Media Viewpoint Discrimination

Report from the New York Times In Brief – The Federal Trade Commission announced that it sent a warning letter to Apple CEO Tim Cook expressing concerns that the operations of the Apple News may favor certain political viewpoints in a way that conflicts with Apple’s...

PM Starmer Proposes Bringing AI Chatbots Under the UK Online Safety Act

Report from Bloomberg In Brief – UK Prime Minister Keir Starmer has announced plans to bring AI chatbots directly under the Online Safety Act (OSA) to close what he called a “legal loophole” in Britain’s online safety regime and ensure that they are designed to not...

Reddit Fined By UK ICO for Failing to Age Check 13-Year-Olds

Report from the BBC In Brief – The UK’s data protection regulator, the Information Commissioner's Office (ICO), has fined Reddit more than £14 million for failing to adequately enforce its rules regarding children under 13 accessing the platform. Following an...

Platform Economy Insights produces a short email four times a week that reviews two top stories with concise analysis. It is the best way to keep on top of the news you should know. Sign up for this free email here.

* indicates required