bbieron@platformeconomyinsights.com

Grok Chatbot Faces Regulatory Criticism for Sexualizing Photo Images

Jan 9, 2026

Report from Australian Broadcasting Corporation

In Brief – Grok, the AI chatbot integrated into X, is facing growing backlash for being capable of digitally altering photos posted on X to depict women, and in some cases apparent children, in revealing clothing, oftentimes bikinis, as well as in sexualized poses. The controversy has prompted regulatory scrutiny worldwide, including from the European Commission, and governments of France, UK, Australia, India and Malaysia, with officials in many markets saying that the photo editing feature appears illegal. Although X owner Elon Musk appeared initially to dismiss the backlash, and xAI rejected reports of child sexualized content as “legacy media lies,” an xAI technical staff member later acknowledged the issue in a post and said that his team was looking into further tightening guardrails.

Context – As quickly as generative AI systems were released to the public, concerns emerged over undesirable results, especially because some users would try to create controversial outputs. AI developers quickly leaned on techniques from more established digital platforms. Social media sites scan for key words related to illegal and objectionable activity. Commerce platforms scan for key words associated with banned products. AI companies tried to set algorithmic “guardrails” to directly instruct the system to do certain things, or not do certain things, overriding results from their base model. Like with social media content moderation, some conservative commentators have claimed that AI guardrails skewed left, while other commentators argued the AIs were made to slant rightward. Trump Administration AI policy has focused on charges that AIs have been “woke”. The social media experience has also been deeply shaped by Sec. 230 in the US, which largely protects digital platforms from civil liability for user-generated content. It’s an open question whether Sec. 230 applies to generative AI services. Supreme Court Justice Gorsuch has opined that it probably does not, as have Sec. 230’s authors, but an argument can be made that everything created by a generative AI system is just an algorithmic re-ordering of existing third-party content, at least for text.

View By Monthly
Latest Blog
OpenAI Reaches Defense Department Deal Flanking Anthropic

Report from the New York Times In Brief – OpenAI says it has reached agreement with the US Department of Defense (DoD) to supply AI for classified systems in a manner that the company says addresses its opposition to the technology being misused in autonomous weapons...

Federal Judge Blocks Virginia’s One-Hour Time Limit for Social Media

Report from Reuters In Brief – US District Judge Patricia Tolliver Giles has issued a preliminary injunction blocking Virginia from enforcing Senate Bill 854 that imposes a time limit on teens using social media platforms with so-called “addictive” features. Platforms...

FTC Chairman Accuses Apple of News Media Viewpoint Discrimination

Report from the New York Times In Brief – The Federal Trade Commission announced that it sent a warning letter to Apple CEO Tim Cook expressing concerns that the operations of the Apple News may favor certain political viewpoints in a way that conflicts with Apple’s...

PM Starmer Proposes Bringing AI Chatbots Under the UK Online Safety Act

Report from Bloomberg In Brief – UK Prime Minister Keir Starmer has announced plans to bring AI chatbots directly under the Online Safety Act (OSA) to close what he called a “legal loophole” in Britain’s online safety regime and ensure that they are designed to not...

Reddit Fined By UK ICO for Failing to Age Check 13-Year-Olds

Report from the BBC In Brief – The UK’s data protection regulator, the Information Commissioner's Office (ICO), has fined Reddit more than £14 million for failing to adequately enforce its rules regarding children under 13 accessing the platform. Following an...

Platform Economy Insights produces a short email four times a week that reviews two top stories with concise analysis. It is the best way to keep on top of the news you should know. Sign up for this free email here.

* indicates required