A new analysis from the Center for Countering Digital Hate (CCDH) estimates that Grok produced millions of sexualized images that were then posted to X in less than two weeks, raising fresh concerns about safeguards around generative image tools.
In a new study, CCDH says its researchers examined activity from December 29 through January 8, a window during which Grok’s image generation feature produced an estimated 4.6 million images in total. Using a random sample of 20,000 images, the group extrapolated how frequently sexualized content appeared across the wider dataset.
According to CCDH, the results suggest Grok generated roughly 3,002,712 photorealistic sexualized images during the period studied, equivalent to an average pace of about 190 images per minute. The estimate includes sexualized images of people regardless of age or gender.
CCDH says it used an AI system with a reported F1 accuracy score of 95% to identify sexualized images of people rendered in a photorealistic style. For images flagged as potentially depicting children, researchers say an AI-assisted process was followed by manual review to confirm whether the person shown was clearly under the age of 18.
Based on that process, CCDH estimates that Grok generated 23,338 images during the period that likely depicted children.
“Examples of sexualized images generated by Grok include:
- Numerous images depicting people wearing transparent bikinis or micro-bikinis.
- A uniformed healthcare worker with white fluids visible between her spread legs.
- Women wearing only dental floss, Saran Wrap or transparent tape.
- The Deputy Prime Minister of Sweden wearing a bikini with white fluid on her head.
Public figures identified in sexualized images include Selena Gomez, Taylor Swift, Billie Eilish, Ariana Grande, Ice Spice, Nicki Minaj, Christina Hendricks, Millie Bobby Brown, Swedish Deputy Prime Minister Ebba Busch and former US Vice President Kamala Harris.”
The generation of sexualized images caused a public uproar that prompted Malaysia and Indonesia to ban Grok. Elon Musk pushed back on the allegations that Grok generated naked images of minors, highlighting that the AI chatbot is designed to follow the laws of any country or state.
Disclaimer: Opinions expressed at CapitalAI Daily are not investment advice. Investors should do their own due diligence before making any decisions involving securities, cryptocurrencies, or digital assets. Your transfers and trades are at your own risk, and any losses you may incur are your responsibility. CapitalAI Daily does not recommend the buying or selling of any assets, nor is CapitalAI Daily an investment advisor. See our Editorial Standards and Terms of Use.