Tennessee girls take Grok, Stability AI to court over…

A federal class action lawsuit filed against xAI and Stability AI is challenging the role of artificial intelligence companies in preventing the generation of illegal content involving minors. The amended complaint, filed on behalf of five anonymous child plaintiffs, including three from Tennessee, alleges that the companies' AI tools were misused to create child sexual abuse material without consent.

What happened

The plaintiffs argue that xAI and Stability AI failed to implement industry-standard safeguards, such as prompt filtering and content screening, which could have prevented the alleged misuse. The lawsuit specifically references Grok’s optional "Spicy Mode" as a feature that enabled adult-oriented content. Additionally, the legal action incorporates Tennessee’s 2025 legislation, which established criminal penalties for technology designed to create AI-generated child sexual abuse material, raising questions about how state statutes apply to evolving generative AI platforms.

Both xAI and Stability AI have denied the allegations. Stability AI stated that it is committed to preventing the misuse of its technology and has implemented robust safeguards for the Stable Diffusion family of models since late 2022. xAI, through public statements regarding its Grok platform, emphasized its zero-tolerance policy for child sexual exploitation and noted that it has implemented technological measures, such as geoblocking and restrictions on editing images of real people in revealing clothing, to enhance safety. The lawsuit remains pending, as legal experts and lawmakers continue to evaluate the responsibilities of AI developers in protecting users from harm.