AI-generated ads raise fresh concerns over racist online…

Independent game publisher Finji alleged that TikTok ran unauthorized AI-generated versions of advertisements for its game Usual June. The company stated that it had not approved the altered content, which reportedly contained racist and sexist imagery.

What happened

The incident involved the circulation of AI-generated advertisements that featured content the publisher did not authorize. While TikTok disputed aspects of the publisher’s account, the episode highlighted significant risks associated with the proliferation of AI-generated advertising. This case is part of a broader trend where generative AI tools are used to create realistic marketing materials at low cost and speed, often leading to the spread of content referred to as AI slop. Industry observers have noted an increase in AI-produced ads that utilize sensational or misleading visuals to garner attention, creating substantial moderation challenges for major digital platforms that review millions of advertisements daily. These incidents underscore how generative AI systems can reproduce or amplify harmful stereotypes if misused or trained on biased data. As generative AI becomes more deeply integrated into the advertising industry, companies are facing increasing pressure to strengthen content review processes to ensure that AI-generated materials comply with policies against hate speech and discriminatory content.