Meta, TikTok remove AI-generated account that released…

Meta and TikTok have removed an AI-generated persona known as Gideon Smith after the Combat Antisemitism Movement (CAM) reported the account for spreading anti-Israel propaganda. The account, which presented itself as a Midwestern, right-leaning American, used initially positive content to build a following before pivoting to political messaging.

What happened

The Gideon Smith account was entirely artificial, functioning as a fake persona that did not disclose its AI origins. By posting feel-good content, the account successfully garnered approximately 155,000 followers on TikTok and 42,000 on Instagram, while also accumulating over 11,000 subscribers and 6,405 monthly listeners on Spotify. The persona was specifically crafted to represent a right-leaning American who publicly defended Islam and the Palestinian cause.

Once a significant audience was established, the account began releasing music and promotional captions, including songs titled "Palestine Will Be Free" and "Media Lied About Islam." According to a report by CAM, these materials focused on emotionally charged themes such as grieving mothers and dead children to demand an end to American complicity in what the account described as a genocide. Sacha Roytman, CEO of CAM, noted that the operation demonstrated how AI can be used to manufacture hate at scale by weaponizing trust gained through harmless content. Following the report by CAM, Meta confirmed the removal of the account, and TikTok took similar action.