AI-generated protesters passed off as real Australians -…

In August 2024, spam Facebook accounts began circulating AI-generated videos that falsely portray Australians protesting sensitive political and social issues. These clips, which have garnered tens of thousands of views, use synthetic media to simulate rallies regarding benefit fraud, halal meat, and sharia law.

What happened

The videos exhibit multiple technical hallmarks of AI synthesis, including garbled text, anatomical distortions, and illogical visual continuity. In one instance, a protestor is depicted with three hands while holding a sign that reads "SEND THEM ARSK" instead of "Send them back." Another clip features a man protesting halal meat while holding a sign with the misspelling "halala."

Beyond textual errors, the clips contain significant spatial and logical inconsistencies. In several videos, vehicles are shown parked on the right-hand side of the road, which is illegal in Australia. Furthermore, the videos demonstrate erratic object manipulation; one clip shows a pedestrian walking behind a speaker, vanishing, and then reappearing walking in the opposite direction. Verbal cues also indicate synthetic generation, such as a speaker mispronouncing "sharia" as "sheria" mid-sentence, and another speaker delivering contradictory statements by simultaneously advocating for the protection of asylum seekers and their immediate deportation. These visual and auditory errors serve as clear indicators that the content was not filmed at real events but was instead fabricated using generative AI.