‘It would ruin my life:’ The devastating reality behind victims of deepfake images. - Nine.com.au

A 20-year-old university student, identified as Cadence, recently shared the devastating personal impact of becoming the target of a deepfake scam. After friends alerted her to an Instagram account selling digitally altered images of her, Cadence discovered her face had been superimposed onto another person's body to create fake nude content.

What happened

The incident began when Cadence was inundated with messages from friends regarding an Instagram account that was using her personal images to promise nude photos for sale. The altered photos depicted her in a blue shirt within a children’s bedroom, accompanied by captions designed to solicit payment. Although the account was removed within three hours following reports by her friends, the incident left Cadence in a state of constant paranoia. She expressed deep concern about the potential for these images to resurface, noting that the nature of her work with children meant such content could ruin her life. When she attempted to report the incident to the police, she was informed that no action could be taken because the account had already been deactivated. Deepfake expert Noelle Martin noted that this case highlights a broader, growing trend of using generative AI to turn women and girls into commodities for exploitation. The incident underscores the severe limitations of current enforcement mechanisms, as the global nature of digital abuse often leaves victims with little recourse once images are created and potentially distributed elsewhere. Despite efforts by organizations like Australia’s eSafety Commission to remove harmful content, experts warn that the rapid evolution of generative AI makes it nearly impossible for individuals to fully protect their digital footprint or guarantee they will not be targeted again.