AI avatars in digital blackface want to sell you this belt buckle - The Verge

AI-generated influencers are appearing on social media platforms, often mimicking marginalized individuals, to sell dropshipped products. These avatars, like one named Aliyah, are used to create a false sense of empathy and capitalize on the desire to support small businesses.

What happened

Aliyah, a light-skinned Black woman, was presented as a struggling artisan selling handmade belt buckles. However, Aliyah is not real; she is an AI-generated character, and the products are mass-produced items available on sites like Shein for a fraction of the price. The videos use robotic voices and inconsistent details to manipulate viewers. Similar accounts, featuring avatars of various ethnicities, also exist, but the AI-generated Black women receive the most engagement. Experts warn that these scams are growing, with potentially hundreds of new accounts appearing daily. The avatars often pretend to make the items, go to fairs to display their products, and respond to comments through automation.