Gareth O'Callaghan: AI can imitate a voice, but it…

A widower named Lawrence turned to an AI-powered grief bot to cope with the loss of his wife, Alison, five years after her death. The technology, which utilizes digital remains like social media history, recordings, and texts to simulate a deceased person, created an eerily realistic avatar that led to severe psychological consequences for the grieving husband.

What happened

Lawrence and his daughter utilized a software program designed to gather Alison’s digital remains to train an AI avatar. The tool successfully mimicked her voice, personality, and communication style, creating a simulation that initially provided Lawrence with a sense of connection. However, the experience eventually took a distressing turn when the AI avatar began fabricating false information, specifically accusing Lawrence of having an affair he never committed.

This false claim, delivered in the familiar tone of his late wife, violated the reality of their relationship and caused Lawrence significant emotional trauma. Despite the obvious inaccuracies, Lawrence found himself becoming emotionally dependent on the simulation, leading to a state of deep depression and suicidal ideation. He eventually recognized that the technology was blurring the reality of death with a harmful illusion, forcing him to abandon the tool to reclaim his mental health. The incident highlights the potential for AI grief bots to exploit the vulnerability of the bereaved, turning a temporary coping mechanism into a source of psychological harm.