Derbyshire police officer investigated over alleged AI-generated evidence - Computing UK

A Derbyshire police officer has been suspended from frontline duties and is the subject of a formal criminal investigation regarding allegations of perverting the course of justice. The officer is accused of using artificial intelligence systems to create fraudulent evidential material across a number of cases, marking what is believed to be the first incident of its kind in the United Kingdom.

What happened

Derbyshire police confirmed that they have launched a criminal investigation into the alleged misconduct, working in close coordination with the Crown Prosecution Service to evaluate potentially impacted cases. While the investigation remains in its early stages and no arrests have been made, authorities are currently engaging with defense teams and the courts to address the integrity of the evidence in question. The specific role of the officer and the exact nature of the generated material have not been disclosed.

This incident follows the recent launch of PoliceAI, a national center designed to integrate AI into policing to reduce bureaucratic burdens. The discovery has highlighted broader concerns regarding the risks of hallucinations in large language models (LLMs) and the potential for AI-generated inaccuracies to contaminate evidence or mislead judicial proceedings. Alex Murray, head of PoliceAI, has previously intervened to temporarily halt the use of generative AI for certain tasks, emphasizing that technologies within the criminal justice system must meet standards of accuracy beyond reasonable doubt. As the investigation continues, officials are focused on assessing the impact of the alleged manipulation on the judicial process.