National Center for State Courts raises alarm over…
An investigation by the National Center for State Courts highlights rising risks of AI-generated evidence in legal proceedings including a case involving…
- Incident date
- Jul 2026
- Target
- unnamed Florida woman
The National Center for State Courts (NCSC) has issued warnings regarding the threat that AI-generated evidence poses to public trust in the judicial system. As legal professionals grapple with this new frontier, concerns are mounting that artificial intelligence is being used to manipulate court outcomes by introducing fake digital materials.
What happened
The NCSC report highlights a specific instance in Florida where a woman was wrongfully arrested and spent two days in jail after her ex-boyfriend allegedly used AI to fabricate a series of text messages. The messages were used to falsely claim she had violated a protective order, though prosecutors eventually dropped the charges once the fabrication was identified.
Beyond this personal incident, the NCSC points to a September 2025 California civil case as a significant milestone in judicial history. In that matter, self-represented plaintiffs submitted a video that was identified as a crude deepfake. Alameda County Superior Court Judge Victoria Kolakowski subsequently issued a termination order to dismiss the case. While there are currently no confirmed instances of attorneys knowingly submitting deepfakes, experts like Santa Clara County Superior Court Judge Erica Yew warn that AI-generated evidence is likely occurring more frequently than is publicly reported.
These incidents have sparked a broader debate about the integrity of digital evidence. The NCSC and the Thomson Reuters Institute have formed the AI Policy Consortium for Law & Courts to address these challenges. Discussions include the "Liar’s Dividend," where the mere existence of AI technology allows guilty parties to cast doubt on authentic evidence. Despite proposals to update evidence rules, the U.S. Judicial Conference’s Advisory Committee on Evidence Rules has maintained that existing standards of authenticity remain sufficient. To assist the judiciary, the consortium has developed resources, including bench cards that provide judges with specific questions to verify the integrity and metadata of digital files submitted as evidence.