In brief
A federal judge has pointed out the use of AI, specifically ChatGPT, by immigration agents to draft use-of-force reports could undermine their credibility and lead to inaccuracies. Experts warn that relying on AI for such sensitive reports detracts from the critical perspective officers must provide, raising ethical and privacy concerns. The Department of Homeland Security has yet to establish clear guidelines for this technology's use in law enforcement.
Tucked in a two-sentence footnote in a voluminous court opinion, a federal judge recently raised concerns about immigration agents using artificial intelligence to write use-of-force reports. U.S. District Judge Sara Ellis highlighted the potential for inaccuracies that could further erode public confidence in law enforcement amidst ongoing scrutiny of police conduct, especially in light of immigration crackdowns and subsequent protests in the Chicago area.
In her opinion, Judge Ellis noted that an agent had asked ChatGPT to compile a narrative from a brief description and images, leading to concerns about the credibility of the reports generated. Experts warn that such reliance on AI without the officer's personal and professional insights fundamentally undermines the report's authenticity, raising questions about privacy and due process.
“What this guy did is the worst of all worlds. This is a nightmare scenario,” said Ian Adams, a criminology expert, in reaction to the judge's findings. Law enforcement agencies nationwide grapple with how to leverage AI responsibly while ensuring accountability and accuracy.
Katie Kinsey from NYU's Policing Project highlighted risks of losing control over potentially sensitive data when using public AI tools. There are calls for law enforcement to implement clearer guidelines and label AI-generated content, to enhance transparency and accountability.
The debate continues as lawmakers and experts emphasize the need for accurate, officer-specific reporting that reflects real-life scenarios, protecting both the integrity of law enforcement and the rights of individuals affected by their actions.
