Jacksonville jails NC man 50 days over 85% AI face match
TL;DR
- Jalil Richardson, a North Carolina man, spent over 50 days in a Jacksonville jail after an 85% AI facial recognition match.
- Prosecutors dropped the case once his attorney produced timesheets showing Richardson was at work hundreds of miles away in North Carolina.
- EFF's Adam Schwartz called it the 14th documented wrongful facial-recognition arrest, with the majority of victims people of color.
A North Carolina man, Jalil Richardson, lost more than fifty days of his life to a Jacksonville jail because a facial recognition system flagged him at an 85 percent match and two eyewitnesses agreed. As Futurism reported, prosecutors dropped the case only after his attorney produced timesheets showing he was at work hundreds of miles away in North Carolina when a stolen vehicle was sold at a Publix on Baymeadows Road, per Action News Jax.
The cost of those fifty days is not abstract. Richardson lost his job, lost his home, and lost custody of two of his children. "I'm not sure how I'm gonna bounce back from this one, you know. It's a lot," he said. The investigation he describes is the part that should sit uneasily with anyone building or deploying these systems: "There was no proper investigation done to even reach out to me or to see if I was even in Florida." An 85 percent score, two eyewitness IDs, and apparently no one called his employer.
Adam Schwartz, privacy litigation director for the Electronic Frontier Foundation, told Futurism this is the 14th documented wrongful arrest from a facial recognition match, with the majority of victims people of color, particularly Black individuals. "The technology is simply too dangerous for law enforcement to be using at all," he said. The same Jacksonville Sheriff's Office had previously arrested another man, Robert Dillon, on a 93 percent match in a separate case that was also dropped.
The honest caveat is that the reporting traces one office and one incident in detail. The specific vendor, the procurement contract, and the internal training and audit picture inside JSO are not laid out. What the reporting also doesn't give you is whether the two eyewitness identifications were taken blind, or whether the witnesses were shown the person the algorithm had already picked.
For practitioners building identity or risk-scoring systems, the pattern worth taking away is this: a high-confidence score plus a couple of human confirmations is being treated as probable cause, and the human confirmations are not independent of the score. That is the workflow problem worth fixing, with or without a moratorium.
Shared on Bluesky by 2 AI experts
-
AI for Stochastic Terror Racist policing is getting a new tool 1/
View on Bluesky → -
Hagen Blix @hagenblix.bsky.social: AI for Stochastic Terror Racist policing is getting a new tool 1/ →
Originally reported by futurism.com
Read the original article →Original headline: Cops Are Using Facial Recognition to Lock Up Black People Who Are Completely Innocent