Police didn't care that Linsey Isaacs' car was the wrong color, and wasn't damaged. They still arrested her because of Flock data.
145 comments
This is also comparable to self-driving car: Waymo's system has achieve the level of "less error than human on average" long time ago, but they are still only doing slow expansion. Why? Because when AI is involved, human naturally expect them to be almost 100% correct, not just barely better than human, otherwise why bother use AI (and all the troubles to legalize for AI) in the first place? So in this case, I guess the police just blindly trust the AI being 99.99% correct.
It’s a camera system, and data can be queried by police. They have to search for something. So the cops searched for a vehicle matching the description in the general area, seemed to take the first one, and called it a day.
That’s not an AI-uncanny-valley. That’s the equivalent of (pre-flock/cameras) looking at vehicle registration list and assuming the one at the top of the list must be it.
The automation-trust is a legitimate concern but it’s not applicable here.
Perhaps more facts will come out, but if we take the article at face value, the cops are at this woman's house, looking at her car and can see with their own eyes that the car right in front of them has obviously not been in an accident. All that is required is for these cops to rub two brain cells together and they will reach the conclusion that Flock misread a license plate.
It's also worth emphasizing that this wasn't for a parking ticket. The extremely low level of care with which these public servants are conducting a manslaughter investigation is somewhat alarming.
Yes, but it is still your fault. “I am dumb and I was deceived” is no valid defense, least of all for a police officer.
Police approving AI PRs without reading them: This is the way the world works now. Get with the times.
Yes, the system is broken even before we get to Flock (or whatever tech) but Flock makes it worse. If a bad tool is badly used to cause harm, it’s fair to criticise its existence. You can’t fix police abuse with a snap of the finger, so you need to start but taking away the tools which facilitate it.
If it were your ass which had been thrown in solitary, would you be pleading with your lawyer to “go easy on Flock. Sure, they allowed a major disruption and trauma into my life, but they’re just a tool”?
The people who say there are problems with the human police officers are perceived as excusing Flock.
Who is responsible for the area inside a square, the width or the height? It is not an additive relationship.
And if your country happens to have a police force that is historically bad at its job, giving them that power seems like a really stupid idea.
Certain technology just has too much potential to be misused / people repeatedly prove they can't use it properly. It also comes with risks of making authoritarian takeover easier.
However, here, it seems they used Flock a bit like a regular ANPR. The actions they took independent of Flock show there are better stories to use to criticise this technology.
A lot of people coming to this story seem to have the idea that it's unthinkable for someone to spend 13 days in jail when they have clear evidence they're innocent, so there must be some novel explanation for how this could happen. But as any criminal defense lawyer will tell you it's very thinkable. She was ordered to report to jail on a Friday afternoon, the standard stratagem cops use to ensure people they don't like spend at least a weekend behind bars. She was denied bail, even though she made no move to flee in the months where she knew the police thought she did it, because the courts in many places view mandatory pretrial detention as a punishment for presumptively guilty people.
If a random person walks into a police station and accuses a random stranger of murder, and the police put that stranger in jail based on that alone, the main problem is not the accuser.
But seriously, privacy must not become a sided issue. Attacks on privacy are bipartisan, the defense of it would be weakened if it was not bipartisan. Civil liberties protected by the constitution should not be controversial.
Flock didn't fail to inspect the car for damage and not find any, flock didn't take 13 days to conduct a cursory review of evidence, flock didn't fail to request cell tower triangulation data and rule out her being in the location of the accident...
I get that people feel their privacy's invaded by being filmed, but this story doesn't appear to have any more to do with Flock than what the officers had for breakfast or the brand of air freshener she had in her car at the time.
With dumb camera footage, the cops looks at the plates, visual indicators, etc. That does not make them more competent or less prone to abuse. But here, Flock's software literally told them this woman was the one they were looking for, despite no evidence supporting this.
This is 100% both on the police and on Flock. Some technologies don't deserve to exist. Facial recognition and ALPR is one of those, because the error rates are too high and the stakes are too high.
Nor does Flock - Flock merely provides a photo and timestamp, which should have been scrutised like any other evidence.
The Flock data showed:
- Car of same make/model nearby at similar time to the accident
- Possible colour match (eyewitnesses gave varying reports on the colour of the perpetrating vehicle). But a match could have been ruled out in minutes had police inspected paint transfer onto the struck vehicle
- A number plate non-match (first three characters were reported to 911 and did not match)
- That's all!
So police didn't do their job (scutinise the evidence), and possibly worse, they may have fabricated evidence (since police claimed Isaacs' vehicle was damaged, but it was in factory-new condition) - which may explain why they're shifting blame to Flock!
Could they have, you know, double checked it? Yes, obviously. But they didn't.
I agree that this story is more about the incredible incompetence of the police involved than flock attempting to record everyone and everything, but flock giving the police an excuse to stop looking and arrest an innocent is by no means irrelevant.
- Does anything connect this vehicle to the accident?
- Did it look damaged; as though it had been in a crash?
- Did it look like it was fleeing or driving erratically?
- Was there anything suspicious about the vehicle or the driver?
Police would have deemed the photo irrelevant and moved on. But that didn't happen in this case.
Their failure to do so doesn't have to do with source of the image (Flock, shop CCTV, dashcam), but with their inexplicable lack of rigour.
The accusation that some machine made any decision here goes beyond the reporting in the article. It seems concocted to raise AI alarm. All we have is that it supplied accurate data that police then abused. That isn't in the vicinity of "outsource[d] basic critical thinking to machines".
I want such general government surveillance banned, but the machines in this story had no more volition than a breathalyzer.
As far as I know, it lets law enforcement query for things against the data. Can be specific (like a license plate) or more general (like a dark colored mid-sized SUV around <location> at <time>).
To get where this story is at, cops here must have done the latter, and taken the first name off the top of the pile and patted themselves on the back, and then waited 7 months, and went and arrested her. Unless there’s an explanation for a 7 month delay, it seems designed to allow defensive evidence to spoil.
There isn’t an uncanny-valley of automation here. There is just lazy, grossly-incompetent, bad-faith, and malicious cops/investigators.
But they didn't question the quality of the evidence. And there is a reason for that.
Guns can be used for all sorts of things. A handgun in a house is likely to be used for murder/suicide.
Modern AI was and is a mistake. It's only going to get worst before it gets better.
Unfortunately, our current government in the US is hard AI-pilled (oh, sorry, "super-intelligence-pilled"). They use it every day to present propaganda to the public via social media.
Ban AI use in all branches of government, and in policing. At least until there are ethical standards put in place that are very heavily punished when violated.
Also, state and federal level politicians should be prohibited from using social media in anything other than a purely personal basis without mention of political office or without speaking on the topic of politics. Want to post cool pictures of your family? Go for it. Speaking to your constituency? Must be strongly vetted for ethical violations, and punishable by immediate removal from office and a 10-year blacklist.
I expect the solution they will settle on is to form a department for interacting with technology like this, who understand its outputs are not edicts.
you can't really expect any meaningful police reforms (such as liability and insurance) because anyone who is in any position to enact them is perfectly fine with dumb muscle that holds a monopoly on violence and is deferential to them. in fact the public disliking the police is an ideal outcome for those decision makers as it gives them more leverage over the police.
Partial matches, correct matches but no investigation into things like paint transfer, it's happened way too many times (hint: one is too many times for things that can incarcerate people).
It's like they're speedrunning unworthiness to hold the monopoly on violence. This is how you get riots and revolutions. Sadly, today's Western world is complicit and complacent. Nobody who is pro-surveillance state will change their mind until it affects them or someone close to them.
Read the full thread on Hacker News →
Related stories
- Hacker News · 1 points · about 8 hours ago
- Hacker News · 6 points · about 8 hours ago
- Hacker News · 3 points · 6 days ago
- Hacker News · 1 points · 10 days ago
- Hacker News · 377 points · 15 days ago
- The Verge · 0 points · about 9 hours ago