Peers challenge police use of artificial intelligence

31 March 2022, 08:52

Facial recognition technology in use in London
Facial Recognition Technology. Picture: PA

The Lords Justice and Home Affairs Committee raised concerns about a lack of oversight for new technologies used by law enforcement agencies.

Law enforcement agencies’ use of artificial intelligence and facial recognition technology are not subject to proper oversight and risk exacerbating discrimination, peers have warned.

New technologies were being created in a “new Wild West” without the law and public awareness keeping up with developments, a parliamentary committee said.

The Lords Justice and Home Affairs Committee warned that the lack of oversight meant “users are in effect making it up as they go along”.

Facial Recognition Technology
A board detailing facial recognition technology in use in Leicester Square, London (Kirsty O’Connor/PA)

The cross-party group said AI had the potential to improve people’s lives but could have “serious implications” for human rights and civil liberties in the justice system.

“Algorithms are being used to improve crime detection, aid the security categorisation of prisoners, streamline entry clearance processes at our borders and generate new insights that feed into the entire criminal justice pipeline,” the peers said.

Scrutiny was not happening to ensure new tools were “safe, necessary, proportionate and effective”.

“Instead, we uncovered a landscape, a new Wild West, in which new technologies are developing at a pace that public awareness, government and legislation have not kept up with.”

Police forces and other agencies were buying equipment in a “worryingly opaque” market, with details of how systems work kept secret due to firms’ insistence on commercial confidentiality.

The peers also had concerns about AI being used in “predictive policing” – forecasting crime before it happened.

There was a danger it could make problems of discrimination worse by embedding in algorithms the “human bias” contained in the original data.

Professor Karen Yeung, an expert in law, ethics and informatics at the University of Birmingham, told the committee that “criminal risk assessment” tools were not focused on white-collar crimes such as insider trading, due to the lack of data, but were instead focused on the kind of crimes for which there was more information.

Prof Yeung said: “This is really pernicious. We are looking at high-volume data that is mostly about poor people, and we are turning it into prediction tools about poor people.

“We are leaving whole swathes of society untouched by those tools.”

The peers called for a mandatory register of algorithms used in criminal justice tools, a national body to set standards and certify new technology and new local ethics committees to oversee its use.

Baroness Hamwee, the Liberal Democrat chairwoman of the committee, said: “What would it be like to be convicted and imprisoned on the basis of AI which you don’t understand and which you can’t challenge?

“Without proper safeguards, advanced technologies may affect human rights, undermine the fairness of trials, worsen inequalities and weaken the rule of law. The tools available must be fit for purpose, and not be used unchecked.”

By Press Association

More Technology News

See more More Technology News

Glastonbury Festival 2022

Glastonbury 2022 broke data records, EE says

A child using a laptop computer

Pupils ‘AirDrop nudes in maths and use Google Drive to store images’, MPs told

Over 20 million US dollars were raised by the public for drones to fight the Russian invasion

Tech company to gift Bayraktar drones to Ukraine after millions raised by public

A mixed reality holographic patient

UK medical students training on hologram patients in world-first

Laptop

Warning new internet laws will hand ministers ‘unprecedented’ powers

A battery changing station of Nio brand electrical car (Alamy)

Two dead after Nio electric car they were testing ‘falls from building’

Alexa to expand

Amazon’s Alexa could mimic the voices of dead relatives

Ai-Da at work

Robot painting Glastonbury’s famous faces says festival atmosphere is ‘electric’

Instagram's new age verification tools, which have started being testing in the US

Instagram begins testing new age verification tools

A security surveillance camera is seen near the Microsoft office building in Beijing

Microsoft: Russian cyber spying targets 42 Ukraine allies

Social media apps on a smartphone

Meta removes ‘large numbers’ of upskirting images found on Facebook

Rio Ferdinand poses for photographs with children at 10 Downing Street to celebrate the launch of the Diana Award’s annual anti-bullying campaign Don’t Face It Alone (Stefan Rousseau/PA)

Rio Ferdinand calls for new ‘inspiring’ online platform to combat child bullying

A screenshot of the Microsoft Outlook email service

Microsoft’s Outlook email service hit by outage

Elon Musk

Elon Musk’s proposed £35.8bn Twitter deal gets board endorsement

Apple unveils new products

Guide Dogs launches scheme to provide free iPads to children with sight loss

A woman using a laptop

Cloudflare outage knocks hundreds of websites offline