Letter to Peter Kyle: Keep our right not to be subjected to decisions based solely on AI

Civil society organisations, trade unions, academics and campaigners have called for the government to scrap proposals to remove the right not to be subject to decisions made by automated or AI systems.

The signatories of a letter to the Secretary of State for Science, Innovation and Technology the work in the areas data policy, policing, racial justice, employment, health, disability rights, welfare and criminal justice where automated systems are increasingly being deployed to make decisions, which can have a profound impact on an individual’s life.

However, automated decisions are sometimes incorrect and we need to ensure humans are in control of decisions.

The Data Use and Access (DUA) Bill proposes to remove the existing right that people in the UK have not to be subject to a decision based solely on automated processing. This could impact people in many ways.

Open letter

Calling on the UK government to scrap proposals to remove the right not to be subject to decisions made by automated or AI systems

Read now

James Baker, Platform Power Programme Manager at Open Rights Group said:

“AI is rapidly expanding into all areas of public life. Many AI systems have been proven to magnify discrimination and inequality in society.

“We currently have the right not to be subject to a legal, or significant decision based solely on automated processing.

“It’s vital that the government reconsiders these proposals and protects us from harmful decisions.”

In 2019, an algorithm misgraded the A-level results of thousands of students – as a result 40% came out lower than expected. Uber was sued after the company used an algorithm to ‘robo-fire’ many of its drivers, and problems with the Post Office Horizon computer system resulted in hundreds of people being wrongly prosecuted. 

What’s changing?

Under Art 22 of GDPR we have the right not to be subject to a decision based solely on automated processing, including profiling, which produces legal effects concerning him or her or similarly significantly affects him or her.

This right would be removed if the DUA Bill is passed. Clause 80 of the Data Bill would deprive individuals of this important right in most circumstances and exacerbate power imbalances by requiring individuals to scrutinise, contest and assert their rights against decisions made by AI.

Briefing on the data bill

Read the Open Rights Group briefing outlining all of our concerns with the Data Use and Access Bill

Find out more

Sign the petition

Amend the Data Bill to protect our right to request a human review of automated decisions that impact your life

Take action
Hands Off Our Data