Experts have warned that a “hasty implementation” of artificial intelligence (AI) in the Department for Work and Pensions’ (DWP) sickness and disability benefits could potentially “harm” claimants. There are concerns that the “historical data used to train AI may perpetuate bias and discrimination” within the benefits system.
A Guardian investigation revealed that the machine-learning programme utilised by the DWP to detect universal credit fraud disproportionately targeted certain groups over others, showing bias based on age, disability, marital status, and nationality. Shelley Hopkinson, head of policy and influencing at Turn2us, stated: “AI has the potential to improve speed and consistency in the social security system, but errors from rushed implementation could cause serious harm to people relying on support. We are concerned that the historical data used to train AI may perpetuate bias and discrimination against marginalised groups.”
She further added: “AI integration should be guided by consultation and transparency so that the system meets the needs of everyone and builds trust that decisions are fair and accurate. This must come with clear accountability and safeguards to allow for challenge. AI must work for people, not against them, prioritising people’s lives and wellbeing in decision-making.”
This comes as the UK government has recently unveiled an extensive action plan to enhance the country’s role in developing and deploying artificial intelligence, reports Birmingham Live.
Keir Starmer has endorsed a report by tech investor Matt Clifford, which includes 50 recommendations for the use of artificial intelligence (AI) in public services. The Labour leader believes that AI will bring about “incredible change in our country”.
The report urges the government to quickly test AI-powered services, which Starmer says will improve experiences and outcomes for citizens and boost productivity. Examples given of how AI could be used in the public sector include assisting teachers with lesson preparation and using AI-enhanced road cameras to identify potholes.