Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Transparent AI builds public trust at large and solves malevolent and racist AI

Mills et al., 21 (Steven Mills, Elias Baltassis, Nadim Abillama, and Matthew Mendelsohn, Steven Mills is the Global GAMMA Chief AI Ethics Officer at Boston Consulting Group. , 1-18-2021, accessed on 7-17-2022, BCG Global, "Responsible AI Builds Trust in Government", https://www.bcg.com/publications/2021/responsible-ai-builds-trust-in-government)

When governments incorporate artificial intelligence into decision making, the results can be good. Governments have, for instance, deployed AI-based systems effectively to manage hospital capacity, regulate traffic, and determine the best way to distribute social benefits and deliver services. However, some government AI systems have unfairly or unwittingly targeted or disadvantaged specific portions of their constituencies—and worse. A major difference between systems that work and those that fail is the way in which they are created and overseen. An approach that leads to successful outcomes includes proper governance, thoughtfully conceived processes based on input from affected stakeholders, and transparency about AI’s role in decision making. We call such a comprehensive approach Responsible AI. To achieve it, governments must empower leadership and use AI to enhance human decision making—not replace it. A Responsible AI approach should include regular reviews, integration with standard tools and data models, and a plan for potential lapses. Governments have another powerful tool at their disposal. They can use procurement to promote widespread adoption of Responsible AI. By making adherence to Responsible AI principles a prerequisite for bidding on public-sector AI contracts, agencies can ensure that the systems they create are ethical and transparent, while gradually integrating AI into public-sector decision making. UNINTENDED CONSEQUENCES OF GOVERNMENT AI SYSTEMS In the recent past, several well-publicized lapses have illustrated the unintentional harm that can befall individuals or society when government AI systems aren’t designed, built, or implemented in a responsible manner. A major difference between AI systems that work and those that fail is the way in which they are created and overseen. After college entrance exams were canceled because of the pandemic, the UK government used an algorithm that determined grades based on students’ past performance. The system and led to accusations that it was biased against test takers from challenging socioeconomic backgrounds. A Dutch court ordered the government to —which was intended to predict whether people would commit benefits or tax fraud—after it was determined that the system breached human rights laws and the EU’s General Data Protection Regulation. Citizens groups initiated the legal action after discovering that the system had been used to target neighborhoods with mostly low-income and minority residents. A local NGO after the city adopted a facial-recognition system to find criminal suspects. The system relied on a database that contained information about children as young as four. A US border control agency deployed a biometric scanning application built on machine-learning systems from multiple vendors. When it was because of the proprietary nature of the technology, concerns arose about the agency’s accountability and procurement practices. These lapses and others like them have led to widespread criticism and legal action. In the US, concerns over algorithmic-based decision systems in health care, criminal justice, education, employment, and other areas have resulted in lawsuits. Lapses have also led to organized efforts to track “bad actor” vendors and enact policies or laws to limit the use of public-sector AI systems or, at a minimum, make them more transparent. A 2020 UK parliamentary committee report on AI and public standards found that government and public-sector agencies are failing to be as open as they should be about AI use. The report called on the government to uphold new transparency standards and create effective oversight processes to mitigate risks. When lapses occur in government AI systems, trust in public institutions is eroded. Over time, such a disconnect can damage government legitimacy and citizens’ belief in and support for governmental authority in general. According to BCG research, when people have a positive experience with online public-service delivery, it strengthens their trust in government. But when they have a negative experience, it has a disproportionately detrimental effect on trust. If governments’ deployment of AI is to earn citizens’ trust, they need to get it right. Responsible AI will foster both trust and the ongoing license that governments need in order to use machine learning to improve their own performance.

Sign in to recut, update, or save this card.