Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

AI reflects harmful systematic biases

Boutin 3/16/22 (NIST, a physical sciences laboratory and non-regulatory agency of the United States Department of Commerce, “There’s More to AI Bias Than Biased Data, NIST Report Highlights,” NIST, June 21, 2022, https://www.nist.gov/news-events/news/2022/03/theres-more-ai-bias-biased-data-nist-report-highlights#:~:text=It%20is%20relatively%20common%20knowledge,particular%20gender%20or%20ethnic%20group) – Joyous Joelle

The recommendation is a core message of a revised NIST publication, , which reflects public comments the agency received on its released last summer. As part of a to support the development of trustworthy and responsible AI, the document offers guidance connected to the that NIST is developing. According to NIST’s Reva Schwartz, the main distinction between the draft and final versions of the publication is the new emphasis on how bias manifests itself not only in AI algorithms and the data used to train them, but also in the societal context in which AI systems are used. “Context is everything,” said Schwartz, principal investigator for AI bias and one of the report’s authors. “AI systems do not operate in isolation. They help people make decisions that directly affect other people’s lives. If we are to develop trustworthy AI systems, we need to consider all the factors that can chip away at the public’s trust in AI. Many of these factors go beyond the technology itself to the impacts of the technology, and the comments we received from a wide range of people and organizations emphasized this point.” Bias in AI can harm humans. AI can make decisions that affect whether a person is admitted into a school, authorized for a bank loan or accepted as a rental applicant. It is relatively common knowledge that AI systems can exhibit biases that stem from their programming and data sources; for example, machine learning software could be trained on a dataset that underrepresents a particular gender or ethnic group. The revised NIST publication acknowledges that while these computational and statistical sources of bias remain highly important, they do not represent the full picture. A more complete understanding of bias must take into account human and systemic biases, which figure significantly in the new version. Systemic biases result from institutions operating in ways that disadvantage certain social groups, such as discriminating against individuals based on their race. Human biases can relate to how people use data to fill in missing information, such as a person’s neighborhood of residence influencing how likely authorities would consider the person to be a crime suspect. When human, systemic and computational biases combine, they can form a pernicious mixture — especially when explicit guidance is lacking for addressing the risks associated with using AI systems.

Sign in to recut, update, or save this card.