LAWs exacerbate racial inequalities due to biased programing
Ramsay-Jones 19 – Hayley Ramsay-Jones, Soka Gakkai International, member of the Campaign to Stop Killer Robots, October 17, 2019, “Racism and Fully Autonomous Weapons UN Special Rapporteur on contemporary forms of racism, racial discrimination, xenophobia and related intolerance, workshop on the impact of new information technologies on racial equality, https://www.ohchr.org/sites/default/files/Documents/Issues/Racism/SR/Call/campaigntostopkillerrobots.pdf
Fully autonomous weapons can select and attack targets without meaningful human control, they operate based on algorithms and data analysis programming. In essence, this means that machines would have the power to make life-and-death decisions over human beings. The trend towards more autonomy in weaponry without adequate human oversight is alarming especially when we know that digital technologies are not racially neutral. Moreover, when it comes to artificial intelligence (AI) there is an increasing body of evidence that shows that racism operates at every level of the design process and continues to emerge in the production, implementation, distribution and regulation. In this regard AI not only embodies the values and beliefs of the society or individuals that produce them but acts to amplify these biases and the power disparities.iii One example of racism manifesting in AI is the under-representation problem in science, technology, engineering and mathematics (STEM) fields, which in itself is a manifestation of structural racism and patriarchy in western society. Technologies in the west are mostly 2 developed by white males, and thus perform better for this group. A 2010 studyiv by researchers at the National Institute of Standards and Technology (NIST) and the University of Texas, found that algorithms designed and tested in East Asia are better at recognizing East Asians, while those designed in Western countries are more accurate at detecting Caucasians. Similarly, sound detecting devices perform better at detecting male, Anglo-American voices and accents, as opposed to female voices, and non-Anglo-American accents. Research by Joy Buolamwini,v reveals that race, skin tone and gender are significant when it comes to facial recognition. Buolamwini demonstrates that facial recognition software recognizes male faces far more accurately than female faces, especially when these faces are white. For darker-skinned people however the error rates were over 19%, and unsurprisingly the systems performed especially badly when presented with the intersection between race and gender, evidenced by a 34.4% error margin when recognizing dark-skinned women. Despite the concerning error rates in these systems, commercially we already see adaptations of faulty facial recognition systems being rolled out in a variety of ways from soap dispensers to self-driving cars. The issue here is what happens if law enforcement and national security become reliant on a system that can recognize white males with just 1% error rate yet fails to recognize dark-skinned women more than one-third of the time? These types of applications of new information technology fail people of color intersectionally at a disturbing rate. The fact that these systems are commercially available reveals a blatant disregard for people of color, it also positions "whiteness"vi as the norm, the standard for objectivity and reason. These applications of new information technology including their weaponization favors whiteness at the expense of all others, it is not merely a disempowerment but an empowerment. In real terms, racism bolsters white people's life chances. Vii