Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

AI is used as an apparatus of domination due to data that will always construct power relations via rendering women and minorities invisible because its data is not representative of the entire population

Aradau and Bunz 2022 (Claudia Aradau, Professor of International Politics at King’s College London and a member of the editorial collective of Radical Philosophy. Mercedes Bunz, Reader in Digital Culture and Society at the Department of Digital Humanities, King’s College London, and an editor of the Open Access meson press. Her work explores the digital transformation of knowledge, and its effect on power. Radical Philosophy Issue 212, “Dismantling the apparatus of domination? Left critiques of AI”)

The critique of power addresses AI as an apparatus of domination and traces the technology through the production of data – data collected by corporations thriving in so-called ‘platform capitalism’ as well as by the state and its repressive agencies. Power emerges in multiple forms, from the historicity of data, its extraction by corporations and the state, its valorisation and the effects of surveillance and oppression it creates. What statisticians and computer scientists refer to as bias is created by training data reflecting historical or social inequities. When gathering training data, specific groups – such as people of colour, minorities or women – are often underrepresented. They might have been overlooked in the process of data sampling or during the testing of the AI technology. This ‘prototypical whiteness’ that renders racialised subjects invisible is entwined with surveillance technologies that render them hypervisible, as Simone Browne has shown.15 For example, a dataset called‘Faces in the Wild’, which had long been considered as a benchmark for testing facial recognition software, now comes with the warning that its data is not representative – 70% of the faces are male and 80% white, as digital activist Joy Buolamwini found out.16 And even if values representing race, gender, sexual orientation or class are removed, AI models, always looking for patterns, turn to proxy discrimination using statistical correlations of postcodes, education or particular expressions to discriminate. As Wendy Chun pointed out in her study Discriminating Data: ‘These “errors” often come from “ignoring” race – that is, wrongly assuming that race-free equals racism-free’.17

Sign in to recut, update, or save this card.