The aff’s search for ethics ignores the way algorithms inevitably shape our assumptions and forward technological manipulation
Amoore 20 (Louise Amoore, Professor of Political Geography at Durham University, “Cloud Ethics: Algorithms and the Attributes of Ourselves and Others”, Duke University Press, 8/30/20, https://doi.org/10.1080/1369118X.2020.1800782) // EL
Ethics of Algorithms At first sight, the potential for violent harm precipitated by algorithms that learn to recognize human propensities appears to be a self-evident matter for critique. Surely, one could say, the ethical terrain of the algorithm resides in the broader political landscape of rights and wrongs, good and evil. After all, one could readily identify a set of rights, already apparently registered as belonging to rights-bearing subjects, that has been contravened by algorithms that generate targets, adjudicating which people may peaceably assemble, or which people are worthy of credit or employment, and on what terms. Indeed, on this terrain of delineating the rights and wrongs of algorithmic actions is precisely where many critical voices on the harms of the algorithm have been heard. Writing in the New York Times, for example, Kate Crawford identifies machine learning’s “white guy problem,” arguing that “we need to be vigilant about how we design and train machine learning systems.”10 The dominant critical perspectives on algorithmic decisions have thus argued for removing the “bias” or the “value judgements” of the algorithm, and for regulating harmful and damaging mathematical models.11 Within each of these critical calls, the ethical problem is thought to dwell in the opacity of the algorithm and in its inscrutability, so that what Frank Pasquale has called the “black box society” is addressed through remedies of transparency and accountability.12 In sum, the rise of algorithmic power in society has been overwhelmingly understood as a problem of opaque and illegible algorithms infringing or undercutting a precisely legible world of rights belonging to human subjects. In such a framing, there is an outside to the algorithm—an accountable human subject who is the locus of responsibility, the source of a code of conduct with which algorithms must comply. To call for the opening of the black box, for transparency and accountability, then, is to seek to institute arrangements that are good, ethical, and normal, and to prevent the transgression of societal norms by the algorithm. Yet, when people gathered to protest on Baltimore streets, or when Facebook users’ data fueled the political and commercial models of Cambridge Analytica (figure I.3), legible rights to peaceable assembly or to electoral due process were not violated primarily by illegible algorithms. Rather, the means by which people could appear in a political forum, the conditions of their appearance, and the capacities they had to make a recognizable political claim in the world were subject to algorithmic regimes of what Michel Foucault calls truth telling and wrongdoing.13 In short, what matters is not primarily the identification and regulation of algorithmic wrongs, but more significantly how algorithms are implicated in new regimes of verification, new forms of identifying a wrong or of truth telling in the world. Understood in these terms, the algorithm already presents itself as an ethicopolitical arrangement of values, assumptions, and propositions about the world. One does not need to look beyond the algorithm for an outside that is properly political and recognizably of ethics. Indeed, there can be no legible human outside the algorithm and underwriting its conduct, for as John Cheney-Lippold reminds us, we are enmeshed in the data that produce each “freshly minted algorithmic truth.”14 One cannot sustain a search for codes of ethics that instill the good, the lawful, or the normal into the algorithm. Contemporary algorithms are not so much transgressing settled societal norms as establishing new patterns of good and bad, new thresholds of normality and abnormality, against which actions are calibrated. Actions one might consider harmful, as William Connolly notes, are not merely “actions by immoral agents who freely transgress the moral law” but are “arbitrary cruelty installed in regular institutional arrangements taken to embody the Law, the Good, and the Normal.”15 Amid the widespread search for new ethical arrangements for the scrutiny and regulation of algorithms, what becomes of the arbitrary harms lodged within embodied algorithmic arrangements? One could imagine a world in which the deep neural networks used in cities like Baltimore are scrutinized and rendered compliant with rules and yet continue to learn to recognize and misrecognize people and to infer intent, to generate rules from the contingent and arbitrary data of many past moments of associative life on the city streets, to refine and edit the code for future uses in unknown future places. I may feel that some notion of legible rights is protected, and yet the attributes generated from my data, in correlation with yours and others’, continue to supply the conditions for future arbitrary actions against unknown others. I draw a distinction here between ethics as code, or what Michel Foucault describes as “the code that determines which acts are permitted or forbidden,” and ethics as the inescapably political formation of the relation of oneself to oneself and to others.16 My argument is that there is a need for a certain kind of ethical practice in relation to algorithms, one that does not merely locate the permissions and prohibitions of their use. This different kind of ethical practice begins from the algorithm as always already an ethicopolitical entity by virtue of being immanently formed through the relational attributes of selves and others. My desire for a different mode of critique and ethical account is animated not by the question, How ought the algorithm be arranged for a good society?, but by the question, How are algorithmic arrangements generating ideas of goodness, transgression, and what society ought to be?