Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Human control is key to for responsible AI use

Sauer, 2021 - Senior Research Fellow at Bundeswehr University [Frank serves on the International Panel on the Regulation of Autonomous Weapons IRRC No. 913 March “Stepping back from the brink: Why multilateral regulation of autonomy in weapons systems is difficult, yet imperative and feasible” https://international-review.icrc.org/articles/stepping-back-from-brink-regulation-of-autonomous-weapons-systems-913 Acc 4/5/22 TA]

Luckily, the process of conceptualizing the issue and translating it into diplomatic language has begun, and has already made some progress. After almost six years, the codification of a positive obligation of human control over weapons systems is establishing itself more and more at the heart of the debate. This general notion, gaining prominence in the wake of the call for “meaningful human control” originally introduced by the NGO Article 36,15 is being embraced by civil society as well as a consistently growing number of CCW States Parties. Accordingly, the conceptualization is now finding broad acceptance in both academic literature and the diplomatic debate – not least because the United States and the International Committee of the Red Cross (ICRC) have adopted it. This is not some sort of categorical definition of LAWS (versus non-LAWS) via a list of criteria. Instead, it is a functional understanding of the phenomenon.16 From a functionalist point of view, the LAWS issue is best understood as one of autonomy in a weapons system – that is, of the machine rather than a human performing a certain function (or certain functions) during the system's operation.17 Every military operation concluding with an attack on a target can be systematized along discrete steps of a kill chain or targeting cycle.18 This includes finding, fixing, tracking, selecting and engaging the target (as well as assessing the effects afterwards). Many weapons systems are already capable of performing some of the targeting cycle functions without human input or supervision – for example, a drone navigating from one waypoint to the next via satellite navigation and thus performing a part of the “finding” function without having to be remotely controlled. An autonomous weapon, however, completes the entire targeting cycle – including the final stages of selecting and engaging the target with force – without human intervention. In the debate about LAWS, the focus rests mainly on those last two functions (which the ICRC calls “critical”19) because most of the effects of weapon autonomy currently under discussion derive from giving up human control over them and handing the decision to use force over to a machine.20

Sign in to recut, update, or save this card.