Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Lack of brightline over “human control” makes enforcement null.

Sauer, 16 [Frank Sauer is a senior research fellow and lecturer at Bundeswehr University in Munich, October, 2016, accessed on 6-27-2022, Armscontrol, "Stopping ‘Killer Robots’: Why Now Is the Time to Ban Autonomous Weapons Systems | Arms Control Association", https://www.armscontrol.org/act/2016-09/features/stopping-%E2%80%98killer-robots%E2%80%99-why-now-time-ban-autonomous-weapons-systems]/ISEE

Perspectives for Arms Control The human brain needs time for complex evaluation and decision-making processes, time that it cannot be denied in the interaction between human and machine if the human role is to remain relevant, in other words, if the decision-making process is merely to be supported, not dominated, by the machine. Establishing where to draw that line is shaping up to be the key challenge in Geneva. Arriving at a decision in that regard would also mean producing the first definition of autonomous weapons systems in terms of international law. At the CCW meetings, the almost mantra-like repetition of a shared commitment to retain “meaningful human control” over the use of force by states-parties and civil society actors has become pivotal. Keeping weapons systems under meaningful human control and banning autonomous weapons systems are two sides of the same coin. The concept of meaningful human control introduced at the end of 2013 by Article 36, a member of the Campaign to Stop Killer Robots, has since been taken up by governments. It goes beyond the “appropriate levels of human judgment” approach specified by the 2012 Pentagon directive. Thus, the argument that human control over life-and-death decisions must always be in place in a significant or meaningful fashion, as more than just a mindless pushing of a button by a human in response to a machine-processed stream of information. According to current practice, a human weapons operator must have sufficient information about the target and sufficient control over the weapon and must be able to assess its effects in order to be able to make decisions in accordance with international law. At the same time, modern weapons systems are already highly computerized and automated, a trend that is only accelerating. So, determining how much human judgment can be replaced by algorithms before human control is no longer “meaningful” involves various technical, legal, ethical, and political considerations.

Sign in to recut, update, or save this card.