Focusing on Human Control avoids the trap of trying to precisely define weapons
Sprenger, 2021 - Europe editor for Defense News [Sebastian, Apr 27, “NATO tees up negotiations on artificial intelligence in weapons” https://www.c4isrnet.com/artificial-intelligence/2021/04/27/nato-tees-up-negotiations-on-artificial-intelligence-in-weapons/ Acc 4/22/22 TA]
Accountability and transparency are two more buzzwords expected to loom large in the debate. Accidents with autonomous vehicles, for example, will the raise the question of who is responsible — manufacturers or operators. The level of visibility into of how systems make decisions also will be crucial, according to van Weel. “Can you explain to me as an operator what your autonomous vehicle does, and why it does certain things? And if it does things that we didn’t expect, can we then turn it off?” he asked. NATO’s effort to hammer out common ground on artificial intelligence follows a push by the European Union to do the same, albeit without considering military applications. In addition, the United Nations has long been a forum for discussing the implications of weaponizing AI. Some of those organizations have essentially reinvented the wheel every time, according to Frank Sauer, a researcher at the Bundeswehr University in Munich. Regulators tend to focus too much on slicing and dicing through various definitions of autonomy and pairing them with potential use cases, he said. “You have to think about this in a technology-agnostic way,” Sauer argued, suggesting that officials place greater emphasis on the precise mechanics of human control. “Let’s just assume the machine can do everything it wants — what role are humans supposed to play?”