Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Ethical principles and Responsible AI use prevents miscalculation and escalation

International Panel on the Regulation of Autonomous Weapons, 2021 [(iPRAW) coordinated by: German Institute for International and Security Affairs, July “Building Blocks for a Regulation on LAWS and Human Control Updated Recommendations to the GGE on LAWS” https://www.readkong.com/page/building-blocks-for-a-regulation-on-laws-and-human-control-8617434 Acc 2/27/22 TA]

Albeit not being at the center of the CCW debate on LAWS, military AI and machine autonomy could also have manifold implications for international security and strategic stability. A major benefit of applying autonomous functions for military purposes is the possibility of accelerating information processing, decision-making, and command and control cycles. A faster tempo of warfare however also runs risk of overwhelming human operators and undermining human judgment, especially in crisis situations. This could be aggravated by the fact that AI-enabled systems are often not entirely comprehensible for humans, especially those relying on machine or deep learning. Automation bias, meaning human overreliance and over- trust in the effectiveness of machine autonomy, has already caused various accidents in the civilian domain and could be particularly acute if human operators were not aware of the limits of AI and autonomy. Therefore, technical errors, coupled with unpredictable, opaque systems and automation bias could lead to a situation where humans might lose the ability to control escalation and manage war termination. Furthermore, already existing threat perceptions and an increasing speed of warfare could spur arms competition towards greater levels of autonomy that again increases the speed of conflicts, leading to a vicious circle. Similarly, while sophisticated AI- enabled systems might not be easily built or acquired, rather "crude" LAWS and their components could diffuse rather rapidly, potentially falling into the hands of illegitimate or irresponsible actors. Export controls might be able to mitigate this issue to a certain extent. Whether AI-enabled systems and machine autonomy will strengthen or undermine strategic stability will to a large extent depend on their application and the human role. In many cases, AI technologies could aid human operators and strengthen strategic stability. For example, by enabling the integration of heterogeneous data and rapid information processing, AI methods could improve situational awareness of human operators and commanders. This however presupposes that technical risks and limitations as well as risks in relation to human-machine interaction are taken into account and that safety measures and adequate training of human operators ensure reliable systems and their responsible use. Ultimately, the focus should be on aiding rather than replacing the unique judgment of humans.

Sign in to recut, update, or save this card.