NATO AI key to democracy---solves ethical AI---starting with non combat still solves
Andrea Gilli et al 20, Senior Researcher at the NATO Defense College where he works on issues related to technological change and military innovation. He has been visiting and postdoctoral fellow at Johns Hopkins University and Columbia University as well as Stanford University (where he remains an Affiliate) and Harvard University. Mauro Gilli is a Senior Researcher in Military Technology and International Security at the Center for Security Studies (CSS) at the Swiss Federal Institute of Technology, ETHZurich. Before joining CSS, he was a post-doctoral fellow at the Dickey Center, Dartmouth College. Ann-Sophie Leonard is a former Mercator Fellow on International Affairs, focusing on the intersection of international security and technology. She was a Visiting Fellow at the Research Division of the NATO Defense College in Rome from September to December 2019. Zoe Stanley-Lockman is an Associate Research Fellow in the Military Transformations Programme at the Institute of Defence and Strategic Studies at the S. Rajaratnam School of International Studies in Singapore. “NATO-Mation”: Strategies for Leading in the Age of Artificial Intelligence. NDC Research Paper No.15 – December 2020 //pipk
NATO has an interest, and a moral obligation, to promote the adoption of its values in the realm of AI. Democratic values inform the Alliance’s goals, thus giving meaning to its material capabilities – including its military power. At the same time, the integration of AI into the fields of security and defence poses unique moral, ethical, legal, and safety-related questions.85 It is thus imperative that the Alliance actively considers and operationalizes AI ethics, regardless of the degree and scope of AI integration within NATO and its Allies. The common principles and values pronounced in the Atlantic Treaty represent the foundations on which NATO was built. Such principles and values – democracy, freedom, rule of law, individual rights, free markets – are the bond underlying the transatlantic community, which in fact predates the Atlantic Alliance.86
Norms and values can strongly shape the international system.87 Given the intense international competition in the technological, military, economic, and normative domains, embedding democratic values into AI is as much a strategic imperative for the Alliance as it is a functional one.88 In addition to signalling to domestic populations that NATO and its Allies follow through on their commitments to uphold values as the basis of the political and military Alliance, incorporating AI ethics into the “NATO-mation” agenda also serves as a bulwark against the incursion of unwelcome illiberal values in the course of future technological development.89
It is worth noting that NATO’s role in the AI ethics sphere differs from that of many other organizations, such as national governments and the European Union, because NATO is not a regulatory body. NATO complies with existing laws and regulations, including the Laws of War, which nations and the international community created. This means that regulatory and normative questions such as the development and deployment of autonomous weapons systems will not be determined at NATO level. Nevertheless, there is still room for NATO to play a clear role. Indeed, given doubts and worries about the adoption of AI for military purposes, NATO can help generate more public support and engagement by clearly defining ethical boundaries and moral guidelines.
The uses of AI in military operations – ranging from logistics to maintenance, from recruitment to retainment, from intelligence, surveillance and reconnaissance to medical tests and medical evacuation, and more90 – go beyond the discussions on lethal autonomous weapons systems that have dominated European debate about AI in military affairs. Accordingly, the range of ethical questions relevant to NATO extend beyond focusing on the tip of the spear. Seemingly mundane uses of AI, such as in human resources or decision support, can still pose distinct ethical questions the Alliance should be prepared to handle. Addressing security risks,91 minimizing bias in systems,92 developing trust,93 and respecting privacy are fundamental tasks for the Alliance to ensure the future effectiveness of AI, whether in battle or in other functions.
The age of intelligent machines requires the Alliance to reiterate its commitment to values as new moral and ethical questions emerge, because algorithms do not have a conscience, personal preferences or moral agency. These statistical machines have no understanding of good and bad, or fair and unjust.94 All an algorithm can do is achieve its human-defined reward function, not provide any context or information on whether the right question is being asked.95 Instead of giving moral agency to algorithms, humans and organizations can view AI as a “moral entity”. This means that we humans are dutybound to adhere to our moral code of conduct when interacting with the systems, rather than shirking human responsibility to computers.96 At the organizational level, this means that the design, development and deployment of AI should be “ethically aligned” with the Alliance’s values and goals.97
This is important because AI is data-intensive, unpredictable and brittle.98 While a system may work well in the context in which it was trained, it may break in an unfamiliar setting. The reliance on BD in the current second wave of ML also creates fallibilities,99 given that the algorithms can scale up harm if the data over- or under-represents certain groups.100 For neural networks in particular, it may be impossible to explain or interpret results. Some refer to this as the “black-box” problem, meaning that the outcomes of these complex AI systems are opaque to humans that either want to reproduce the good, or prevent the bad from recurring. While traditional software can be debugged to solve a performance issue, the lack of linear causality between a programmer’s inputs and the AI system’s outputs means that it is difficult to track bias and reliability. Creating organizational processes to minimize these concerns across the AI lifecycle is critical to responsible use of the technology.