Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

AI systems operate in an opaque “black box” – they’re hard to understand and correct, contributing to the fog of war

Greenberg ‘20 (Erik Lin-Greenberg, , “Article Title,” Journal/Magazine/etc, “Allies and artificial intelligence: Obstacles to operations and decision making”, Texas National Security Review, 3(2), 56–76, March 05 2020, https://tnsr.org/2020/03/allies-and-artificial-intelligence-obstacles-to-operations-and-decision-making/)-amc

AI can also strain alliance decision-making by fueling uncertainty about information and military actions. Unlike human analysts or military personnel who can be asked to explain and justify their findings or decisions, AI generally operates in a “black box.” 97 The neural networks that underpin many cutting-edge AI systems are opaque and offer little insight into how they arrive at their conclusions.98 These networks rely on deep learning, a process that passes information from large data sets through a hierarchy of digital nodes that analyze data inputs and make predictions using mathematical rules. As data flows through the neural network, the net makes internal adjustments to refine the quality of outputs. Researchers are often unable to explain how neural nets make these internal adjustments. Because of this lack of “explainability,” users of AI systems may have difficulty understanding failures and correcting errors.99 Policymakers have called for the development of more transparent AI systems, and researchers are working to develop explainable AI tools that peer inside the AI black box.100 Yet, many decision-makers remain uncomfortable with the uncertainty surrounding AI-enabled systems. The commander of the U.S. Air Force’s Air Combat Command, for instance, publicly explained that he was not yet willing to rely on AI programs to analyze the full-motion video collected by reconnaissance drones. He argued that although systems are improving, they are still unable to consistently provide accurate analysis.101 So long as the decisions and analysis of AI systems remain opaque, military commanders may be reluctant to trust AI-enabled systems. And if used, AI may contribute to the fog of war, rather than reduce it, making it difficult to make decisions using information delivered by AI technologies.

Sign in to recut, update, or save this card.