Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

DoD needs huge reforms before it could be effective

Konaev and Nurkin, 22 (Konaev Margarita and Tate Nurkin, Margarita Konaev is a nonresident senior fellow in the Forward Defense practice of the Atlantic Council’s Scowcroft Center for Strategy and Security. Konaev’s research on international security, armed conflict, non-state actors and urban warfare in the Middle East, Russia, and Eurasia., Tate Nurkin is the founder of OTH Intelligence Group and a nonresident senior fellow with the Scowcroft Center for Strategy and Security at the Atlantic Council.Substantively, Mr. Nurkin’s research and analysis has a particularly strong focus on US-China competition, defense technology, the future of military capabilities, and the global defense industry and its market issues., 5-25-2022, accessed on 7-13-2022, Atlantic Council, "Eye to eye in AI: Developing artificial intelligence for national security and defense", https://www.atlanticcouncil.org/in-depth-research-reports/report/eye-to-eye-in-ai/#accelerating-dod)

Currently, there are no shared technical standards for what constitutes ethical or trustworthy AI systems, which can make it difficult for nontraditional AI vendors to set expectations and navigate the bureaucracy. The DoD is not directly responsible for setting standards. Rather, the 2021 National Defense Authorization Act (NDAA) expanded the National Institute of Standards and Technology (NIST) mission “to include advancing collaborative frameworks, standards, guidelines for AI, supporting the development of a risk mitigation framework for AI systems, and supporting the development of technical standards and guidelines to promote trustworthy AI systems.”7979. Pub. L. 116-283, William M. (Mac) Thornberry National Defense Authorization Act for Fiscal Year 2021, 134 Stat. 3388 (2021), https://www.congress.gov/116/plaws/publ283/PLAW-116publ283.pdf. In July 2021, the NIST issued a request for information from stakeholders as it develops its AI Risk Management Framework, meant to help organizations “incorporate trustworthiness considerations into the design, development, use, and evaluation of AI products, services, and systems.”8080. “Summary Analysis of Responses to the NIST Artificial Intelligence Risk Management Framework (AI RMF)—Request for Information (RFI),” National Institute of Standards and Technology, October 15, 2021, https://www.nist.gov/system/files/documents/2021/10/15/AI%20RMF_RFI%20Summary%20.pdf. Related to standards are the challenges linked to testing, evaluation, verification, and validation (TEVV). Testing and verification processes are meant to “help decision-makers and operators understand and manage the risks of developing, producing, operating, and sustaining AI-enabling systems,” and are essential for building trust in AI.8181 Michele A. Flournoy, Avril Haines, and Gabrielle Chefitz, “Building Trust through Testing: Adapting DOD’s Test & Evaluation, Validation & Verification (TEVV) Enterprise for Machine Learning Systems, including Deep Learning Systems,” WestExec, October 2020, 3–4, https://cset.georgetown.edu/wp-content/uploads/Building-Trust-Through-Testing.pdf. The DoD’s current TEVV protocols and infrastructure are meant primarily for major defense acquisition programs like ships, airplanes, or tanks; it is linear, sequential, and, ultimately, finite once the program transitions to production and deployment. With AI systems, however, “development is never really finished, so neither is testing.”8282. Flournoy, Haines, and Chefitz, “Building Trust through Testing,” 3. Adaptive, continuously learning emerging technologies like AI, therefore, require a more agile and iterative development-and-testing approach—one that, as the NSCAI recommended, “integrates testing as a continuous part of requirements specification, development, deployment, training, and maintenance and includes run-time monitoring of operational behavior.”8383. “Final ,” 384. The ethical code that guides the US military reflects a fundamental commitment to abiding with the laws of war at a time when authoritarian countries like China and Russia show little regard for human rights and humanitarian principles. Concurrently, the DoD’s rigorous approach to testing and assurance of new capabilities is designed to ensure that new weapons are used responsibly and appropriately, and to minimize the risk from accidents, misuse, and abuse of systems and capabilities that can have dangerous, or even catastrophic, effects. These values and principles that the United States shares with many of its allies and partners are a strategic asset in the competition against authoritarian countries as they field AI-enabled military systems. To cement the DoD’s advantage in this arena, we recommend the following steps. The DoD will not be able to fulfill its ambitions in AI and compete effectively with the Chinese model of sourcing technology innovation through military- civil fusion without close partnerships with a broad range of technology companies. This includes defense-industry leaders with long-standing ties to the Pentagon, technology giants at the forefront of global innovation, commercial technology players seeking to expand their government portfolio, and startups at the cutting edge of AI development. But, the DoD’s budget-planning, procurement, acquisition, contracting, and compliance processes will likely need to be fundamentally restructured to effectively engage with the entirety of this vibrant and diverse technology ecosystem. Systemic change is a slow, arduous process. But, delaying this transition risks the US military falling behind on exploiting the advantages AI promises to deliver, from operational speed to decision dominance. In the meantime, the following actions could help improve coordination with industry partners to accelerate the DoD’s AI adoption efforts. The DoD should implement the NSCAI’s recommendation to accelerate efforts to train acquisition professionals on the full range of available options for acquisition and contracting, and incentivize their use for AI and digital technologies.”88 Moreover, such acquisition- workforce training initiatives should ensure that acquisition professionals have a sufficient understanding of the DoD’s ethical principles for AI and the technical dimensions of trusted and responsible AI. The DIU’s ethical guidelines can serve as the foundation for this training. Rather than building entirely new AI-enabled systems, in the short to medium term, the DoD will be integrating AI into a range of existing software and hardware systems—from cyberdefense architectures to fighter jets to C2. Progress toward implementing AI will, therefore, also depend upon streamlining collaboration between the startups and nontraditional AI vendors that the DoD has been courting for their innovative and cutting-edge technologies and the defense primes responsible for integrating new capabilities into legacy systems.

Sign in to recut, update, or save this card.