Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Confidence in AI reliability is key for Operator Trust – even if no technology is perfect, it is essential to follow best practices.

National Security Commission on Artificial Intelligence 2022 [March 19, “NCSAI Final Report 2021 – Chapter 7: Establishing Justified Confidence in AI Systems”, https://assets.foleon.com/eu-west-2/uploads-7e3kk3/48187/nscai_ch7_digital_02-26-21.24159789cf2e.pdf]

Artificial intelligence (AI) systems must be developed and fielded with justified confidence.1 If AI systems do not work as designed, or are unpredictable in ways that can have significant negative consequences, then leaders will not adopt them, operators will not use them, Congress will not fund them, and the American people will not support them. “ “If AI systems ... are unpredictable in ways that can have significant negative consequences, then leaders will not adopt them, operators will not use them, Congress will not fund them, and the American people will not support them.” Achieving acceptable AI performance often is linked to the decision to accept some level of risk. No technology works perfectly under all conditions. Risk calculus changes with circumstances. The variables and considerations that inform judgments to rely on AI will vary significantly across military, intelligence, homeland security, and law enforcement missions. In a high-threat environment like combat, in some cases it may be reasonable to employ a system offering some immediate military advantage, while recognizing that it might fail; in other cases, however, a reasonable commander might want the highest assurances of AI reliability before fielding when lives are at risk. As departments and agencies rely more heavily on machines, a central guiding principle across national security scenarios is the continued centrality of human judgment. Those charged with utilizing AI need an informed understanding of risks, opportunities, and tradeoffs. They need awareness of the possibilities and limitations in a system’s expected performance. Ultimately, they need to formulate an educated answer to this question: In the given circumstance, how much confidence in the machine is enough confidence? These issues bear on the full lifecycle of an AI system––from acquisition or system development and the thresholds for justified confidence to deploy a specific AI-intensive system to the performance of the system in the field. While there is no absolute assurance of perfection, there are policies and best practices that support making these decisions responsibly. Agencies are broadly aware of the principal challenges in employing AI systems and the necessity of incorporating best practices in the engineering and management of AI systems.

Sign in to recut, update, or save this card.