Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

The DOD AI Strategy underfunded reliability testing – it focused on ethics, but not safety.

Lewis 2019 - project lead for the DOD’s Joint Lessons Learned studies [Larry, “AI Safety: Charting out the High Road”, War on the Rocks Dec 19, https://warontherocks.com/2019/12/ai-safety-charting-out-the-high-road/ LMSi]

Promise 1: Addressing Safety Risks Unique to AI In its AI strategy, the Department of Defense made a promise to address the safety risks unique to AI technology. This is reflective of America’s long record of commitments to safety and adherence to international laws for armed conflict. For example, all military systems are subject to test and evaluation activities to ensure that they are reliable and safe, as well as legal reviews to ensure they are consistent with international humanitarian law (e.g., the Geneva Conventions). It is not surprising, therefore, that safety is prominent in the defense AI strategy. Though a commendable intention, the strategy has not yet resulted in significant institutional steps to promote safety with regard to AI. The U.S. military has been busy supporting the Defense Innovation Board’s development of AI ethics, with the Joint AI Center also emphasizing the critical role ethics plays in AI applications, yet the pursuit of safety — for example, avoiding civilian casualties, friendly fire, and inadvertent escalation — has not received the same sort of attention. I acknowledge a few steps are being taken towards promoting AI safety. For example, the Defense Advanced Research Projects Agency has a program working to develop explainable AI, to help address challenges with the use of machine learning as a black box technology. Explainability will enhance AI safety: for example, by being able to explain why an AI application does something amiss in testing or operations and to take corrective actions. But such steps, while important, do not make up a comprehensive approach to identify and then systematically address AI safety risks. To that end, our most recent report draws on a risk management approach to AI safety: identifying risks, analyzing them, and then suggesting concrete actions to begin addressing them.

Sign in to recut, update, or save this card.