Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

DOD policies do not require human control for AI due to unclear definitions

Freedberg, 2019 – deputy editor for Breaking Defense [Sydney J “The frontline of a new age in defense Artificial Intelligence” https://cdn2.hubspot.net/hubfs/2097098/MCM120_BreakingDefense_AI_ebookR1%20(1).pdf Acc 5/25/22 TA]

• DoD 3000.09, Section 4.c(2), covers “human- supervised autonomous weapons systems” — since a human overseer can turn it off at any time , like Aegis– and specifically limits them to defensive purposes, explicitly banning the “selecting of humans as targets.” • Section 4.c(3) allows computer-controlled non- lethal systems, such as radar jammers. (Automated cybersecurity software is permitted elsewhere). • Section 4.c(1) allows the use of lethal force by “semi- autonomous weapons systems” (emphasis added), which aren’t fully computer-controlled. But even those must “not autonomously select and engage individual targets or specific target groups that have not been previously selected by an authorized human operator.” Such strictly regulated systems are a far cry from the Terminator, or even Stuart Russell’s more realistic nightmare scenario of swarming mini-drones. But while Section 4.c is the heart of the Pentagon policy on autonomous weapons, it’s immediately followed by a loophole: • Section 4.d states that “Autonomous or semi- autonomous weapon systems intended to be used in a manner that falls outside the policies in subparagraphs 4.c.(1) through 4.c.(3) must be approved” before development can proceed. Who approves? Two deputy secretaries of defense (policy and technology) and the Chairman of the Joint Chiefs. Getting three such high-level officials to sign on is a daunting challenge for any bureaucrat, but it’s hardly impossible. • Even after the three officials approve an exception, the system must follow a long list of safety and testing guidelines and ensure “commanders and operators [can] exercise appropriate levels of human judgment in the use of force.” But “appropriate” is left undefined. What’s more, if all three officials agree, they can ask the Deputy Secretary of Defense to waive all of those restrictions, “with the exception of the requirement for a legal review, in cases of urgent military operational need” — again, left undefined. Nowhere in this document, incidentally, will you find the comforting but imprecise phrase “human in the loop.” In fact, when I used it in a query to the Pentagon, I got gentle chiding from DoD spokesperson Elissa Smith: “The Directive does not use the phrase ‘human in the loop,’ so we recommend not indicating that DoD has established requirements using that term.”

Sign in to recut, update, or save this card.