Current DOD policy does Not require human control – that is a common misperception
Freedberg, 2019 – deputy editor for Breaking Defense [Sydney J “The frontline of a new age in defense Artificial Intelligence” https://cdn2.hubspot.net/hubfs/2097098/MCM120_BreakingDefense_AI_ebookR1%20(1).pdf Acc 5/25/22 TA]
The revised solicitation for ATLAS adds a paragraph emphasizing the system will be “consistent with DoD legal and ethical standards,” especially Department of Defense Instruction 3000.09 on “Autonomy in Weapon Systems.” The final decision to fire will always be a human being’s job, the Army insists, in keeping with Pentagon policy. But policy is not law, and the Pentagon leadership can change it unilaterally. What’s more, even though the military’s AI policy is usually described as requiring a “human in the loop,” there’s actually an enormous loophole. “It authorizes the development of weapons that use autonomy...for defensive purposes like in Aegis or Active Protection Systems,” Scharre said. “For anything else, it creates a review process for senior leaders to make a determination.” “It’s not a red light,” Scharre told me. It’s a stop sign: You halt, you check out the situation — and then you can go.