Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

The US military does not require human control for AI, despite common misperceptions

Freedberg, 2019 – deputy editor for Breaking Defense [Sydney J “The frontline of a new age in defense Artificial Intelligence” https://cdn2.hubspot.net/hubfs/2097098/MCM120_BreakingDefense_AI_ebookR1%20(1).pdf Acc 5/25/22 TA]

The April 2018 Army released its ATLAS artificial intelligence targeting program solicitation, inspiring runaway headlines about “AI-powered killing machines.” Why did this happen? The answer lies in a strange mix of misperceptions and some very real loopholes in the Pentagon’s policy on lethal AI. “The US Defense Department policy on autonomy in weapons doesn’t say that the DoD has to keep the human in the loop,” Army Ranger turned technologist Paul Scharre said. “It doesn’t say that. That’s a common misconception.” Buzzwords & Firestorms ATLAS came to public attention in about the worst way possible: an unheralded announcement on a federal contracting website (fbo.gov) on February 19th 2019, an indigestible bolus of buzzwords that meant one thing to insiders but something very different to everyone else — not just the general public but even civilian experts in AI. The name itself is ominous: ATLAS stands for Advanced Targeting and Lethality Automated System. The wording on the website made it worse, soliciting white papers on “autonomous target acquisition technology, that will be integrated with fire control technology, aimed at providing ground combat vehicles with the capability to acquire, identify, and engage targets at least 3X faster than the current manual process.” “The LA in ATLAS stands for Lethality Automated,” pointed out an appalled Stuart Russell, an AI scientist at Berkeley who’s campaigned for a global ban on lethal autonomous weapons. “‘Acquire, identify, and engage targets’ is essentially the UN definition of lethal autonomy.” But it’s not the military definition, which is where the problem starts. The military has long applied the loaded word “lethality” to anything that could make weapons more effective, not just the weapons themselves. Adding new infrared targeting sensors to tanks, for example, is officially a “lethality” upgrade. Networking Navy ships so they can share targeting data is called “distributed lethality.” Then came Defense Secretary Jim Mattis, a retired Marine Corps four- star who liked the word “lethal” so much that underlings plastered it on everything they were trying to sell him on, from high-tech weapons to new training techniques. What about “engagement”? In plain English, a “military engagement” means people are trying to kill each other (lethally).” But in the military, “engagement” can mean anything from “destroy” to “consider” to “talk to.” A Key Leader Engagement (KLE) in Iraq meant soldiers talking with a tribal elder, sheikh, or other influential person over tea. So in military language — at once abstrusely technical and sloppy — an artificial intelligence can increase “lethality” and “engage” a potential target by helping a human soldier spot it and aim at it, without the AI having any control over the trigger.

Sign in to recut, update, or save this card.