Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

--AT No Enforcement

Enforcement problems should not prevent a Ban – empirical evidence, improved enforcement and moral stigmas will improve compliance

Freedberg, 2019 – Breaking Defense writer [Sydney “ Should We Ban ‘Killer Robots’? Can We? The Pentagon insists it doesn't want them. But could a global ban really rein in Russia or China? March 11, Acc 12/27/20 TA]

What about an international treaty banning lethal AI, which would have the force of law? “Such a treaty would be very difficult to monitor and enforce,” the official said. “That doesn’t mean an international treaty should be ruled out.” The Enforcement Problem “Autonomous weapons have all of the features that make arms control hard,” said Paul Scharre, a former Army Ranger, now at CNAS, who worked on the current Pentagon policy. International inspectors can’t tell by looking at an unmanned tank, plane, or warship whether it’s programmed to ask a human for permission before opening fire. Even if they get to see the actual code — a security breach few countries would allow — “there’s nothing to stop you from upgrading the software as soon as the inspectors leave,” he told me. “Having said that,” Scharre continued, “I think that the kind of arms control that Stuart Russell is advocating for is actually more feasible.” If someone’s building vast swarms of lethal mini-drones, you don’t have to see the code to know they have to be fully autonomous: There’s no practical way, Scharre told me, for humans to review and approve “a million targets.” Conversely, such mini-drones are only truly threatening in vast numbers. “A country or an individual… might be able to build a few hundred of these,” Scharre said, “but if you’re going to build millions of them, there’s no way to hide that.” So how would you find them? The best model is probably the Chemical Weapons Convention, which, unlike many other treaties — the Biological Weapons Convention, the landmine ban, and so on — has a robust enforcement mechanism. The scope of the problem is similar. Lethal chemicals like chlorine and phosgene are widely used in legitimate industry, so you can’t ban them outright any more than mini-drones; they’re relatively easy to turn into weapons, again like drones; and yet only rogue states like Syria and Iraq have used them since the end of World War I. Much of the reason militaries abandoned poison gas is that a weapon that blows with the wind is hard to control — yet another similarity with AI, since even “narrow” machine-learning algorithms modify themselves in ways beyond human understanding. But there is also a robust monitoring regime, run by the Organisation to Prevent Chemical Weapons, which has about 250 inspectors who can rapidly respond to reported violations. Such “challenge inspections” are a crucial tool, said Irakli Beridze, a Georgian-born veteran of both OPCW and the UNICRI chem, bio, radiological, & nuclear program — with service in Afghanistan, Iraq, Libya, and Syria — who now runs the Centre for AI & Robotics at UNICRI, the United Nations Interregional Crime and Justice Research Institute. (Beridze emphasized he was only expressing his personal opinion as an expert, not as a UN official). Mini-drone production would be easier to hide than chemical plants — for one thing, it doesn’t stink like a lot of toxic chemicals — but investigative techniques have advanced since the CWC entered into force in 1997. It might even be possible, Beridze said, to set an AI to catch an AI: use artificial intelligence to crunch big data — social media or parts orders, for example — and correlate subtle clues no human inspector could catch. Robust inspections, however, are only one part of the solution, he told me. Countries need not only to sign the treaty but use their own intelligence agencies and domestic law enforcement to watch for violations. And, after initial reluctance in the private sector, “buy-in and participation of the chemical industry… was absolutely essential,” he said. “Otherwise this treaty would not work.” Once compliance became a norm in the chemical industry, in large part because of the moral stigma that attached to chemical weapons, it became much harder to produce poison gas in militarily significant amounts. Given widespread anxiety in the tech community about lethal AI, it should be possible to reach a similar consensus among drone manufacturers — eventually. Getting private industry, law enforcement, and national governments on board, even simply making them aware of the problem, would take years.

Sign in to recut, update, or save this card.