Second, the proliferation of autonomous weapons system development makes leaks inevitable. The more people that have the technology, the more likely it is for terrorists to get it.
Jacob Ware (master’s degree in security studies from Georgetown University and an MA (Hons) in international relations and modern history from the University of St Andrews) “TERRORIST GROUPS, ARTIFICIAL INTELLIGENCE, AND KILLER DRONES” September 24, 2019 https://warontherocks.com/2019/09/terrorist-groups-artificial-intelligence-and-killer-drones/
Firstly, modern terrorist organizations have advanced scientific and engineering departments, and actively seek out skilled scientists for recruitment. ISIL, for example, has appealed for scientists to trek to the caliphate to work on drone and AI technology. The individual technologies behind swarming killer robots — including unmanned aerial vehicles, facial recognition, and machine-to-machine communication — already exist, and have been adapted by terrorist organizations for other means. According to a French defense industry executive, “the technological challenge of scaling it up to swarms and things like that doesn’t need any inventive step. It’s just a question of time and scale and I think that’s an absolute certainty that we should worry about.” Secondly, autonomous weapons technology will likely proliferate through sales. Because AI research is led by private firms, advanced AI technology will be publicly sold on the open market. As Michael Horowitz argues, “militant groups and less-capable states may already have what they need to produce some simple autonomous weapon systems, and that capability is likely to spread even further for purely commercial reasons.” The current framework controlling high-tech weapons proliferation — the Wassenaar Arrangement and Missile Technology Control Regime — is voluntary, and is constantly tested by great-power weapons development. Given interest in developing AI-guided weapons, this seems unlikely to change. Ultimately, as AI expert Toby Walsh notes, the world’s weapons companies can, and will, “make a killing (pun very much intended) selling autonomous weapons to all sides of every conflict.” Finally, autonomous weapons technology is likely to leak. Innovation in the AI field is led by the private sector, not the military, because of the myriad commercial applications of the technology. This will make it more difficult to contain the technology, and prevent it from proliferating to nonstate actors. Perhaps the starkest warning has been issued by Paul Scharre, a former U.S. defense official: “We are entering a world where the technology to build lethal autonomous weapons is available not only to nation-states but to individuals as well. That world is not in the distant future. It’s already here.”