2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Can’t Be Controlled
Shaun Tan, 9/26/2017 (staff writer, “We Need an AI Limitation Treaty. Now.” , Retrieved 6/15/2022)
Then, there’s the likelihood that any safeguards would be circumvented by the AI itself. Indeed, any security measures our best computer scientists could devise would be laughable to a superintelligence, which by definition would be many times smarter than any human. Imagine a human being held captive by chimpanzees. Suppose that these are unusually intelligent chimpanzees that use state-of-the-art monkey technology to keep the human prisoner – perhaps they manage to construct a rudimentary cage out of sticks. Is there any doubt that the human wouldn’t eventually escape in ways the chimpanzees couldn’t possibly think of? Perhaps he’d dig a hole under the cage, or fashion tools out of nearby objects to help him, or remove the bars of the cage and use them as weapons, or make a fire that burns down a portion of the cage. One way or another, it would only be a matter of time before he found a way free. A superintelligence would be smarter than humans in a similar fashion. In his article “Leakproofing the Singularity: Artificial Intelligence Confinement Problem,” Yampolskiy suggested that a superintelligence could easily manipulate a human guard into letting it escape. It could target a guard’s weaknesses, offering him power or immortality, or promising a cure for a loved-one with a terminal disease. It could also find a bug in the system and exploit it (something even human hackers do all the time). Or pretend to malfunction, and then escape when its jailors lower safeguards to investigate. Or it could escape in ways humans aren’t even aware are possible. Insulated from the outside world, Bostrom suggested, it might find a way to generate radio waves by shuffling the electrons in its circuitry in particular patterns. Of course, these are just the methods our puny human brains can imagine – an entity thousands of times smarter would be able to come up with a lot more. Effective safeguards are built around power – they’re not possible against a being that’s smarter, and therefore more powerful, than us. Thinking we could contain something like that would be hubris.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Can’t Be Controlled
Shaun Tan, 9/26/2017 (staff writer, “We Need an AI Limitation Treaty. Now.” , Retrieved 6/15/2022)
Others have suggested building safeguards around the AGI or superintelligence. They’ve mooted measures of varying degrees of complexity, from denying it access to the internet, to restricting its contact with the outside world, to trapping it in a series of concentric virtual worlds. None of these safeguards inspire confidence. First, as Roman V. Yampolskiy, Associate Professor of Computer Engineering and Computer Science at the University of Louisville, noted, every security measure ever invented has eventually been circumvented. “Signatures have been faked, locks have been picked, supermax prisons had escapes, guarded leaders have been assassinated, bank vaults have been cleaned out, laws have been bypassed…passwords have been brute-forced, networks have been penetrated, computers have been hacked, biometric systems have been spoofed, credit cards have been cloned, cryptocurrencies have been double spent…CAPTCHAs have been cracked, cryptographic protocols have been broken,” he wrote. “Millennia long history of humanity contains millions of examples of attempts to develop technological and logistical solutions to increase safety and security, yet not a single example exists which has not eventually failed.” Any safeguards would eventually be circumvented either by human hackers, or acts of nature (for example, the tsunami that caused the radiation leak at the Fukushima nuclear reactor). Whilst a certain failure rate may be acceptable in an enterprise where the stakes are lower, it’s unacceptable where a single leak might be all the AI needs to end humanity’s dominance.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Not Science Fiction
Robby Berman, 2021 (political analyst), THE FUTURE. Jan. 20, 2021. Retrieved May 18, 2022 from
“A super-intelligent machine that controls the world sounds like science fiction,” says paper co-author Manuel Cebrian in a press release. “But there are already machines that perform certain important tasks independently without programmers fully understanding how they learned it. The question therefore arises whether this could at some point become uncontrollable and dangerous for humanity.”
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Not Science Fiction
Shaun Tan, 9/26/2017 (staff writer, “We Need an AI Limitation Treaty. Now.” , Retrieved 6/15/2022)
For most, the threat of artificial intelligence seems like science fiction, the stuff of movies like I, Robot, The Matrix, and The Terminator. But the threat it poses is real. Prominent computer scientists have warned of it for years, and recently some of the smartest people on the planet have taken up the call. Bill Gates considers AI more dangerous than a nuclear catastrophe, Elon Musk said it was probably humanity’s “biggest existential threat,” Steven Hawking said it could “spell the end of the human race.”
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Economy
Jomo Kwame Sundaram & Vladimir Popov, 2/12/2019 (Jomo Kwame Sundaram, a former economics professor, was United Nations Assistant Secretary-General for Economic Development, and received the Wassily Leontief Prize for Advancing the Frontiers of Economic Thought in 2007 & Vladimir Popov, a former senior economics researcher in the Soviet Union, Russia and the United Nations Secretariat, is now Research Director at the Dialogue of Civilizations Research Institute in Berlin, “Economic Crisis Can Trigger World War,” , Retrieved 8/2/2021)
KUALA LUMPUR and BERLIN, Feb 12 2019 (IPS) - Economic recovery efforts since the 2008-2009 global financial crisis have mainly depended on unconventional monetary policies. As fears rise of yet another international financial crisis, there are growing concerns about the increased possibility of large-scale military conflict. More worryingly, in the current political landscape, prolonged economic crisis, combined with rising economic inequality, chauvinistic ethno-populism as well as aggressive jingoist rhetoric, including threats, could easily spin out of control and ‘morph’ into military conflict, and worse, world war. Crisis responses limited The 2008-2009 global financial crisis almost ‘bankrupted’ governments and caused systemic collapse. Policymakers managed to pull the world economy from the brink, but soon switched from counter-cyclical fiscal efforts to unconventional monetary measures, primarily ‘quantitative easing’ and very low, if not negative real interest rates. But while these monetary interventions averted realization of the worst fears at the time by turning the US economy around, they did little to address underlying economic weaknesses, largely due to the ascendance of finance in recent decades at the expense of the real economy. Since then, despite promising to do so, policymakers have not seriously pursued, let alone achieved, such needed reforms. Instead, ostensible structural reformers have taken advantage of the crisis to pursue largely irrelevant efforts to further ‘casualize’ labour markets. This lack of structural reform has meant that the unprecedented liquidity central banks injected into economies has not been well allocated to stimulate resurgence of the real economy. From bust to bubble Instead, easy credit raised asset prices to levels even higher than those prevailing before 2008. US house prices are now 8% more than at the peak of the property bubble in 2006, while its price-to-earnings ratio in late 2018 was even higher than in 2008 and in 1929, when the Wall Street Crash precipitated the Great Depression. As monetary tightening checks asset price bubbles, another economic crisis — possibly more severe than the last, as the economy has become less responsive to such blunt monetary interventions — is considered likely. A decade of such unconventional monetary policies, with very low interest rates, has greatly depleted their ability to revive the economy. The implications beyond the economy of such developments and policy responses are already being seen. Prolonged economic distress has worsened public antipathy towards the culturally alien — not only abroad, but also within. Thus, another round of economic stress is deemed likely to foment unrest, conflict, even war as it is blamed on the foreign. International trade shrank by two-thirds within half a decade after the US passed the Smoot-Hawley Tariff Act in 1930, at the start of the Great Depression, ostensibly to protect American workers and farmers from foreign competition! Liberalization’s discontents Rising economic insecurity, inequalities and deprivation are expected to strengthen ethno-populist and jingoistic nationalist sentiments, and increase social tensions and turmoil, especially among the growing precariat and others who feel vulnerable or threatened. Thus, ethno-populist inspired chauvinistic nationalism may exacerbate tensions, leading to conflicts and tensions among countries, as in the 1930s. Opportunistic leaders have been blaming such misfortunes on outsiders and may seek to reverse policies associated with the perceived causes, such as ‘globalist’ economic liberalization. Policies which successfully check such problems may reduce social tensions, as well as the likelihood of social turmoil and conflict, including among countries. However, these may also inadvertently exacerbate problems. The recent spread of anti-globalization sentiment appears correlated to slow, if not negative per capita income growth and increased economic inequality. To be sure, globalization and liberalization are statistically associated with growing economic inequality and rising ethno-populism. Declining real incomes and growing economic insecurity have apparently strengthened ethno-populism and nationalistic chauvinism, threatening economic liberalization itself, both within and among countries. Insecurity, populism, conflict Thomas Piketty has argued that a sudden increase in income inequality is often followed by a great crisis. Although causality is difficult to prove, with wealth and income inequality now at historical highs, this should give cause for concern. Of course, other factors also contribute to or exacerbate civil and international tensions, with some due to policies intended for other purposes. Nevertheless, even if unintended, such developments could inadvertently catalyse future crises and conflicts. Publics often have good reason to be restless, if not angry, but the emotional appeals of ethno-populism and jingoistic nationalism are leading to chauvinistic policy measures which only make things worse. At the international level, despite the world’s unprecedented and still growing interconnectedness, multilateralism is increasingly being eschewed as the US increasingly resorts to unilateral, sovereigntist policies without bothering to even build coalitions with its usual allies. Avoiding Thucydides’ iceberg Thus, protracted economic distress, economic conflicts or another financial crisis could lead to military confrontation by the protagonists, even if unintended. Less than a decade after the Great Depression started, the Second World War had begun as the Axis powers challenged the earlier entrenched colonial powers. They patently ignored Thucydides’ warning, in chronicling the Peloponnesian wars over two millennia before, when the rise of Athens threatened the established dominance of Sparta! Anticipating and addressing such possibilities may well serve to help avoid otherwise imminent disasters by undertaking pre-emptive collective action, as difficult as that may be. The international community has no excuse for being like the owners and captain of the Titanic, conceitedly convinced that no iceberg could possibly sink the great ship.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Economy
Mike Thomas, 2021 (staff reporter), BUILTIN. July 6, 2021. Retrieved May 18, 2022 from
Have you ever considered that algorithms could bring down our entire financial system? That’s right, Wall Street. You might want to take notice. Algorithmic trading could be responsible for our next major financial crisis in the markets. What is algorithmic trading? This type of trading occurs when a computer, unencumbered by the instincts or emotions that could cloud a human’s judgement, execute trades based off of pre-programmed instructions. These computers can make extremely high-volume, high-frequency and high-value trades that can lead to big losses and extreme market volatility. Algorithmic High-Frequency Trading (HFT) is proving to be a huge risk factor in our markets. HFT is essentially when a computer places thousands of trades at blistering speeds with the goal of selling a few seconds later for small profits. Thousands of these trades every second can equal a pretty hefty chunk of change. The issue with HFT is that it doesn’t take into account how interconnected the markets are or the fact that human emotion and logic still play a massive role in our markets. A sell-off of millions of shares in the airline market could potentially scare humans into selling off their shares in the hotel industry, which in turn could snowball people into selling off their shares in other travel-related companies, which could then affect logistics companies, food supply companies, etc. Take the “Flash Crash” of May 2010 as an example. Towards the end of the trading day, the Dow Jones plunged 1,000 points (more than $1 trillion in value) before rebounding towards normal levels just 36 minutes later. What caused this crash? A London-based trader named Navinder Singh Sarao first caused the crash and then it became exacerbated by HFT computers. Apparently Sarao used a “spoofing” algorithm that placed an order for thousands of stock index futures contracts betting that the market would fall. Instead of going through with the bet, Sarao was going to cancel the order at the last second and buy the lower priced stocks that were being sold off due to his original bet. Other humans and HFT computers saw this $200 million bet and took it as a sign that the market was going to tank. In turn, HFT computers began one of the biggest stock sell-offs in history, causing a brief loss of more than $1 trillion globally.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Bias
Ulrike Franke, 2021 (Senior Policy Fellow, European Council on Foreign Relations), ARTIFICIAL DIVIDE: HOW EUROPE AND AMERICA COULD CLASH OVER AI. Jan. 2021. Retrieved May 18, 2022 from https://ecfr.eu/publication/artificial-divide-how-europe-and-america-could-clash-over-ai/
Machine-learning systems are those that use computing power to execute algorithms that learn from data. This means that AI is only as good as the algorithm it uses and the data it is being trained on. If, for example, the data is incomplete or biased, the AI trained on it will be equally biased. AI researchers around the world, and especially researchers from minority groups, have raised the alarm about this particular risk, which has already materialised in several cases. In the US, a risk assessment tool used in Florida's criminal justice system labelled African-American defendants as "high risk" at nearly twice the rate as white defendants. A hiring algorithm used at Amazon penalised applicants from women's colleges, while a chatbot trained on Twitter interactions started to post racist tweets. The concern is that real-life data fed into machine-learning systems perpetuate existing human biases, and that - as humans tend to consider computers to be rational - these biases will effectively be sanctioned, thereby entrenching prejudice further in society. Furthermore, AI trained on datasets collected in one cultural context and deployed in another cultural context might effectively enable cultural imperialism. In response to these concerns, big tech firms have developed principles and guidelines, and created research groups and divisions, on ethical AI. More recently, however, scandals have emerged over big tech employees reportedly being forced to leave their jobs for being too critical, heightening concerns that these companies are not taking the issue seriously enough.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Bias
Mike Thomas, 2021 (staff reporter), BUILTIN. July 6, 2021. Retrieved May 18, 2022 from
Various forms of AI bias are detrimental, too. Speaking recently to the New York Times, Princeton computer science professor Olga Russakovsky said it goes well beyond gender and race. In addition to data and algorithmic bias (the latter of which can “amplify” the former), AI is developed by humans and humans are inherently biased. “A.I. researchers are primarily people who are male, who come from certain racial demographics, who grew up in high socioeconomic areas, primarily people without disabilities,” Russakovsky said. “We’re a fairly homogeneous population, so it’s a challenge to think broadly about world issues.” In the same article, Google researcher Timnit Gebru said the root of bias is social rather than technological, and called scientists like herself “some of the most dangerous people in the world, because we have this illusion of objectivity.” The scientific field, she noted, “has to be situated in trying to understand the social dynamics of the world, because most of the radical change happens at the social level.”
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk Outweighs
Nick Bostrom, 2012 (philosopher @ the University of Oxford), WE'RE UNDERESTIMATING THE RISK OF HUMAN EXTINCTION. Mar. 6, 2012. Retrieved May 18, 2022 from
Nick Bostrom: Well suppose you have a moral view that counts future people as being worth as much as present people. You might say that fundamentally it doesn't matter whether someone exists at the current time or at some future time, just as many people think that from a fundamental moral point of view, it doesn't matter where somebody is spatially---somebody isn't automatically worth less because you move them to the moon or to Africa or something. A human life is a human life. If you have that moral point of view that future generations matter in proportion to their population numbers, then you get this very stark implication that existential risk mitigation has a much higher utility than pretty much anything else that you could do. There are so many people that could come into existence in the future if humanity survives this critical period of time---we might live for billions of years, our descendants might colonize billions of solar systems, and there could be billions and billions times more people than exist currently. Therefore, even a very small reduction in the probability of realizing this enormous good will tend to outweigh even immense benefits like eliminating poverty or curing malaria, which would be tremendous under ordinary standards.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Outweighs Other Existential Risks
Mike Thomas, 2021 (staff reporter), BUILTIN. July 6, 2021. Retrieved May 18, 2022 from
Considering the number and scope of unfathomably horrible events in world history, that’s really saying something. And in case we haven’t driven home the point quite firmly enough, research fellow Stuart Armstrong from the Future of Life Institute has spoken of AI as an “extinction risk” were it to go rogue. Even nuclear war, he said, is on a different level destruction-wise because it would “kill only a relatively small proportion of the planet.” Ditto pandemics, “even at their more virulent.”
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Rory Cellan-Jones, 2014 (Technology correspondent), BBC. Dec. 2, 2014. Retrieved May 18, 2022 from
Prof Hawking says the primitive forms of artificial intelligence developed so far have already proved very useful, but he fears the consequences of creating something that can match or surpass humans. Stanley Kubrick's film 2001 and its murderous computer HAL encapsulate many people's fears of how AI could pose a threat to human life "It would take off on its own, and re-design itself at an ever increasing rate," he said.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Rory Cellan-Jones, 2014 (Technology correspondent), BBC. Dec. 2, 2014. Retrieved May 18, 2022 from
Prof Stephen Hawking, one of Britain's pre-eminent scientists, has said that efforts to create thinking machines pose a threat to our very existence. He told the BBC:"The development of full artificial intelligence could spell the end of the human race." His warning came in response to a question about a revamp of the technology he uses to communicate, which involves a basic form of AI.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Manuel Alfonseca, et al, 2021 (Escuela Politécnica Superior, Universidad Autónoma de Madrid, Madrid, Spain), JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH. 2021. Retrieved May 18, 2022 from
An even greater risk, however, is the prospect of a superintelligent AI: an entity that is “smarter than the best human brains in practically every field” (Bostrom, 2014), quoting the words of Oxford philosopher Nick Bostrom. A number of public statements by high-profile scientists and technolo¬gists, such as Stephen Hawking, Bill Gates, and Elon Musk, have given the issue a high prominence (Cellan-Jones, 2014; Proudfoot, 2015). But this concern has also gained relevance in academia, where the discourse about the existential risk related to AI has attracted mathematicians, scientists and philosophers, and funneled funding to research institutes and organizations.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Rory Cellan-Jones, 2014 (Technology correspondent), BBC. Dec. 2, 2014. Retrieved May 18, 2022 from
Elon Musk, chief executive of rocket-maker Space X, also fears artificial intelligence In the longer term, the technology entrepreneur Elon Musk has warned that AI is "our biggest existential threat". Robotic voice In his BBC interview, Prof Hawking also talks of the benefits and dangers of the internet. He quotes the director of GCHQ's warning about the net becoming the command centre for terrorists: "More must be done by the internet companies to counter the threat, but the difficulty is to do this without sacrificing freedom and privacy."
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Nick Bostrom, 2012 (philosopher @ the University of Oxford), WE'RE UNDERESTIMATING THE RISK OF HUMAN EXTINCTION. Mar. 6, 2012. Retrieved May 18, 2022 from
Bostrom: I think the biggest existential risks relate to certain future technological capabilities that we might develop, perhaps later this century. For example, machine intelligence or advanced molecular nanotechnology could lead to the development of certain kinds of weapons systems. You could also have risks associated with certain advancements in synthetic biology.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Michael Cohen, 2021 (MA in computer science from Australian National University), EXTINCTION RISK FROM ARTIFICIAL INTELLIGENCE. Oct. 12, 2021. Retrieved May 18, 2022 from
Humans will eventually make a human-level intelligence that pursues goals. That intelligence will quickly surpass human-level intelligence. At that point, it will be very hard to keep it from connecting to the Internet. Most goals, when pursued efficiently by an AI connected to the Internet, result in the extinction of biological life. But wait, it gets better! Most goals that preserve human existence still would not preserve freedom, autonomy, and a number of other things we value. Er worse… did I say better? It is profoundly difficult to give an AI a goal such that it would preserve the things we care about, we can’t even check if a potential goal would be safe, and we have to get AI right on the first attempt. If someone makes human-level-AI before anyone makes human-level-AI-with-a-safe-goal-structure, we will all die, and as hard as the former is, the latter is much harder.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Ross Andersen, 2012 (deputy editor of the Atlantic), WE'RE UNDERESTIMATING THE RISK OF HUMAN EXTINCTION. Mar. 6, 2012. Retrieved May 18, 2022 from
Unthinkable as it may be, humanity, every last person, could someday be wiped from the face of the Earth. We have learned to worry about asteroids and supervolcanoes, but the more-likely scenario, according to Nick Bostrom, a professor of philosophy at Oxford, is that we humans will destroy ourselves. Bostrom, who directs Oxford's Future of Humanity Institute, has argued over the course of several papers that human extinction risks are poorly understood and, worse still, severely underestimated by society. Some of these existential risks are fairly well known, especially the natural ones. But others are obscure or even exotic. Most worrying to Bostrom is the subset of existential risks that arise from human technology, a subset that he expects to grow in number and potency over the next century.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Kai Kupferschmidt, 2018 (contributing correspondent for Science magazine), SCIENCE. Jan. 11, 2018. Retrieved May 18, 2022 from
Philosopher Nick Bostrom believes it's entirely possible that artificial intelligence (AI) could lead to the extinction of Homo sapiens. In his 2014 bestseller Superintelligence: Paths, Dangers, Strategies, Bostrom paints a dark scenario in which researchers create a machine capable of steadily improving itself. At some point, it learns to make money from online transactions and begins purchasing goods and services in the real world. Using mail-ordered DNA, it builds simple nanosystems that in turn create more complex systems, giving it ever more power to shape the world. Now suppose the AI suspects that humans might interfere with its plans, writes Bostrom, who's at the University of Oxford in the United Kingdom. It could decide to build tiny weapons and distribute them around the world covertly. "At a pre-set time, nanofactories producing nerve gas or target-seeking mosquito-like robots might then burgeon forth simultaneously from every square meter of the globe." For Bostrom and a number of other scientists and philosophers, such scenarios are more than science fiction. They're studying which technological advances pose "existential risks" that could wipe out humanity or at least end civilization as we know it—and what could be done to stop them. "Think of what we're trying to do as providing a scientific red team for the things that could threaten our species," says philosopher Huw Price, who heads the Centre for the Study of Existential Risk (CSER) here at the University of Cambridge.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Mark Stockley, 2015 (writer for Sophos), ARTIFICIAL INTELLIGENCE COULD MAKE US EXTINCT, WARN OXFORD UNIVERSITY RESEARCHERS. Feb. 17, 2015. Retrieved May 18, 2022 from
Stephen Hawking, whose speech synthesiser uses a basic form of AI, isn’t a man with a lot of words to spare and when he spoke to the BBC about AI he was characteristically terse: The development of full artificial intelligence could spell the end of the human race. Humans, who are limited by slow biological evolution, couldn't compete, and would be superseded.
2022
SDI
Negative
Disadvantages › Rogue AI Disadvantage › Impact – Existential Risk
Gerrard Kaonga, 2019 (US News Reporter), EXPRESS. Oct. 7, 2019. Retrieved May 18, 2022 from
Mr Russell insisted that unless this changed, AI could lead to human extinction as we give it the tasks of solving complicated problems like crime and climate change. He said: “If you think about it, the way we build Artificial Intelligence is a bit like the way we think of a genie in a lamp. “You rub the lamp and the genie comes out and you say I want this to happen. “If the AI system is sufficiently powerful it will do exactly what you ask and you will get exactly what you asked for. “Now the problem with genies in lamps is the third wish is always to undo the first two wishes. “This is because we are unable to specify the objectives correctly. “So a machine pursuing an objective that isn’t the right one becomes an enemy of the human race, an enemy that is much more powerful than us.