Continued development of AI leads to human extinction.
Michael Cohen, 2021 (MA in computer science from Australian National University), EXTINCTION RISK FROM ARTIFICIAL INTELLIGENCE. Oct. 12, 2021. Retrieved May 18, 2022 from https://aisafety.wordpress.com/
Humans will eventually make a human-level intelligence that pursues goals. That intelligence will quickly surpass human-level intelligence. At that point, it will be very hard to keep it from connecting to the Internet. Most goals, when pursued efficiently by an AI connected to the Internet, result in the extinction of biological life. But wait, it gets better! Most goals that preserve human existence still would not preserve freedom, autonomy, and a number of other things we value. Er worse… did I say better? It is profoundly difficult to give an AI a goal such that it would preserve the things we care about, we can’t even check if a potential goal would be safe, and we have to get AI right on the first attempt. If someone makes human-level-AI before anyone makes human-level-AI-with-a-safe-goal-structure, we will all die, and as hard as the former is, the latter is much harder.