Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Advancing AI is the most likely existential risk to humanity.

Kai Kupferschmidt, 2018 (contributing correspondent for Science magazine), SCIENCE. Jan. 11, 2018. Retrieved May 18, 2022 from https://www.science.org/content/article/could-science-destroy-world-these-scholars-want-save-us-modern-day-frankenstein

Viruses are unlikely to kill every last human, Bostrom says; for him and others, it is AI that poses truly existential threats. Most scenarios center on machines out-smarting humans, a feat called "super-intelligence." If such AI were ever achieved and it acquired a will of its own, it might turn malevolent and actively seek to destroy humans, like HAL, the computer that goes rogue aboard a spaceship in Stanley Kubrick's film 2001: A Space Odyssey. Most AI experts worry less about machines rising up to overthrow their creators, however, than about them making a fatal mistake. To Tallinn, the most plausible way in which AI could end humanity is if it simply pursued its goals and, along the way, heedlessly created an environment fatal to humans. "Imagine a situation where the temperature rises by 100° or is lowered by 100°. We'd go extinct in a matter of minutes," Tallinn says. Tegmark agrees: "The real problem with AI is not malice, it's incompetence," he says.

Sign in to recut, update, or save this card.