AI risks human extinction and it can’t be controlled.
Mark Stockley, 2015 (writer for Sophos), ARTIFICIAL INTELLIGENCE COULD MAKE US EXTINCT, WARN OXFORD UNIVERSITY RESEARCHERS. Feb. 17, 2015. Retrieved May 18, 2022 from https://nakedsecurity.sophos.com/2015/02/17/artificial-intelligence-could-make-us-extinct-warn-oxford-university-researchers/
Researchers at Oxford University have produced the first list of global risks ‘that pose a threat to human civilisation, or even possibly to all human life.’ The report focuses on risks with ‘impacts that for all practical purposes can be called infinite’. Artificial Intelligence (AI) is on it. And while human extinction might be a horrific, accidental side effect of climate change, a metorite impact or a super volcano, the report warns that AI might decide to cause our extinction deliberately (my emphasis): ...extreme intelligences could not easily be controlled (either by the groups creating them, or by some international regulatory regime), and would probably act to boost their own intelligence and acquire maximal resources for almost all initial AI motivations. And if these motivations do not detail the survival and value of humanity, the intelligence will be driven to construct a world without humans. This makes extremely intelligent AIs a unique risk, in that extinction is more likely than lesser impacts. [ellipses in original].