Safeguards around AI will fail.
Shaun Tan, 9/26/2017 (staff writer, “We Need an AI Limitation Treaty. Now.” https://www.chinausfocus.com/society-culture/we-need-an-ai-limitation-treaty-now, Retrieved 6/15/2022)
Others have suggested building safeguards around the AGI or superintelligence. They’ve mooted measures of varying degrees of complexity, from denying it access to the internet, to restricting its contact with the outside world, to trapping it in a series of concentric virtual worlds. None of these safeguards inspire confidence. First, as Roman V. Yampolskiy, Associate Professor of Computer Engineering and Computer Science at the University of Louisville, noted, every security measure ever invented has eventually been circumvented. “Signatures have been faked, locks have been picked, supermax prisons had escapes, guarded leaders have been assassinated, bank vaults have been cleaned out, laws have been bypassed…passwords have been brute-forced, networks have been penetrated, computers have been hacked, biometric systems have been spoofed, credit cards have been cloned, cryptocurrencies have been double spent…CAPTCHAs have been cracked, cryptographic protocols have been broken,” he wrote. “Millennia long history of humanity contains millions of examples of attempts to develop technological and logistical solutions to increase safety and security, yet not a single example exists which has not eventually failed.” Any safeguards would eventually be circumvented either by human hackers, or acts of nature (for example, the tsunami that caused the radiation leak at the Fukushima nuclear reactor). Whilst a certain failure rate may be acceptable in an enterprise where the stakes are lower, it’s unacceptable where a single leak might be all the AI needs to end humanity’s dominance.