Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Superintelligence is a practical impossibility.

Edward Moore Geist, 8/9/2015 (MacArthur Nuclear Security Fellow at Stanford University's Center for International Security and Cooperation, “Is artificial intelligence really an existential threat to humanity?” https://thebulletin.org/2015/08/is-artificial-intelligence-really-an-existential-threat-to-humanity/, Retrieved 6/15/2022)

Convinced that sufficient “intelligence” can overcome almost any obstacle, Bostrom acknowledges few limits on what artificial intelligences might accomplish. Engineering realities rarely enter into Bostrom’s analysis, and those that do contradict the thrust of his argument. He admits that the theoretically optimal intelligence, a “perfect Bayesian agent that makes probabilistically optimal use of available information,” will forever remain “unattainable because it is too computationally demanding to be implemented in any physical computer.” Yet Bostrom’s postulated “superintelligences” seem uncomfortably close to this ideal. The author offers few hints of how machine superintelligences would circumvent the computational barriers that render the perfect Bayesian agent impossible, other than promises that the advantages of artificial components relative to human brains will somehow save the day. But over the course of 60 years of attempts to create thinking machines, AI researchers have come to the realization that there is far more to intelligence than simply deploying a faster mechanical alternative to neurons. In fact, the history of artificial intelligence suggests that Bostrom’s “superintelligence” is a practical impossibility.

Sign in to recut, update, or save this card.