Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

They’ve got it backwards--- AI singularity solves threats.

Rick Hayes-Roth 10-02-2006 [Rick Hayes-Roth is a professor in the Information Sciences Dept. at the Naval Postgraduate School in Monterey, California, Institute of Electrical and Electronics Engineers, “Puppetry vs. Creationism: Why AI Must Cross the Chasm,” https://ieeexplore.ieee.org/abstract/document/1705420/authors#authors//ZW]

Most of the visions for self-modifying and self-improving AI have been a bit scary or a bit shallow. Much discussion has occurred around the concept of the singularity, first explained by Vernor Vinge2 and now a theme popularized by Ray Kurzweil,3 among others (for example, see www.aleph. so/Trans/Global/Singularity). Roughly, the singularity is a point in history when technology accelerates beyond human capacity to master it. With regard to AI, this could mean that computers learn and communicate with one another faster than they can with humans. At that point, they might not be willing to slow down or engage further. In such a case, the machines would reach a kind of escape velocity, enabling them to leave human culture behind. I'm suggesting that we should actively seek to create the capabilities underlying such a possibility, because the potential gains are exponentially greater than what traditional puppetry can produce. But this surely entails risks, as readily suggested in most of the scary movies about rogue AI and robots gone haywire. We obviously have limited insight into both the positive and negative capabilities of self-improving AI systems. Although the road will be somewhat long, we ought to consider ways to identify and mitigate the risks before they afflict us. Fortunately, many people interested in the singularity and future visions of robots have given these issues serious consideration. We'll want to incorporate their ideas and related technologies into the new creationism agenda. This will help prevent predictable problems and provide additional insurance against the unforeseen. Although I consider these risks serious, I think we can de-emphasize or defer them a bit. To get out of the puppetry business will require a major shift in investment, orientation, and technology. By focusing mostly on the required new capacities for model-based learning and improvements in operational contexts, we put first things first. Like the master puppet makers of the classic folktales, AI engineers have built some marvelous machines. These machines are surely valuable, but our puppetry won't cross the chasm separating us from a world of artificially intelligent creatures. To get there, we need a singularity of artificial creationism, where we launch artificial beings that can adapt, learn, and evolve. We need to emphasize the development of continuously self-improving systems that interact with and perform tasks in the physical world. Creation of those systems will mark a singularity in the punctuated evolution of artificial intelligence.

Sign in to recut, update, or save this card.