AGI is a distant dream---their scenario is science fiction.
---Not quite a strawman, but you should be wary of the parts that say things like ‘at least not yet,’ though I still think warrants apply.
Joshi 22, [Naveen Joshi (Director of Allerin Tech Pvt Ltd, Former Research Analyst at Bosch Research, Forbes Contributor), "Chasing The Myth: Why Achieving Artificial General Intelligence May Be A Pipe Dream," Forbes, https://www.forbes.com/sites/naveenjoshi/2022/03/25/chasing-the-myth-why-achieving-artificial-general-intelligence-may-be-a-pipe-dream/, accessed 7-2-2024, 3/28/22] Mr.Mr.
At the moment, there are certain factors that may prevent the creation and development of AGI, not least the fear in people’s minds that it will leave them unemployed, which makes the technology seem like a distant dream.
Human Consciousness Is Not Algorithm-Driven
As stated multiple times above, AGI applications are supposed to replicate human consciousness and cognitive abilities seamlessly. However, AGI developers cannot design neural networks that can recreate artificial consciousness in a lab—at least not yet. Human consciousness is too abstract and asymmetrical for any Turing machine to be used to model it for AGI creation. One approach to replicate human consciousness into an AGI model would be to treat the brain as a quantum computer to solve problems in polynomial time with brute computing power alone. While this would significantly boost the performance and efficiency of an algorithm, it would also not be the route to configuring machines with consciousness and their own distinctive human personalities.
Another issue with using programs and code is the "halting problem." This concept implies that every computer program, at some point in time, will pose functionality problems and stop running eventually for certain inputs. This is a problem that may have no solutions, with even Turing's studies showing in general that there isn't an algorithm that can resolve this problem. This then poses massive questions regarding the long-term functionality and computability of AGI-based tools.
There is a reason why humans are so unique and incomparable to even the most advanced machines of the past and present. AI, for all its incredible capabilities, still runs on painstakingly-created computer programs and algorithms. The most advanced AI tools can create such programs autonomously. However, the technology cannot generate lifelike consciousness in AGI-based tools. Even with all the advancements made in AI, every decision is backed by hardcore data analytics and processing, scoring low on factors such as logical reasoning, emotion-based decisions and other aspects.