Sorry but AGI is not a helpful concept

In a short Nature commentary "Does AI already have human-level intelligence? The evidence is clear," (lnkd.in/dbC_JfPb) authors Eddy Keming Chen, Mikhail Belkin, Leon Bergen, and David Danks argue that the long-standing goal of creating Artificial General Intelligence (AGI) has been achieved as of early 2026.

The authors contend that current Large Language Models (LLMs) have fulfilled Alan Turing’s 1950 vision of machines displaying flexible, general cognitive competence. Their argument rests on

1️⃣ Empirical Performance: In March 2025, GPT-4.5 passed a Turing test, being judged as human 73% more often than actual humans. That reinforces in my view the uselessness of the Turing test at this point. LLMs also demonstrate "expert-level" intelligence by winning gold medals in the International Mathematical Olympiad, proving theorems, and solving PhD-level exams.

2️⃣ Breadth and Depth: Unlike "narrow" AI (e.g., a chess program), LLMs show breadth across multiple domains—math, science, law, and creative arts—and sufficient depth to assist in frontier scientific research.

3️⃣ Functional Definitions: The authors argue that intelligence is a functional property, not a biological one. They assert that AGI should not require perfection, universal mastery of all tasks, human-like biology, or "superintelligence".

4️⃣ Emergent World Models: They dismiss the "stochastic parrot" critique, noting that current models can predict counterfactual physical outcomes and solve unpublished math problems, suggesting they have extracted the underlying structure of reality from data.

I agree with the authors that some AI models have demonstrated a breadth of abilities that is both mind blowing and until recently firmly in the realm of human intelligence. In fact some models are so good at so many things that they strike me as a form of alien intelligence, or, at the very least, alien problem-solving. They may be inefficient, in their use of training examples, energy and compute, but how they achieve this level of problem-solving is beside the point.

However, invoking AGI is unhelpful. Today’s AIs may not be fully autonomous or have persistent identity beyond the “context window”, but these shortcomings would be easily forgiven if they solved problems in a reliable manner. And there’s the rub: the jagged frontier. Today’s AIs exhibit bizarre failures in tasks trivial for humans, which suggests their "intelligence" is not just fundamentally different but also perhaps more fragile than human cognition on problems that are relevant to humans.

The Weierstrass function that seems to define the frontier between excellent and terrible performance makes any claim of AGI moot.