CS Paper Radar

Why machines will still not rule the world

Jobst Landgrebe, Barry Smith

cs.AI ·submitted 2026-10-08 07:51 UTC · v1
position

Abstract

In our book Why machines will never rule the world [13, 14] we argue that arti- ficial general intelligence is mathematically impossible. This is because the human beings and the processes which exhibit intelligence are complex systems whose be- haviour cannot be captured by the kinds of models that we can generate with or without computers. Proponents of contemporary machine intelligence respond with two lines of argument: a theoretical one, grounded in the universal approximation theorems for neural networks and the Church-Turing-Deutsch principle; and an em- pirical one, grounded in rapidly rising scores on standardized benchmarks. In this communication we examine and reject both responses. First, we show serious issues in the physicalist counter-argument based on the Church-Turing-Deutsch principle. Second, we review recent evidence to the effect that prominent benchmarks are compromised by training-data contamination, flawed test construction, and strate- gic optimization. Our central argument remains: That models required to perform cognitive behaviour in open-ended, thermodynamically complex and non-ergodic environments are not and will not become achievable.

Closest papers

Nearest neighbours by meaning across the whole index.

Fundamental Mathematics in the Age of AI -- The Residue, the Journey, and the Ecology

cs.CY math.HO ·2026-08-13 ·Benjamin Collas
position similarity 0.61
Abstract · 26(+9) pages, 3(+1) figures, 2 tables. Companion paper to Parmy Olson's "Math's AI Crisis Has a Lesson For the Rest of Us" (Bloomberg, Aug. …

Large language models have begun refuting long-standing conjectures and solving long-open problems. The introspection this has prompted about the future of mathematical discovery is well under way, and the anxiety accompanying it legitimate -- but both, we claim, are attached to the wrong loss. What machines now produce is the countable part of mathematics -- theorems, proofs, refutations -- which was always the work's residue, not its product. The distinction is old, and not economic: a result can be taken in its finished essence, or in the operations that engendered it. The product is human understanding: not a stock of results but a collective, hard-won way of deciphering the world and acting upon it. The two are arcs of a single loop: understanding tells us where to look; looking produces the residue; and taking it up again, one journey at a time, rebuilds shared understanding. Machines are strong on the countable arc, absent from the one that feeds it. The peril is to leave the loop open. AI did not create the confusion between residue and product; it has called a bluff long on the books, driving the cost of the residue towards zero and making the scarce thing visible at last. A new instrument makes a new way of working before it makes a new result. The pressing questions are therefore institutional: who can check an announced result, whoever announces it; what work and training become for the next generation of researchers; and whether the one thing that cannot be mass-produced -- the journey that nourishes a shared understanding -- continues to be funded. Mathematics, we argue, is uniquely placed among the sciences on the first -- a proof answers to no one's permission -- and uniquely exposed on the other two: teaching cannot go on as before, and no collective position yet exists; and the journey has never had a price our institutions knew how to pay. The decision is ours.

0.04

The Past and Future of AI Scientists

cs.AI ·2026-08-14 ·Ross D. King
survey similarity 0.58
Abstract

We present a survey of the past and future of AI Scientists: machines capable of automating science. AI Scientists can originate hypotheses, deduce their consequences, design and execute experiments, interpret their results, and revise their beliefs. Such systems are integrated scientific agents, connected to the literature, formal knowledge, mathematical models, simulations, data-analysis systems and physical laboratories. Adam was the first machine to make novel scientific discoveries through cycles of hypothesis formation and physical experimentation. Eve established the architecture of the modern self-driving laboratory. Foundation models, autonomous agents and laboratory robotics now make it possible to build systems far more general than either Adam or Eve. The central problem is no longer whether individual components of science can be automated. They can. The problem is integration. AI Scientists must combine neural learning with logic, probability, mathematics, causal reasoning, simulation, experimental design, robotics and formal scientific records. AI Scientists have the potential to transform science: to make science faster, cheaper, more systematic and more reproducible. AI Scientists could investigate systems too complicated for unaided human science, and enable thousands of AI scientists to work together on single problems. The Nobel Turing Challenge sets the goal of developing by 2050 AI systems capable of automating Nobel-quality discoveries. Progress is ahead of schedule. When we succeed it will create a new form of science and transform the world.

0.04

At the Limits of Computability: Steps Towards Autonomous AI Discovery on the Busy Beaver Frontier

cs.AI cs.FL ·2026-10-15 ·Marco Dos Santos, Vivek Veeriah, Alex Havrilla, Andrew Bolt, Goran Zuzic +2 more
theory similarity 0.58
Abstract

Recent breakthroughs in AI for mathematics---ranging from Olympiad medal performances to resolving long-standing open conjectures---have rapidly expanded what automated systems can achieve. Yet these successes primarily concern predefined, human-formulated problems, leaving open how AI systems can autonomously uncover mathematical structure and formulate new questions. To push beyond static challenges, we explore the Busy Beaver (BB) domain, an uncomputable frontier that is fundamentally open-ended. Because no algorithm can compute the Busy Beaver number $\mathrm{BB}(n)$ for every $n$, this domain provides a natural setting for sustained exploration through mathematical conjecture and proof. In this paper, we introduce a Gemini-based agentic pipeline that automatically discovers accelerations of Turing machines, expressed as compact mathematical rules summarizing many execution steps. Our system integrates pattern recognition, automated conjecturing, informal mathematical reasoning, and formal theorem proving in Lean. With this framework, our system autonomously discovered and formally verified novel Collatz-like accelerations for eleven machines in $\mathrm{BB}(6)$. Subject to community acceptance, we provisionally classify these machines as Cryptids, namely machines whose blank-tape executions admit exact, compact mathematical descriptions but whose halting behavior remains unresolved. These results advance the analysis of $\mathrm{BB}(6)$ holdouts on the Busy Beaver frontier and demonstrate the potential of autonomous AI systems for open-ended mathematical discovery in fundamental computer science.

0.24

Process-Constituted Intelligence: A Shared Criterion for Humans and Machines

cs.AI cs.ET ·2026-08-17 ·Michael J. Richardson, Manuel Varlet, Ayeh Alhasan, Cassandra Crone, M. Paula Diaz Monfort +4 more
hot direction similarity 0.57
Abstract · v2: revised throughout for clarity and consistency; supplementary cross-references corrected

Intelligence is constituted by \textit{process} (iterative activity through which output emerges), not in the output itself. Generative AI (GenAI) is trained on \textit{traces} (textual and visual residues of human cognitive processes), reproducing samples from a distribution of those traces. Its outputs resemble reasoning, problem-solving, and creativity, yet the activity that produces such outputs in humans remains largely absent. Current GenAI is, therefore, weakly equivalent to the cognition it imitates, matching outputs while process stays absent or opaque. The cognitive sciences have long distinguished between weak and strong equivalence. Here, we define \textit{strong} equivalence across seven process features, assessable against human and machine cognition. Our process-based account addresses a symmetric risk: GenAI tools that outsource a person's generative processes may leave critical capacities unbuilt. We specify design principles for GenAI that instantiate more process and preserve rather than erode human judgment and creativity, and outline process audits that make strong equivalence testable.

0.29

From Maps to Metabolism: Historical Precedents and a Unified Critique of Computationalism

cs.AI q-bio.NC ·2026-10-23 ·J. Mark Bishop, Slawomir J. Nasuto
similarity 0.57
Abstract

Alexander Lerchner's recent work on the 'abstraction fallacy' argues that computational functionalism confuses physical processes with abstract descriptions, and that symbolic computation alone cannot instantiate consciousness. Yet these claims were anticipated by Korzybski's map-territory distinction, Searle's critique of strong artificial intelligence, Floridi's levels of abstraction, Spencer et al.'s observer-relativity arguments, Winograd and Flores's account of computation as socially grounded practice, and Nasuto and Bishop's biological arguments. Synthesizing these contributions, this paper advances a form of non-computational physicalism: consciousness depends upon intrinsically organized, metabolically grounded physical dynamics rather than abstract computation, whilst leaving open the possibility of artificial consciousness. An objection is that this critique targets an outdated computationalism. Mechanistic computationalism, associated with Milkowski, Piccinini, Craver, Bechtel, and Kaplan, treats computation as a property of physically realized mechanisms rather than substrate-independent formalism. Although this represents an important advance, it does not dissolve the abstraction fallacy. Computational attributions remain dependent upon choices of state individuation, system boundaries, and interpretive mapping that are not determined by physical facts alone. Kaplan and Craver's 'model-to-mechanism mapping' constrains computational descriptions without eliminating their dependence upon an external observer. Grounding computation in neural mechanisms does not confer intrinsic significance or the normativity explored by Bickhard and Nasuto and Bishop. The abstraction fallacy persists wherever computational descriptions are treated as constitutive of, rather than descriptive of, physical reality.

0.24

Artificiality's First Exam: An LLM-Referenced C-test for Supraintelligence

cs.AI cs.CLcs.LG ·2026-09-27 ·Jose Hernandez-Orallo
benchmarktheorycode/data similarity 0.57
Abstract · Preprint, under review. 63 pages. Code and data at https://github.com/jorallo/ctest-one

Under the accelerated pace of AI development, any benchmark whose difficulty is calibrated with humans or current AI systems becomes circular, or saturates soon. How can we then evaluate machines that may become more capable than the current machines and the people who write the tests? One answer to the question hinges on inverse problems, inductive inference questions for which difficulty depends on the complexity of the underlying mechanism, given the observations and the previous knowledge. Levin's Kt, a computable variant of Kolmogorov complexity, puts a theoretical upper bound to that difficulty, balancing the simplest representation encoding for the mechanism and the logarithm of the time steps to run that mechanism. Previous tests derived from Levin's Kt, such as the original C-test, are based on minimalistic Universal Turing Machines (UTM), capable of very limited representations and no previous knowledge. Reasoning large language models (LLM) are UTMs that capture a compendium of human culture as knowledge, using prompts as natural language programs. This paper presents the first test based on Levin's Kt with LLMs as representational machines. Fresh test items can be produced at high difficulties, estimated in a ratio scale measured in bits, before any human or frontier model can solve them. We formalise the measure, devise a lightweight generation and certification pipeline, explore the effect of the power of the reference machine and the gap between examiner and examinee. We produce a first battery of certified items administered to twelve LLMs. The resulting agent characteristic curves decrease with difficulty, down to the uncharted high-difficulty region, the supra-intelligence window of items we can certify, yet beyond generations of frontier intelligence.

0.47

Machine Learning Beyond Statistical Consistency for Hybrid AI

cs.LG cs.AIcs.LOstat.ML ·2026-11-01 ·Jinsook Kim, Jinho Kang
theory similarity 0.56
Abstract

We propose a new definition of machine learning, according to which a machine learns a function when it computes the function successfully, that is, when the value it returns for each input has a proper derivation in a formal system. We extend Gödel's Representability Theorem, which equates computation with derivation, to empirical targets in two ways: the theorem is extended to the computable reals, and the data are admitted into the system as empirical definitions that record what has been observed. We prove that a machine learns a true probability if and only if two conditions are met. The Truth Condition is that its estimate converges to the true probability, which is statistical consistency. The Assurance Condition is that the machine properly derives its own convergence inside the system. Learning thus lies beyond statistical consistency, for it requires a derivation of the convergence from the record. A global assumption about the data, such as the i.i.d. assumption, does not supply such a derivation, because it leads only to a circular one, as we show for PAC learning. On the other hand, the two conditions are met for the probability of a sentence over a finite ideal corpus. A real machine can approximate a true probability only if an ideal machine can learn it precisely, that is, only in a domain that meets the two conditions. Modern AI works in such a domain, and we offer this as a clue to its success. Modern AI is hybrid as well, in two senses: First, it performs two kinds of tasks, namely probabilistic ones such as predicting the next word and deductive ones such as proving and coding. Second, it combines two parts of different kinds, a statistical proposer and a deductive verifier, for proving and coding. Our framework explains both senses of hybridity in one formal system.

0.51

Flawed in Nature, Perfect through Evolution

cs.LG cs.AIcs.NE ·2026-08-31 ·J. M. Diederik Kruijssen
publishedtheory similarity 0.56
Abstract · 32 pages, 16 figures; appeared in ADI (September 2026)

The performance of artificial intelligence (AI) and machine learning (ML) models degrades when the problem they were trained on drifts. This is a near-universal feature of real-world problems, which often change unpredictably. Biological evolution has achieved intelligence by overcoming this obstacle through natural selection acting on heritable variation. AI/ML techniques have long incorporated forms of natural selection, but it has been challenging to maintain model diversity as optimization naturally drives convergence. Here we show that a swarm of AI/ML models subjected to deliberate mutations of their model coefficients away from optimality can reliably and sustainably improve performance in changing environments by acting as a statistical hedge against non-stationarity. We call this mechanism 'Flawed in Nature, Perfect through Evolution', reflecting that the collective performance gain goes at the expense of individual performance. We prove via four theorems that the resulting regret reduction is guaranteed under general conditions, establishing the Flawed-in-Nature mechanism as a generalizable design principle for AI/ML systems. We validate these results on synthetic linear regression tasks, demonstrating that the mutated swarm delivers the best model in $\sim80\%$ of environment changes and that inference synthesis successfully translates this individual advantage into a collective one. The mechanism proves to be most effective when the mutation drift rate matches the drift rate of the environment. We outline a simple, adaptive controller that enables practical applications by tuning the mutation drift rate to match the unknown drift rate of the environment. The close analogy of the Flawed-in-Nature mechanism to biological evolution suggests it may have been a critical missing ingredient for the organic discovery of AI forms that more closely mimic biological intelligence.

0.36