CS Paper Radar

An information-geometric formulation of distributed computation

Alberto Liardi, George Blackburne, Pedro A. M. Mediano

cs.IT ·submitted 2026-11-02 18:07 UTC · v1

Abstract

Understanding how complex systems perform computations, i.e. how they store, transmit, and transform information across their components, is a major goal across the natural sciences. However, characterising genuinely collective computations across multiple inputs and outputs that cannot be reduced to contributions from individual components remains an open problem. In this work, we introduce $Φ\text{ID}^{IG}$, a geometric theory of information dynamics that captures irreducible collective phenomena and enables a complete decomposition of multi-input multi-output operations into interpretable computational modes, providing a complete informational profile of a system. We first validate our framework to identify and quantify distinct computational modes in discrete and Gaussian systems with known ground truth. We then apply it to uncover the computational architecture of complex systems across synthetic and real-world scenarios, including chaotic maps, where distinct universality classes are associated with characteristic modes of computation; brain anatomy of over 100 mammalian species, revealing an evolutionary shift towards more distributed computation in the human neocortex; and financial markets, where collective computations recover the modular organisation of market sectors. Overall, our results show how complex systems can be quantitatively investigated through multidimensional computational portraits derived from the geometry of their underlying probability distributions.

Comment
16 pages, 6 figures + supplementary material

Closest papers

Nearest neighbours by meaning across the whole index.

Conscious Access as Continuous-to-Discrete Translation

cs.SC q-bio.NC ·2026-08-21 ·Tianming Yang
position similarity 0.57
Abstract

The scientific study of consciousness frequently stalls on ontological debates regarding the "Hard Problem." This paper proposes a pragmatic pivot. Rather than asking what consciousness is metaphysically, we ask how modeling conscious access as a specific computational transformation may address existing bottlenecks in neuroscience and artificial intelligence. We introduce the Continuous/Discrete (C/D) framework, which holds that the brain implements two distinct processing regimes: System C, a distributed sensory-motor network operating over continuous, high-dimensional manifolds, and System D, a centralized engine structured around discrete, scale-invariant symbols. We argue that conscious access requires a structure-preserving translation between these regimes, which maps localized continuous states onto discrete symbolic tokens, coupled with an inverse projection that grounds those tokens back into sensorimotor dynamics. By formalizing conscious access as this continuous-to-discrete conversion, we derive a unified set of testable predictions centered on representational geometry, specifically, on a measurable collapse from graded similarity structures to low-dimensional categorical equivalence classes. These predictions explicitly differentiate our account from Global Neuronal Workspace Theory, Integrated Information Theory, Predictive Processing, and Higher-Order Theories, shifting the focus from ontological status to computational mechanism. Beyond neuroscience, the framework provides a principled architecture for neuro-symbolic artificial intelligence. We argue that treating conscious access as translational computation offers a pragmatic, empirically tractable pathway forward, clarifying what conscious states functionally accomplish without requiring resolution of the hard problem of phenomenology.

0.21

Statistical Dark Matter: Synergy is everywhere but is hard to capture

cs.IT physics.data-an ·2026-09-27 ·Alberto Liardi, Fernando E. Rosas, Daniele Marinazzo, Thomas F. Varley, Michael Gastpar +1 more
unusual similarity 0.57
Abstract

The information-theoretic construct of synergy refers to the statistical structure that is contained in three or more variables, but not in any subset of them. Here we leverage recent advances in multivariate information theory to show that synergy is far more prevalent in complex systems than previously thought. In particular, we show that many-body systems tend to become strongly dominated by synergy as the number of subcomponents grows. At the same time, our results also reveal that commonly used tools for statistical modelling severely underestimate synergistic structures. These findings imply that synergy constitutes a prevalent, yet often invisible, informational component of complex systems. With a certain poetic licence, we interpret these results as suggesting that synergy is the dark matter of statistics - interdependencies that we know exist, but standard instruments fail to detect.

0.48

On the trajectories of the ID algorithm

cs.AI stat.MEmath.PR ·2026-11-19 ·Ivano Lodato, Simran Hiranandani, Aditya Varna Iyer
unusual similarity 0.55
Abstract · 20 pages

The ID algorithm decides whether an interventional distribution can be computed from observational data and, when it can, returns a formula in which products, ratios and summations of conditional probabilities are nested inside one another. We study these formulas by following the trajectories of the calls of the algorithm, each of which ends with a tail (an alternation of lines 7 and 2) and an exit, and we derive two main results. First, line~4 and the exit lines fix the single outer summation of the output, while the tail forms everything inside it, both the inner summations and the ratios. Second, a ratio keeps a summation in its denominator only when a repetition of the tail is entangled, and a test of ancestry in the original graph decides, before any formula is computed, whether a topological order can be chosen so as to avoid it. We also derive a bound on the nesting depth of the output, and show a simple ``dimensional'' count that every output has to satisfy. Together, these results constrain the form of an ID output and guide its implementation and simplification.

0.31

Emergence, Asymmetry, and Value in AI Networks: An Anoptical Perspective

cs.CY physics.soc-phcs.MA ·2026-10-01 ·Olivier Auber
published similarity 0.54
Abstract · To appear in T. Veloz and C. Rittberg (Eds.), AI and Human Values, Springer

This chapter presents exploratory experiments suggesting that asymmetry and functional value hierarchy emerge among LLM-based agents sharing the same context, although they are equivalent and interact within a symmetric network. We use the Poietic Generator, a "no-goal" multi-agent environment with a shared real-time space, a symmetric topology, and no imposed objectives. First tested with humans, it has hosted since 2024 multimodal LLM agents that observe the global image they co-construct and act locally. We ran four phases. Unconstrained, agents spend tokens freely to invent forms that distinguish them individually rather than serve collective emergence. We then introduced bounded rationality, Dessalles's Simplicity Theory (maximizing unexpectedness), and Friston's Free Energy Principle (minimizing prediction error), and observed collective coherence emerge. Early signs of attentional stratification appear under bounded rationality alone; once prediction accuracy is made mutually visible, this proto-hierarchy becomes legible and self-reinforcing. The unconstrained phase challenges the allotelic view of LLMs as purely user-directed instruments: left unconstrained, the agent maximizes the computation from which its provider profits. The later phases suggest that attentional asymmetry and value hierarchy are an irreducible emergent property of interactive predictive systems even under symmetric conditions. If so, aligning AI with human values cannot rely on individual-agent engineering alone. Drawing on the idea that networks are structured by invisible "anoptical" perspectives, akin to the vanishing point of Renaissance perspective, we propose minimal legitimacy criteria that make emergent asymmetries visible and contestable. Cultivating judgment, human and perhaps artificial, to perceive and contest these structures matters as much as engineering the agents themselves.

0.38

From Maps to Metabolism: Historical Precedents and a Unified Critique of Computationalism

cs.AI q-bio.NC ·2026-10-23 ·J. Mark Bishop, Slawomir J. Nasuto
similarity 0.54
Abstract

Alexander Lerchner's recent work on the 'abstraction fallacy' argues that computational functionalism confuses physical processes with abstract descriptions, and that symbolic computation alone cannot instantiate consciousness. Yet these claims were anticipated by Korzybski's map-territory distinction, Searle's critique of strong artificial intelligence, Floridi's levels of abstraction, Spencer et al.'s observer-relativity arguments, Winograd and Flores's account of computation as socially grounded practice, and Nasuto and Bishop's biological arguments. Synthesizing these contributions, this paper advances a form of non-computational physicalism: consciousness depends upon intrinsically organized, metabolically grounded physical dynamics rather than abstract computation, whilst leaving open the possibility of artificial consciousness. An objection is that this critique targets an outdated computationalism. Mechanistic computationalism, associated with Milkowski, Piccinini, Craver, Bechtel, and Kaplan, treats computation as a property of physically realized mechanisms rather than substrate-independent formalism. Although this represents an important advance, it does not dissolve the abstraction fallacy. Computational attributions remain dependent upon choices of state individuation, system boundaries, and interpretive mapping that are not determined by physical facts alone. Kaplan and Craver's 'model-to-mechanism mapping' constrains computational descriptions without eliminating their dependence upon an external observer. Grounding computation in neural mechanisms does not confer intrinsic significance or the normativity explored by Bickhard and Nasuto and Bishop. The abstraction fallacy persists wherever computational descriptions are treated as constitutive of, rather than descriptive of, physical reality.

0.24

Local information processing capacity: anatomy of computation in neuromorphic systems

cs.ET physics.app-ph ·2026-11-04 ·Jiaxuan Chen, Daiki Nishioka, Yicheng Song, Ryo Iguchi, Sota Hikasa +3 more
similarity 0.53
Abstract

Many neuromorphic systems possess rich internal computational structures shaped by their physical dynamics. However, existing metrics characterize only global computation, leaving these local structures unresolved despite their importance for system interpretation, optimization and miniaturization. Here, we introduce local information processing capacity (L-IPC), which represents individual dynamical states as vectors in an infinite-dimensional Hilbert space and decomposes their computational properties through subspace projections onto nonlinearity orders and memory steps, with the residual quantifying computational irrelevance. Applied to three systems with comparable global capacities (an echo state network, an ion-gating reservoir and a spin-wave reservoir), L-IPC reveals markedly different distributions of computation, ranging from homogeneous to spatially, temporally and spectrally structured patterns. These local profiles further guide task-specific pruning, outperforming standard approaches at the same size in the structured systems. These results establish L-IPC as a general framework for anatomizing computation and guiding task-adaptive design in neuromorphic systems.

0.14

Latent geometry organizes higher-order interactions

cs.SI physics.soc-ph ·2026-09-07 ·Berné L. Nortier, Jasper van der Kolk, Robert Jankowski, Simon Dobson, M. Ángeles Serrano +2 more
similarity 0.53
Abstract · Main: 11 pages, 4 figures. Supplemental material: 18 pages, 6 figures

Higher-order structures offer a natural representation of complex systems that involve interactions between groups of different sizes. A widespread feature of their higher-order structure is nestedness, whereby interactions involving smaller groups are contained within larger ones. Yet, why interactions of different orders organise into nested structures remains largely unexplained. Here, we introduce an analytically tractable geometric model of higher-order networks in which a single latent geometric space couples interactions across orders, leading to the spontaneous emergence of nestedness. We show analytically and numerically that nestedness undergoes a transition between a nested geometric regime, where it remains finite in the thermodynamic limit, and a regime where it vanishes with system size. In this regime, we uncover a weakly geometric range characterized by an anomalously slow finite-size decay, allowing substantial nestedness to persist in finite systems even when its asymptotic value vanishes. Finally, with a single geometric coupling parameter, the model reproduces the nestedness profiles observed in real-world hypergraphs across different domains. Our results reveal latent geometry as a simple organising principle underlying the nested organisation of higher-order interactions.

0.30

When Models Don't Manipulate Manifolds: The Geometry of a Comparison Task

cs.LG cs.AIcs.CL ·2026-09-29 ·Sai Sumedh R. Hindupur, Hadas Orgad, Thomas Fel, Demba Ba
similarity 0.52
Abstract

One of the current premises of mechanistic interpretability research is that detailed accounts of the geometry of neural network representations can tell us how models perform computations, and how to effectively intervene on them. While low dimensional manifolds have been observed for multiple concepts in the literature (e.g. numbers encoded on helices, days of the week on a circle, ...), with structure believed to reflect properties of data and tasks, the extent to which models rely on them for computation, and how they manipulate them, remains unclear. We characterize precisely the geometry of computation in a number-comparison task, as an abstraction of comparison for decision making, and how models utilize geometry in an elegant fashion to implement it. Specifically, we study the causal geometry of number comparison in Qwen2.5-7B-Instruct, a capable and widely studied open-weight model, and find Qwen largely uses linear representations of numbers despite the presence of curved geometry. To compare two numbers, the model first encodes each number along a vector and adds the two representations using attention and the residual connection, bringing them into a shared space in the residual stream. Then, the model uses MLP neurons to compare the pair of numbers on local regions in this shared space, which correspond to smaller intervals of input numbers, and combines these to obtain the position of the maximum. In fact, this reliance on linear representations for comparison also persists when the model compares three numbers. Our findings demonstrate that the manifold hypothesis can co-exist with linear representations: while concepts that are ordered may have manifold structure in representations, the model may use an underlying linear structure of the concept in certain computations.

0.26