CS Paper Radar

Structure is in the zoom: probing neural symmetry through dimensionality scaling

Adil Amin

cs.CL q-bio.NCcond-mat.dis-nncs.LG ·submitted 2026-09-16 03:08 UTC · v2
top venuebenchmarkcode/dataunusual

Abstract

Scaling exponents of neural dimensionality are read as properties of the code, and used to compare representations and benchmark models against cortex. Yet one recording of 11,311 mouse V1 neurons gives 0.25, 0.30 or 0.35, depending only on how it is subsampled. We show that such an exponent measures the population and the probe together. We split it exactly into a floor, which random subsets of the same sizes give, and a shift, which a declared axis of stimulus classes adds. The usual random-subsample exponent is almost all floor. Stimulus direction lifts the exponent in every grating recording by reading both symmetry sectors of the code: orientation, which repeats every half turn, and direction, which does not. The lift lives in trial-to-trial fluctuations that differ between directions, while the class means, which linear decoders read, pull it down. Two measured terms, how much the classes' fluctuations overlap and how the means sit against them, account for the shift. They give its sign where it changes: in Allen Neuropixels recordings, whose class means mostly raise the exponent, and in macaque V1. In an XY lattice whose classes stay on one orbit, temperature flips the sign as the two terms say, and in GPT-2 the shift ranks the indirect-object circuit's name-mover and backup heads. Reported with its path, its floor and its shift, an exponent says how much structure a probe finds and what carries it. Our open tool, rung, reports all three for any labelled neural recording or language-model layer: https://github.com/adilamin89/structure-in-the-zoom

Comment
Accepted at NeurReps 2026 (Symmetry and Geometry in Neural Representations), Proceedings of Machine Learning Research. 48 pages. Code, data and the rung tool: https://github.com/adilamin89/structure-in-the-zoom. Five-minute talk: https://youtu.be/S4kUtP37KLM

Closest papers

Nearest neighbours by meaning across the whole index.

Reading a neuron's tuning from its correlations with other neurons

cs.LG q-bio.NCcs.NE ·2026-09-19 ·Francesco Lässig
code/data similarity 0.62
Abstract · Code: https://github.com/entropicbloom/intentionality. Reassignment to q-bio.NC as primary welcome

What a neuron represents is usually established by relating its activity to a stimulus. We ask whether the same facts are contained in the correlation matrix of a recorded population, which keeps the pairwise relations among the neurons and discards the stimulus. A transformer that sees only the correlation matrix of 512 sampled neurons, with no labels and no reference population in its input, decodes the preferred orientation of mouse visual cortex neurons from in-vivo MICrONS responses to a mean error of 25° (uninformed: 45°; best constant guess: 41°) and their receptive-field position at R^2 = 0.23; on the digital-twin substrate, 20° and 0.48. Asked whether a neuron prefers horizontal or vertical, it is right for 79% of neurons in vivo and 87% on the twin, against 56% for the majority answer; it does not resolve the obliques. The ordering is recoverable because the relations between orientation classes are close to circulant, which fixes the class structure up to rotation and reflection; the rotation of the frame is recoverable only because of a departure from that symmetry. The departure survives equal representation of every orientation and disjoint training and test stimuli, and it is an anisotropy of the signal correlations: in V1 the neurons preferring the dominant orientation have the most similar responses to one another, and a model population with only that property recovers the frame. Across 33 mice of the Allen Brain Observatory, with relations from drifting gratings, orientation transfers to unseen animals only when a sampled population mixes animals; populations drawn from one animal are not decoded measurably below the best constant, a limit of the diversity of populations one animal provides. For receptive fields, what crosses animals is where each animal's imaged patch looks on the screen, not the layout of neurons within it.

0.43

The Computational Value of Sensory-Aligned Receptive Fields Depends on Neuronal Expressivity

cs.NE cs.LGq-bio.NC ·2026-09-22 ·Agnese Adorante, Aaron Spieler, Anna Levina
similarity 0.54
Abstract

Biological sensory neurons have selective receptive fields organized along meaningful stimulus coordinates, such as frequency, motion direction, or retinotopic position. Such structure may arise from efficient coding and biological constraints on activity, connectivity, and wiring, as computational studies of simple neurons have shown across modalities. This raises a question: do structured receptive fields confer a computational advantage beyond resource efficiency itself, and does this advantage persist when individual neurons are highly expressive? We address this question in recurrent networks of Expressive Leaky Memory neurons, where we can independently vary neuronal complexity and the organization of feed-forward receptive fields. Across auditory and event-based visual classification tasks, receptive fields aligned with a task-relevant sensory coordinate improve test accuracy relative to budget-matched random receptive fields. This advantage disappears when sensory coordinates are scrambled, or when receptive fields follow task-irrelevant coordinates, showing that the benefit comes from alignment with task geometry rather than restricted connectivity alone. Increasing neuronal complexity reduces the performance advantage of structured receptive fields. Finally, generic synaptic sparsity regularization induces input selectivity and partially recovers performance, but remains substantially below explicitly structured receptive fields, suggesting that sparsity alone is insufficient to recover the full computational benefit of task-aligned receptive fields. Together, our results show that appropriate receptive fields can serve as a computational prior beyond sparsity itself, and that their value depends on the computational expressivity of individual neurons.

0.23

How Long Is the Coast of a Neuron? Resolution-Dependent Interaction Order and Computational Capacity

cs.NE q-bio.NCcond-mat.dis-nncond-mat.stat-mech+1 ·2026-10-14 ·Nima Dehghani
unusual similarity 0.54
Abstract

Mandlebrot's coastline paradox reframes measurement as a joint property of an object and its ruler. Here we ask how observational resolution shapes the apparent structure of neural computation. We introduce a scale-indexed decomposition that separates the predictive information captured by direct dependencies from the residual outside that model family. Exact constructions show that projection can convert higher-order dependence into pairwise structure. Projection can increase the direct fraction of surviving information even as total predictive information decreases. A schematic branch-to-soma cascade grounds these effects in local coincidence detection, saturating integration and somatic mixing. Resolving organized nonlinear subunits improves approximation and raises effective representational rank. In a nested hierarchy, these gains occur without increasing information about the target. This distinction separates information availability from access by a restricted readout. A point-neuron or direct population model therefore establishes an effective description at a specified scale. It does not uniquely identify the finer computation that generated the observed relation. Which resolution is adequate depends on the observable and perturbation of interest.

0.42

Calibrated concept profiles: making the reading of a model's neurons a measurement

cs.CL cs.LG ·2026-11-06 ·Piotr Wilam
code/dataunusual similarity 0.54
Abstract · 25 pages, 5 figures, 11 tables. Dataset: AtlasOpenCoder, tag v1, doi:10.57967/hf/11472. Code: https://github.com/piotrwilam/AtlasCalibratedC…

Interpretability has largely moved from reading a model's neurons directly to reading a second model trained on the first: a probe, a sparse autoencoder, a crosscoder. The move answered real faults -- mixed meanings, thresholds without a unit, readings that did not transfer from one study to the next -- but gave up what a direct reading alone provides: nothing trained in between, the neurons themselves named, and a reading that can be repeated and compared. Here the direct reading is made a measurement. A neuron's activation varies with the prompt, so its reading is a distribution over a population of stimuli. We declare that population: every factor around a target construct is drawn at its rate in a reference corpus and logged. From the declared distribution we generate a battery of prompts, and draw it twice. From the battery we compute the calibrated concept profile, one number per neuron, stated in units of the neuron's own spread on ordinary input; the two draws give every number a noise unit. Before the profile is read, a fixed set of checks licenses the battery on the model, and the smallest change the profile can resolve across training checkpoints is measured. Realised for Python on OpenCoder-1.5B and followed across checkpoints spanning two trillion training tokens, the profile gives what the alternatives do not report: a unit on every number, a chance level for every comparison, and which neurons carry a construct at every checkpoint. The battery, the code and the data behind every result are released.

0.68

How Finite Brains Generalize Without Bound: Spatial Memory as a Universal Computer

cs.AI ·2026-11-05 ·Yuhang He, Si Wu
benchmarkunusual similarity 0.53
Abstract · 57 pages, including appendices

A child who learns to add small numbers adds numbers of any length. LSTMs and Transformers trained on short sequences fail on longer ones. We trace the difference to what a learner reads when it decides. A position, a count or a time keeps taking new values as the input grows: it is a coordinate, and a learner that reads one meets in every long input values its experience never covered. Whether two things are the same has the same two answers at every size: it is a coincidence, and a learner that reads only coincidences finds in a long input nothing that short inputs lacked, so finite experience fixes its rule for every size. The memory carries the size of the input and the rule stays finite, and this determines the memory a generalizing brain can have: a memory that grows while what the learner reads of it stays finite has to look the same from every place, so it is made of cycles, and the past is reached by asking what happened when the cycles last stood where they stand now. The cycles are the grid modules, the cells that detect their return the place cells, the records the hippocampal index; a prefrontal controller moves the cycles and never sees them. Reading only coincidences costs no power: what finite experience fixes in such a learner is what Turing machines compute in step with their input, which is why a circuit that evolved to find the way home can learn arithmetic and grammar. In a network of neurons this machine of cycles is the dynamics seen through its symmetry, and symbols are its invariants. Trained on strings up to 40 symbols, the machine is at least 99% correct, on average over lengths 41 to 500, on nine of fifteen benchmark tasks, five of them tasks that no LSTM or Transformer solves; given new cycles after training it reverses strings of 15,015 symbols without error and fails beyond that on the curve the theory predicts; and its controllers run unchanged on neurons.

0.34

The Role of Grid Cells in Reducing Spatial Aliasing in Hippocampal Place Representations

cs.NE cs.AIcs.ROeess.SY+1 ·2026-08-19 ·Alexander Johnson, Obadah Ghizawi, Ali A. Minai
published similarity 0.53
Abstract · IEEE World Congress on Computational Intelligence, Masstricht, Netherlands, June 2026

Spatial aliasing occurs when two or more distinct locations produce highly similar place-cell representations, primarily due to environmental symmetry or repetitive structures. This issue is most pronounced when place representations are constructed solely from boundary vector cell (BVC) inputs, because symmetric or repetitive structures can yield indistinguishable sensory patterns across multiple locations in an environment. This work introduces grid cell signals to mitigate spatial aliasing in such settings. Because grid cells contribute periodic, internally generated spatial signals that vary independently of environmental geometry, they play a key role in disambiguating perceptually identical locations. We integrate multiple modules of analytically constructed grid cells with BVC-driven place cells and show that this leads to a 94--99% reduction in spatial aliasing relative to a BVC-only baseline across three environments: an open environment without obstacles; an environment with a cross-shaped central obstacle creating high visual symmetry; and a maze environment. The greatest improvement occurs in the environment with the highest visual symmetry. These results indicate that grid cells provide information complementary to boundary-based inputs, yielding more reliable place representations in geometrically ambiguous environments.

0.57

Coarse-Graining Hidden Representations: Unsupervised Neuron Selection via Mapping Entropy

cs.LG cond-mat.dis-nncond-mat.stat-mech ·2026-09-04 ·Margherita Mele, Andrea Castagna, Roberto Menichetti, Raffaello Potestio, Alessandro Ingrosso
similarity 0.53
Abstract

Overparameterized neural networks carry far more hidden units than a task nominally requires, raising the question of which neurons are essential and whether that distinction is legible in the representation itself, without labels or gradients. We cast neuron selection as the problem of coarse-graining the hidden layer by retaining a subset of its neurons, and score each putative selection by the mapping entropy (ME). This quantity measures the loss of discriminatory power inherent in discarding part of the network neurons, and the selection that minimises the ME is taken as particularly informative. This criterion is fully unsupervised, in that it depends only on hidden-activation statistics. In teacher-student networks, ME optimisation recovers the minimal teacher-consistent representation and retains extra units in proportion to the hidden layer's residual variability; in a non-linear Gaussian process task, it selects coherent functional-class mappings whose preferred class shifts across training. On this task and on translation-augmented MNIST, ME-selected subnetworks outperform random subsets of equal size, most clearly under strong compression - linking configurational distinguishability to predictive performance.

0.35

Capturing Membrane Dynamics and Spike Timing of Human Neurons at Scale using Neural Operators

cs.LG q-bio.NC ·2026-09-28 ·Luca Ghafourpour, Cindy Zhao, Valentin Duruisseaux, Bahareh Tolooshams, Philip H. Wong +2 more
similarity 0.53
Abstract

Characterizing the properties of neuronal cell types is central to understanding brain function. Yet, biophysically realistic neuron models remain difficult to scale to large populations while preserving the richness of cellular dynamics and within-cell-type variability. We present a cell-type-specific neural-operator framework for scalable neuronal population modeling. Rather than training separate surrogate models for individual neurons, the proposed framework learns a shared operator across multiple modeled neurons from the same cell type, conditioned on biologically interpretable electrophysiological features. Relative to the original single-neuron \texttt{NOBLE} setting, learning across heterogeneous neurons requires a richer electrophysiological conditioning representation and a training objective designed to preserve diverse spiking dynamics. This enables efficient generation of large ensembles of somatic voltage responses while preserving variability across cells and model configurations. We evaluate the approach using membrane dynamics metrics, action potential waveform metrics, spike timing accuracy, input-output firing relationships, and electrophysiological feature distributions. Our framework reproduces subthreshold membrane dynamics, spike waveforms, and firing-rate responses across major cortical inhibitory neuron types, while accurately preserving spike timing despite the sensitivity of threshold-crossing dynamics. The predicted electrophysiological feature distributions show strong agreement with detailed simulator outputs and human experimental recordings, including high explained variability in properties such as inter-spike intervals, firing frequency, action-potential shape, and post-spike recovery.

0.22