CS Paper Radar

Clocks all the way down: does sequence-processing AI need endogenous temporal structure?

Meysam Hashemi, Alireza Valizadeh, Viktor Jirsa

cs.AI ·submitted 2026-11-03 02:16 UTC · v1

Abstract

Mainstream sequence-processing AI is temporally reactive: each update is driven by input and learned state transitions, rather than by an independently evolving internal temporal reference. Biological brains, by contrast, continuously generate rhythmic activity that structures perception, memory, and cognition, and this rhythmicity reaches all the way to behavior. We ask whether this difference is merely implementational or genuinely computational. Four lines of evidence suggest that endogenous temporal structure supports putative functions that input-driven architectures may not readily replicate: 1) phase-dependent routing of information, 2) delay-structured combinatorial representation, 3) cross-frequency multiplexing of items, and 4) oscillation-gated offline consolidation. A proof-of-concept delay-ablation test dissociates representational capacity from memory retrieval. In recurrent and spatial spiking networks with fixed synaptic weights and connectivity, shuffling delays preserves part of the capacity but substantially impairs the sequence retrieval. The relative contrast is more pronounced for spatial networks and longer propagations. Instantaneous transmission collapses capacity itself. We then outline a cross-frequency multiplexing scheme that combines item identity and serial order with alternative mechanisms for selective memory retrieval. Finally, we state one falsifiable hypothesis, conditions for matched-resource tests, and three research directions: the components already exist; the disciplined comparison does not.

Closest papers

Nearest neighbours by meaning across the whole index.

Oscillatory Phase Coding Emerges in Adaptive RNNs for Flexible Working Memory

cs.AI q-bio.NC ·2026-09-28 ·Kehan Lu, Tianhao Chu, Aiersi Tuerhong, Yiwen Sun, Huan Luo +2 more
published similarity 0.74
Abstract · 37 pages, 16 figures

Oscillatory phase coding (OPC) is widely observed in neural systems and has been implicated in cognitive functions such as memory and sequence processing. However, its computational role and neural substrates remain largely unclear. Here, we studied OPC by training recurrent neural networks (RNNs) with adaptation to perform sequence working memory tasks with variable delays. After training, we found that OPC emerges in the RNN spontaneously: the memorized items recur at distinct phases of a shared rhythm, with oscillation amplitude encoding item identity and phase encoding serial order. Ablation studies identified three key elements required for OPC: adaptation in neural dynamics, variable delay in memory retention, and flexibility in reading out information. Neuron-type analysis revealed the emergence of content and time cells in the trained RNN, and they process item identity and sequence order separately. Recurrent connectivity analysis revealed phase-organized connections among time cells and structured connections within digit-selective content-cell groups. Inspired by these findings, we proposed a neural circuit model which reproduces OPC through interactions between content units and an adaptive time ring. Together, this study reveals how OPC arises from network structures and task demands, offers insights into the implementation and computational mechanisms of OPC in biological systems, and inspires us to develop computational models for human-like cognitive functions.

0.51

From anatomy to computation: axonal delay dispersion shifts neurons from event to sequence detection

cs.NE q-bio.NC ·2026-09-03 ·Cheng Bi, Jipeng Sun
similarity 0.64
Abstract · 33 pages, 4 figures; submitted to PLOS Computational Biology

Cortical neurons fire sparsely -- often fewer than one spike per sensory window -- so a neuron's spike count in that window carries little information, and its spike timing can carry more. That conduction delays convert firing order into synchrony is long established. What governs which class of temporal feature a neuron detects -- one volley of coincident input, or two in a particular order -- has not been examined. We propose a delay-signature framework in which the axonal conduction delays converging on a dendritic branch or a small neuron's soma constitute a physical key: only input sequences whose spike-time differences the delays compensate arrive synchronously, and coincidence detection, a threshold on input summed within an inhibition-compressed window, converts that synchrony into an all-or-none output. First, in simulations of an integrator-neuron model, a single physical scalar -- the dispersion of the delay set -- moves a population from event to order-selective sequence detection. The transition is emergent under random delays and connectivity, and an exact calculation reproduces it: at narrow dispersion, sequence detectors do not exist, and the dispersion at which they overtake event detectors tracks the inter-event interval. This maps a computational distinction onto the anatomical one between myelinated and unmyelinated projections, making myelination a switch on what a neuron computes. Second, the same dispersion sets the code's limits: it bounds the longest codable interval and fixes an absolute timing tolerance of order a millisecond, the same at every dispersion. Third, that millisecond window and the conduction velocity of afferents inside cortex together set column diameter, and column anatomy predicts the window measured in mouse barrel cortex. One anatomically measurable parameter thus shapes what a neuron detects and sets the limits of what it can represent.

0.34

Oscillatory Processing Units as a computing substrate for biomimetic intelligence

cs.NE cs.ETcs.RO ·2026-11-10 ·Alexander A. Wolf
similarity 0.63
Abstract · 39 pages, 7 figures, 2 tables. Supplementary Information included. Ancillary files: Supplementary Video 1 and source data

Biological intelligence emerges from neural activity that connects sensation, memory and action. Synaptic plasticity, neuronal assemblies and oscillations provide principles for biomimetic computing, but translating them into reusable operations requires a defined computational unit. We introduce Oscillatory Processing Units (OPUs), groups of synthetic neurons sharing a rhythm. Their directed interactions transform incoming activity and prior receiving state into an Oscillatory Occupancy Space (OOS), which becomes available to subsequent computation. We show that source--receiver conditions and oscillatory organization shape these transformations, including their geometry, persistence and historical accessibility. An Atlas of measured relationships supports prospective composition with predicted response classes. Configured circuits perform logical and numerical operations, express associative recall and generate closed-loop decisions with fixed synaptic weights. OPUs and OOS establish a computing substrate for biomimetic intelligence in which experience remains part of the state through which new input becomes action.

0.28

A Time-Variant Spiking Neuron from a Unified State-Dynamics Perspective

cs.NE ·2026-10-14 ·Jing Yang, Qianhui Liu, Gang Pan, Zhanglu Yan
similarity 0.63
Abstract

Spiking neural networks (SNNs) have increasingly incorporated rich neuronal dynamics to enhance temporal processing. However, richer dynamics do not necessarily enable neurons to adapt how information is processed over time. To examine this issue systematically, we introduce a unified state-dynamics framework that characterizes diverse spiking neurons through a common formulation and enables direct comparison of their dynamical designs. The framework reveals a common limitation of existing neurons: although they enhance temporal processing through richer internal states and state evolution, the dynamical rules determining how inputs are integrated, how states evolve, and how they are read out generally remain unchanged throughout temporal processing. Such time-invariant rules limit the ability of neurons to adjust information processing as information relevance changes over time. Inspired by time-varying regulation in biological neurons, we propose the Time-Variant Multi-Compartment Neuron (TV-MCN). TV-MCN builds on multiscale compartment dynamics and makes the rules for input integration, state evolution, and state readout time-varying according to the current input. Specifically, an input-dependent internal time regulates the rate of state evolution, while the current input dynamically modulates input integration and state readout. Extensive experiments show that TV-MCN achieves strong overall performance, with particularly large gains on tasks requiring selective retention and retrieval of information, while ablation studies further support the effectiveness of its time-varying mechanisms.

0.18

From communication to computation in neurons-on-a-chip: an in silico study of neurotopomorphic computing

cs.ET q-bio.NCcs.NE ·2026-10-05 ·Michael Taynnan Barros
similarity 0.61
Abstract · Submitted to a Journal

Living neuronal networks transform inputs through recurrent cellular and population dynamics, yet it is unknown which network architecture supports which computation. Neurons-on-a-chip turn this question into a design problem because microchannels guide axonal growth and set the network architecture. We introduce IC$^3$, an Integrated Characterisation of Communication-Driven Computation, which characterizes network state through neuronal dynamics, functional communication, and structural support. We implemented nine architectures \textit{in silico} as conductance-based spiking networks and tested each on frequency decoding, temporal-order discrimination, and fading memory. Predominantly feedforward circuits decoded best. Sequential Chain and Microchannel Diode had the lowest IC$^3$ and recruited a third of reachable neurons, yet achieved the two highest scores on both classification tasks. Across architectures, higher IC$^3$ went with lower classification scores. We term this new direction \emph{neurotopomorphic computing}, in which the physical organisation of neuronal connectivity is engineered as part of the computing substrate.

0.15

A Gradient-based yet Spike-Timing-Dependent Solution to the Feedback Learning Problem in Neural Microcircuits

cs.NE cs.LGq-bio.NC ·2026-09-08 ·Xiangnan Zhang, Jingxin Liu, Ranqi Lu, Jingyu Liu, Qunxi Dong +4 more
published similarity 0.60
Abstract · Version for the initial submission to Nature Machine Intelligence, 10th Sep. 2026

The brain uses discrete spikes for dynamic computation, yet, how neural microcircuits (NMCs) solve temporal credit assignment using local spike timing remains a fundamental open question. Dominant spiking neural network (SNN) approaches circumvent this by approximating backpropagation through surrogate gradients, decoupling learning from biological spike timing. Here, we reformulate temporal credit assignment as a state separation problem: extracting task-required components induced by historical perturbations directly from the current neural state. This enables an online feedback learning framework for NMCs through a gradient tunneling (GT) algorithm and the lead-lag expansion technique that derives credit assignment from local synaptic spike timing, while remaining compatible with ANN-SNN hybrid architectures. Experimentally, GT-trained NMCs excel at long-timescale evidence integration and noise-robust memory retention, and perform comparably to leading SNN online learning methods on real-world benchmarks with far fewer parameters. The proposed framework addresses the two-decade-old NMC feedback learning problem and suggests a computationally plausible explanation for the brain's learning mechanisms.

0.24

Controlling the latency in temporal coded spiking models for neuromorphic datasets

cs.NE ·2026-10-14 ·Alban Gattepaille, Alexandre Muzy
theory similarity 0.60
Abstract

Spiking neural networks (SNNs) promise energy-efficient, event-driven computation on neuromorphic hardware, where response time, or latency, matters as much as energy for real-time applications. Time-to-first-spike (TTFS) coding with learnable synaptic delays is a natural way to exploit the timing of events. However, in state-of-the-art spiking neuron models, spike times emerge from nonlinear membrane dynamics and thresholds: no closed-form expression links network parameters to spike times, so latency can only be measured empirically, not specified or guaranteed at design time. Moreover, TTFS models are mostly evaluated on static datasets, which hides their latency on truly temporal data. Our hypothesis is that, if spike times are computed directly as closed-form functions of presynaptic spike times and synaptic delays, bypassing membrane potential and thresholding, latency becomes an explicit function of the learnable parameters that can be bounded, and therefore controlled, analytically. We build on this hypothesis with the Delay Neural Network (DeNN) in real time, which turns event streams into successive single-spike images, computes each spike time from standardised inter-spike intervals and synaptic delays, and links successive images through a long-term memory. We prove lower and upper bounds on the latency of every neuron of a layer, and show that bounding the synaptic parameters after training with a single hyperparameter places the latency anywhere between these bounds, without retraining. On a ten-class subset of the Google Speech Commands dataset, this post-training control exposes the accuracy--latency trade-off: a three-hidden-layer network reaches 94.25\% accuracy while deciding, on average, 477~ms after the end of the one-second input, and about 250~ms with confidence-based early decisions. Learning is also shown to concentrate the long-term memory on a few neurons. Latency thus becomes a design parameter of spiking models rather than a quantity measured after the fact, a step towards neuromorphic systems with real-time guarantees.

0.16

HippocamPEX: A Hippocampus-Inspired In-Silico Architecture for Context-Aware Sequence Prediction

cs.AR ·2026-10-30 ·Md Abdullah al Kaiser, Keiland W. Cooper, Rouhan Noor, Ankur Singh, Zhishun Yang +7 more
similarity 0.60
Abstract · 6 figures

The brain's hippocampus enables episodic memory - the ability to encode events within their context, organize them into sequences, and generate predictive representations to guide adaptive behavior. Modern computing architectures, however, are optimized for large-scale arithmetic and struggle with such context-dependent sequential prediction or "cognitive" tasks. To translate these capabilities into a mixed-signal architecture, we first derived a working model from the neuroscience literature distilling key hippocampal computations into engineering-friendly abstractions. We then leveraged converging advances in in-memory computing, neuromorphic computing, asynchronous circuits, and analog computing to design a mixed-signal hardware architecture implementing these computations, called HippocamPEX. Finally, we demonstrated that HippocamPEX reproduces characteristic representational dynamics of hippocampal subregions and performs robust context-specific sequence prediction through detailed activity and circuit simulations. By tightly coupling hardware design with neuroscience knowledge, this work establishes a pathway for artificial systems capable of rapid, adaptive, and context-aware decision-making, addressing a central gap between biological and conventional computing.

0.21