CS Paper Radar

Basin Geometry and Reliable Recall of Dynamical Memories in Reservoir Computing

Ling-Wei Kong, Ying-Cheng Lai

cs.LG nlin.CD ·submitted 2026-09-01 22:32 UTC · v1

Abstract

Reliable attractor recall conventionally requires broad basins of attraction. However, in reservoir-computing based associative memory, temporal cues reliably recover dynamical memories despite basins dominated by unpredictable, riddled-like regions. We reveal that memory basins exhibit an ``octopus-like'' structure: a robust ``head'' near the attractor and thin, intertwined ``tentacles'' spanning state space. Initial states in tentacular regions yield near-zero uncertainty exponents, making the recalled memory effectively unpredictable at finite precision. Yet, cue-driven generalized synchronization bypasses this unpredictability, driving the system into the robust basin head. This mechanism yields a quantitative relation linking minimum cue duration, synchronization rate, and basin-head radius. Trained recurrent neural networks exhibit similar geometry, suggesting this phenomenon extends beyond reservoir computing.

Closest papers

Nearest neighbours by meaning across the whole index.

Impact of Negative Weights on Performance in Reservoir Computing

cs.LG physics.soc-ph ·2026-11-04 ·Yeonsu Jeong, Seonho Nam, Dahan Choi, Mi Jin Lee, Seung-Woo Son
benchmark similarity 0.62
Abstract

Reservoir computing provides an efficient framework for time-series prediction because only the readout layer is trained while the recurrent reservoir remains fixed. In this study, we examine how the negative sign ratio of a signed Erdos-Renyi reservoir affects the internal dynamics and forecasting performance of an echo state network on the Mackey-Glass benchmark. To characterize the reservoir responses, we use two Shannon-entropy-based observables, namely node-state entropy and node-frequency entropy, as empirical proxies for the diversity of reservoir states and temporal activation patterns. We find that intermediate negative sign ratios are associated with richer internal dynamics and substantially lower prediction error than the sign-homogeneous extremes for the task considered here. These results suggest that link-sign composition can be a useful structural parameter in reservoir design for chaotic forecasting. The present findings should be interpreted within the scope of the current benchmark and reservoir setting, and broader validation will be required to establish their generality across other tasks, topologies, and controlled spectral conditions.

0.21

Asymmetric Coupling Anisotropy for Causal Information Filtering in Physical Reservoirs

cs.NE nlin.AOphysics.class-ph ·2026-08-27 ·Takashi Hikihara, Yuma Aoki
similarity 0.61
Abstract · 14 pages, 9 figures

We demonstrate a physical mechanism for causal information filtering in a physical reservoir computing (PRC) by exploiting asymmetric coupling anisotropy. Using a network of coupled Duffing oscillators, we show that the directionality of internal coupling induces a spatial gradient in the effective potential, establishing a deterministic upstream-to-downstream information flow. This anisotropy allows for the selective amplification of semantic drifts, triggering a macroscopic saddle-node bifurcation as a physical interlock before global computational failure. Through spatiotemporal analysis of a 50-node system under traveling wave inputs, we confirm that local phase transitions effectively purge anomalous information while preserving the computational integrity of the remaining nodes. The results suggest that the intrinsic causality of the reservoir's topology provides a robust framework for autonomous reliability and fault-tolerant physical intelligence.

0.28

Beyond density snapshots: Dynamical memory in Chern-Simons reservoirs

cs.ET cs.AIcs.LGcs.NE ·2026-09-10 ·Jyotiranjan Beuria, Venkatesh H. Chembrolu
similarity 0.61
Abstract · 6 figures, 3 tables

How a reservoir encodes input history jointly in density and geometric degrees of freedom remains insufficiently understood. We address this mechanistic gap with a continuous density on an internal manifold coupled to an independently evolving Chern-Simons (CS) connection through a conserved current. On the same internal manifold, we compare reciprocal transport, instantaneous transverse reconstruction, local nonlinear feedback, and coupled CS evolution. These controls isolate how transport and independent connection evolution contribute to memory. We identify a current-generated exact connection component that the tested instantaneous reconstruction and scalar local closure miss. Resetting this component at fixed density and Gauss-law curl changes the future density response within the chosen gauge and drift law and the small effect persists under numerical refinement. We then distinguish dynamical memory from its readout accessibility. Although the four models have similar scalar-memory scores and density traces of pulse order, their circulating and longitudinal traces differ. With all measured features, coupled CS improves pulse-order decoding by \(6.5\pm1.9\) percentage points over the instantaneous-transverse control in paired seedwise comparisons, while remaining comparable to local feedback. Coupled CS shows less lag than the instantaneous and local-feedback controls on the first cycle, but more on subsequent cycles, revealing a dependence on preparation. We thus connect a field-theoretic mechanism of history retention to controlled tests of its dynamical role and computational use. The four-model framework provides a way to determine what an evolving transport field contributes when density snapshots and aggregate performance alone leave the memory mechanism unresolved.

0.23

Extrapolating learned dynamics across bifurcations based on generalized synchronization

cs.LG nlin.CDmath.DS ·2026-10-25 ·Lingfeng Chen, Masanobu Inubushi
similarity 0.60
Abstract

Predicting dynamics across bifurcations by extrapolating trained models is crucial in diverse fields of physics. Generalized synchronization provides a framework for understanding dynamical reconstruction by neural networks, especially in the context of reservoir computing. Building on this framework, we derive a formula combining pretrained readouts to reconstruct unseen chaotic dynamics. Using classical Lagrange interpolation theory, we derive rigorous bounds on readout errors and conjugacy residuals. Numerical examples demonstrate accurate prediction of chaotic dynamics across bifurcations.

0.20

Analyzing the Dynamics of WSBM-based Echo State Networks using InputDSA

cs.AI ·2026-10-11 ·Huy Mai, Robert Clarke
similarity 0.59
Abstract · 9 pages excluding refs and appendices, 9 figures

Bridging the structural gap between biological brains and artificial neural networks presents a pathway to altered computational dynamics. This paper introduces a Reservoir Computing framework that replaces random networks with biologically realistic modularity by applying the Weighted Stochastic Block Model (WSBM) to Echo State Networks (ESNs). This topological parameterization constructs reservoirs reflecting latent functional sub-circuits. Furthermore, the integration of Input Dynamical Similarity Analysis (InputDSA) provides a mechanism to isolate and compare how structural priors modulate intrinsic recurrent dynamics versus external inputs. By evaluating these architectures, we establish that structural diversity does not necessarily predicts behavioral diversity across the selected network subset. Furthermore, our demixed analysis confirms Anna Karenina principle of dynamics, demonstrating that environmental constraints enforce dynamical convergence in successful agents, while failing networks degenerate into idiosyncratic trajectories.

0.26

Does Learning Recurrent Networks Matter in Partially Observable RL?

cs.LG cs.AI ·2026-10-09 ·Zekang Wang, Zhe He, Gaojie Jin
code/data similarity 0.59
Abstract

Reinforcement learning (RL) under partial observability typically re- lies on recurrent networks to encode temporal information, with the recurrent module trained jointly with the policy or value function. This raises a natural question: is learning the recurrent network actually necessary? In this paper, we investigate whether a frozen recurrent network can provide sufficient memory for solving par- tially observable Markov decision processes (POMDPs). Motivated by the theoretical foundations of Reservoir Computing (RC) and Generalized Reservoir Computing (GRC), we study a simple archi- tecture that combines a fixed recurrent network with a trainable nonlinear output module. We evaluate this approach across tasks with varying memory demands, observation modalities, and action spaces. Surprisingly, frozen recurrent networks support recall over hundreds of steps and achieve competitive control performance across diverse POMDPs, while using less than half the number of trainable parameters required by their fully trainable counterparts. These results suggest that learning the recurrent memory module is not always necessary for solving POMDPs. Frozen recurrent networks therefore provide a simple, parameter-efficient, and sur- prisingly strong baseline for partially observable RL. Our source code is available at https://github.com/Aphlios/FRN-POMDP

0.35

Sector-Ring Linear Reservoirs: Sector-Wise Decay-Timescale Allocation With State Reuse Across Candidate Settings

cs.LG cs.NE ·2026-10-19 ·Yudai Ebato, Sou Nobukawa, Yusuke Sakemi, Takashi Kanamaru, Nina Sviridova +1 more
similarity 0.59
Abstract · 19 pages, 9 figures, 6 tables. Submitted to IEEE Access

In reservoir computing, performance depends on whether the fixed dynamics of the reservoir suit the task, and the appropriate memory length and frequency response differ across tasks. The reservoir settings are found by a search on each task, and driving the reservoir with the input and collecting its states for every candidate setting dominates the cost of the search. In a reservoir with a linear recurrence, the dynamics decompose into modes, one per eigenvalue, and the eigenvalue distribution becomes a design variable. We propose the Sector-Ring Linear Reservoir (SRLR), in which the eigenvalue angles are fixed at evenly spaced positions around a circle and one decay timescale, chosen from a few values, is assigned to each sector of consecutive angles. To keep the scale of each mode's state equal across candidates, the input weights are scaled using the power spectrum of the training input. To reduce the cost of the search, the states of the modes for each decay-timescale value are computed once and reused across candidates. On prediction and reconstruction benchmarks built from chaotic systems, the SRLR achieved, in all eight cases, a lower mean test error than a reference model in which all modes share one decay timescale, and was competitive with nonlinear echo state network and leaky-integrator echo state network baselines. The selected decay-timescale profiles changed with the prediction target and horizon. The state reuse reduced the number of computed mode trajectories in the search by 99.8% relative to per-candidate recomputation.

0.28

Oscillatory Processing Units as a computing substrate for biomimetic intelligence

cs.NE cs.ETcs.RO ·2026-11-10 ·Alexander A. Wolf
similarity 0.59
Abstract · 39 pages, 7 figures, 2 tables. Supplementary Information included. Ancillary files: Supplementary Video 1 and source data

Biological intelligence emerges from neural activity that connects sensation, memory and action. Synaptic plasticity, neuronal assemblies and oscillations provide principles for biomimetic computing, but translating them into reusable operations requires a defined computational unit. We introduce Oscillatory Processing Units (OPUs), groups of synthetic neurons sharing a rhythm. Their directed interactions transform incoming activity and prior receiving state into an Oscillatory Occupancy Space (OOS), which becomes available to subsequent computation. We show that source--receiver conditions and oscillatory organization shape these transformations, including their geometry, persistence and historical accessibility. An Atlas of measured relationships supports prospective composition with predicted response classes. Configured circuits perform logical and numerical operations, express associative recall and generate closed-loop decisions with fixed synaptic weights. OPUs and OOS establish a computing substrate for biomimetic intelligence in which experience remains part of the state through which new input becomes action.

0.23