CS Paper Radar

Beyond density snapshots: Dynamical memory in Chern-Simons reservoirs

Jyotiranjan Beuria, Venkatesh H. Chembrolu

cs.ET cs.AIcs.LGcs.NE ·submitted 2026-09-10 17:45 UTC · v2

Abstract

How a reservoir encodes input history jointly in density and geometric degrees of freedom remains insufficiently understood. We address this mechanistic gap with a continuous density on an internal manifold coupled to an independently evolving Chern-Simons (CS) connection through a conserved current. On the same internal manifold, we compare reciprocal transport, instantaneous transverse reconstruction, local nonlinear feedback, and coupled CS evolution. These controls isolate how transport and independent connection evolution contribute to memory. We identify a current-generated exact connection component that the tested instantaneous reconstruction and scalar local closure miss. Resetting this component at fixed density and Gauss-law curl changes the future density response within the chosen gauge and drift law and the small effect persists under numerical refinement. We then distinguish dynamical memory from its readout accessibility. Although the four models have similar scalar-memory scores and density traces of pulse order, their circulating and longitudinal traces differ. With all measured features, coupled CS improves pulse-order decoding by \(6.5\pm1.9\) percentage points over the instantaneous-transverse control in paired seedwise comparisons, while remaining comparable to local feedback. Coupled CS shows less lag than the instantaneous and local-feedback controls on the first cycle, but more on subsequent cycles, revealing a dependence on preparation. We thus connect a field-theoretic mechanism of history retention to controlled tests of its dynamical role and computational use. The four-model framework provides a way to determine what an evolving transport field contributes when density snapshots and aggregate performance alone leave the memory mechanism unresolved.

Comment
6 figures, 3 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Basin Geometry and Reliable Recall of Dynamical Memories in Reservoir Computing

cs.LG nlin.CD ·2026-09-01 ·Ling-Wei Kong, Ying-Cheng Lai
similarity 0.61
Abstract

Reliable attractor recall conventionally requires broad basins of attraction. However, in reservoir-computing based associative memory, temporal cues reliably recover dynamical memories despite basins dominated by unpredictable, riddled-like regions. We reveal that memory basins exhibit an ``octopus-like'' structure: a robust ``head'' near the attractor and thin, intertwined ``tentacles'' spanning state space. Initial states in tentacular regions yield near-zero uncertainty exponents, making the recalled memory effectively unpredictable at finite precision. Yet, cue-driven generalized synchronization bypasses this unpredictability, driving the system into the robust basin head. This mechanism yields a quantitative relation linking minimum cue duration, synchronization rate, and basin-head radius. Trained recurrent neural networks exhibit similar geometry, suggesting this phenomenon extends beyond reservoir computing.

0.34

Memory flows: geometry and dynamics of sequential retrieval in input-driven Hopfield networks

cs.AI cond-mat.dis-nnmath.DSq-bio.NC ·2026-11-03 ·Simone Betteti, Matteo Martin, Morten Gram Pedersen, Sandro Zampieri, Giacomo Baggio
similarity 0.52
Abstract

Associative memory models classically describe retrieval as convergence to stored patterns, but the theory of sequential retrieval remains comparatively limited. We develop a two-timescale input-driven Hopfield network in which fast associative retrieval is modulated by a slow feedback variable evolving over a prescribed memory-transition graph. This yields autonomous, graph-constrained transitions while preserving analytical tractability. Using slow-fast and geometric singular perturbation theory, we characterize memory fixation via memory manifolds and identify the geometric regions that govern stability loss and escape from retrieved memories. We further derive reduced slow dynamics and explicit criteria for transition onset, self-sustained retrieval, and collapse, expressed through escape times, gain thresholds, and fixed points. Together, these results provide a tractable framework for analyzing feedback-driven sequential retrieval in Hopfield networks.

0.22

Frozen in Time: How a Physics Foundation Model Forgets Under Sim-to-Real Adaptation

cs.LG physics.flu-dyn ·2026-10-29 ·Haaris Mian, Miles Cranmer, Alessandro Favero, Payel Mukhopadhyay
publishedcode/data similarity 0.52
Abstract · Accepted at the Sim2Science workshop, NeurIPS 2026. Code: https://github.com/haarisamian/walrus-forgetting-paper

Scientific foundation models (SciFMs) have achieved remarkable performance on a wide range of PDEs, including the ability to efficiently adapt to unseen data distributions with additional finetuning. As with all neural architectures, finetuning such models comes with the risk of catastrophic forgetting, whereby adapting to new tasks degrades prior knowledge of the model. We study catastrophic forgetting in Walrus-1.3B, a SciFM for continuum dynamics, over the course of a two-stage sim-to-real adaptation: first finetuning on simulated flow around a cylinder and then adapting to experimental data of the same system. We find that finetuning on the simulations rapidly degrades rollout performance on the original pretraining datasets, with one-step errors increasing up to 35x after just 20 epochs. Subsequent adaptation to real data further erodes performance on the simulated task. We characterize the potential drivers of forgetting, such as dataset dependence and task representation similarity. We then show that replaying as little as 1% simulated data during real-data finetuning recovers most of the lost simulation performance while retaining effective adaptation to the experimental dynamics. Our results identify catastrophic forgetting as a practical obstacle to sim-to-real adaptation of SciFMs and show that lightweight replay strategies significantly improve retention.

0.34

Asymmetric Coupling Anisotropy for Causal Information Filtering in Physical Reservoirs

cs.NE nlin.AOphysics.class-ph ·2026-08-27 ·Takashi Hikihara, Yuma Aoki
similarity 0.51
Abstract · 14 pages, 9 figures

We demonstrate a physical mechanism for causal information filtering in a physical reservoir computing (PRC) by exploiting asymmetric coupling anisotropy. Using a network of coupled Duffing oscillators, we show that the directionality of internal coupling induces a spatial gradient in the effective potential, establishing a deterministic upstream-to-downstream information flow. This anisotropy allows for the selective amplification of semantic drifts, triggering a macroscopic saddle-node bifurcation as a physical interlock before global computational failure. Through spatiotemporal analysis of a 50-node system under traveling wave inputs, we confirm that local phase transitions effectively purge anomalous information while preserving the computational integrity of the remaining nodes. The results suggest that the intrinsic causality of the reservoir's topology provides a robust framework for autonomous reliability and fault-tolerant physical intelligence.

0.28

Perturbational Validity for Foundation Models of Brain Dynamics: A Controlled Proof-of-Principle Simulation

eess.SY q-bio.QM ·2026-09-11 ·José C. Garcí Alanis, Sarah Alizadeh, Marco Rothermel, Bita Shariatpanahi, Mina Kheirkhah +3 more
similarity 0.50
Abstract

Foundation models for human brain recordings are usually evaluated by signal reconstruction, future-state prediction, and transfer to downstream tasks. However, these benchmarks do not establish whether a transferred model remains valid when the system is actively perturbed. We define perturbational validity as the preservation, after limited system-specific adaptation, of the conditional distribution of future trajectories given the current state and a controlled input, and we evaluate it at three levels: time-series accuracy, dynamical-structure similarity, and responses to perturbations excluded from calibration. We demonstrate the framework in an oracle-drift simulation of stochastic bistable systems. Two otherwise identical multilayer perceptrons were trained on drift evaluations from passive or input-driven trajectories. Next, for each held-out system the shared weights were frozen and only a three-dimensional embedding was adapted, with a correctly specified cubic model fitted from scratch as comparator. With two to five system-specific evaluations, perturbational pretraining yielded lower errors in recovering controlled flow, landscape geometry, finite-run occupancy, response distributions, and dose-transition curves. The advantage was reproduced across five independent runs, persisted under full-network adaptation of the passive model, and was attributable to input excitation rather than transition-state coverage: excitation alone lowered controlled-flow error 1.94-fold relative to coverage alone, in five of five runs. The cubic model became competitive as calibration grew, showing that the benefit is specific to few-shot transfer. This controlled demonstration does not test recovery of dynamics from noisy or partially observed brain recordings. It shows why passive prediction should be complemented by prospective evaluation under controlled inputs.

0.25

Where to Compute and How to Interact: Operator-Readable Adaptation with Gauge-Aware Transport

cs.LG ·2026-09-14 ·Zixuan Shen, Quanxu Wan, Bingchuan Wang, Zhi Wang, Biao Luo
similarity 0.50
Abstract

Adaptive meshes enable neural operators for partial differential equations (PDEs) to allocate spatial samples and computation according to local physical structures. Existing approaches, however, mainly address where to compute, with less attention to how information should interact after node relocation. Mesh adaptation changes local sampling scales, neighborhood structures, and geometric contexts, so representations formed at different nodes may not be directly comparable. Direct aggregation can therefore entangle physical variation with discretization-induced representation variation. Because allocation and interaction are jointly optimized through the same output objective, their individual roles are also difficult to distinguish from final errors alone. We introduce operator readability, requiring an adaptive operator to account for and test why computation is allocated to particular locations and how representations interact under the resulting nonuniform discretization. Based on this principle, we propose the Gauge-Aware Adaptive Mesh Neural Operator (GA-AMNO). Physics-informed adaptive allocation answers where to compute, while geometry-conditioned low-rank Gauge transport maps source features into target representation contexts before aggregation, answering how to interact. This makes mesh-to-solver information exchange inspectable and intervenable. We establish sufficient conditions for representation-consistent aggregation and analyze approximate transport errors and continuity under topology-preserving mesh deformations. Experiments on five PDE benchmarks demonstrate improved predictive accuracy, while controlled interventions and geometric-mismatch analyses verify the roles of allocation and interaction and show that Gauge transport improves cross-discretization representation compatibility under strong geometric mismatch.

0.25

Beyond Gradient Flow: Identifiability and Recovery from Distribution Snapshots

cs.LG ·2026-09-28 ·Nam D. Nguyen, Valeriya Malysheva
benchmarkhot direction similarity 0.50
Abstract

Inferring dynamics from snapshots of evolving distributions is fundamentally underdetermined: the Fokker-Planck equation constrains the drift $F$ only through its score-weighted divergence $\nabla\cdot F+F\cdot\nabla\logρ$, leaving a $ρ$-solenoidal gauge invisible to any single-time constraint. Time-indexed transport formulations cannot resolve this ambiguity: every admissible marginal path admits a curl-free explanation, minimum-action reconstruction selects it, and marginal fit alone cannot distinguish dynamically inequivalent explanations. Requiring one autonomous field to explain several marginals instead makes part of the hidden circulation visible as $\nabla\logρ$ changes across marginals. Separating instantaneous Fokker-Planck source constraints from the snapshot experiment, we show that the source constraints identify the field modulo the kernel of a stacked score-weighted divergence operator. For generic Gaussian shape variation, source constraints at $K\ge m$ time points in intrinsic dimension $m$ eliminate every polynomial gauge direction, whereas finitely many density snapshots alone admit aliasing; we give the obstruction explicitly. At a Gaussian anchor, for Sobolev smoothness $s$ and $n$ samples per time point, we derive a conditional lower rate $(nK)^{-2s/(2s+m+1)}$ for the tangent snapshot experiment, with a matching upper rate in a degreewise benchmark. Strong-form fitting is non-orthogonal to score error and cannot be repaired by spectral filtering. Instead, we estimate using smooth test functions while retaining the known diffusion term, and derive a finite-sample bound that separates sampling error from fixed-grid quadrature bias. Planted-circulation experiments confirm the predicted gauge contraction and expose a design tension between cross-slice information and covariance-aware whitening.

0.38

Flux-form spatiotemporal neural operators for coarse-grained dynamics of multiscale PDEs

cs.LG nlin.CDmath.APphysics.comp-ph ·2026-08-11 ·Junfeng Chen
similarity 0.50
Abstract

We study data-driven prediction of coarse-grained dynamics in multiscale PDE systems. Adopting a closure-free operator-learning viewpoint, we apply a linear coarse-graining map and learn a surrogate evolution operator for the resolved field directly from filtered high-fidelity trajectories. Motivated by the Mori-Zwanzig formalism, we propose a spatiotemporal neural operator mapping a resolved history slab on $Ω\times[-T_{\mathrm{in}},0]$ to a resolved future slab on $Ω\times[0,T_{\mathrm{out}}]$. Spatial mixing uses Fourier convolution, while temporal mixing uses a causal kernel operator with position-attention weights on time lags. This causal temporal operator encodes finite-memory effects in the resolved dynamics while preserving the directionality of the history-to-future map. To improve rollout robustness and suppress nonconservative artifacts, we embed a flux-form inductive bias by parameterizing the windowed update in explicit divergence form. We also provide a data-driven guideline for selecting the memory length $T_{\mathrm{in}}$ via the decorrelation time of a closure-injection diagnostic computed from filtered trajectories. We validate on the coarse-grained viscous Burgers' equation, the Kuramoto-Sivashinsky equation, and two-dimensional turbulent flows, obtaining stable autoregressive rollouts with improved long-horizon accuracy and statistical fidelity.

0.38