CS Paper Radar

Extrapolating learned dynamics across bifurcations based on generalized synchronization

Lingfeng Chen, Masanobu Inubushi

cs.LG nlin.CDmath.DS ·submitted 2026-10-25 17:47 UTC · v1

Abstract

Predicting dynamics across bifurcations by extrapolating trained models is crucial in diverse fields of physics. Generalized synchronization provides a framework for understanding dynamical reconstruction by neural networks, especially in the context of reservoir computing. Building on this framework, we derive a formula combining pretrained readouts to reconstruct unseen chaotic dynamics. Using classical Lagrange interpolation theory, we derive rigorous bounds on readout errors and conjugacy residuals. Numerical examples demonstrate accurate prediction of chaotic dynamics across bifurcations.

Closest papers

Nearest neighbours by meaning across the whole index.

The internal model principle in reservoir computing

eess.SY math.OC ·2026-10-06 ·Danyal Saqib, Alberto Padoan
similarity 0.66
Abstract · Submitted to the American Control Conference (ACC) 2027

The paper studies learning in reservoir computing systems through the lens of the internal model principle. The key idea is to model training signals as outputs of an exogenous signal generator, thus connecting reservoir computing to output regulation, observer theory, and frequency-domain interpolation. For linear signal generators, we characterize the steady-state response of a linear reservoir through invariant subspaces, establishing connections with Luenberger observers and classical frequency-domain interpolation. For nonlinear signal generators, we obtain analogous results using invariant manifolds, connecting synchronization to Kazantzis-Kravaris/Luenberger observers and readout training to nonlinear moment matching. Case studies illustrate how our perspective explains possible instability of trained predictors and informs reservoir design.

0.11

Prediction of Nonlinear Oscillations in a Jumping Quarter-Car Model Using Reservoir Computing

cs.LG nlin.CD ·2026-09-01 ·Masahisa Watanabe, Shiva Dixit, Nirmal Punetha, Swati Chauhan, Manish Dev Shirimali
unusual similarity 0.65
Abstract

Reliable prediction of vehicle dynamics is essential for smart driving applications such as autonomous control and advanced driver-assistance systems. Off-road vehicles used in agricultural and construction settings are particularly prone to nonlinear behavior, including bifurcations and chaotic motion arising from intermittent loss of tire--road contact. Predicting such dynamics is challenging because it requires resolving both smooth nonlinearities and the discontinuous switching associated with contact loss. In this work, we investigate the feasibility of reservoir computing (RC) -- specifically an echo state network (ESN) -- for data-driven prediction of a jumping quarter-car model. The reservoir is trained on time-series data from a small number of points and evaluated on its ability to reconstruct bifurcation diagrams, phase-space attractors, and time trajectories across periodic and chaotic regimes. The trained reservoir qualitatively reproduces the period-doubling route to chaos, captures the geometric structure of periodic and chaotic attractors. These results demonstrate that reservoir computing is a feasible data-driven predictor of nonlinear dynamics in a practical, non-smooth vehicle system.

0.33

Physics is the Best Teacher: Consistency Learning for Time-Invariant Operators of Chaotic Dynamics

cs.LG nlin.CD ·2026-10-02 ·Lufang Chiang, Jiachen Yao, Thomas Y. L. Lin, Anima Anandkumar
published similarity 0.62
Abstract · 23 pages, 7 figures, 10 tables. Accepted for the NeurIPS 2026 Workshop on AI for Stochastic Dynamics

Accelerating the prediction of long-term behavior in chaotic systems is crucial in scientific computing. However, existing methods rely on numerical solvers or autoregressive models that advance one small step at a time, which makes long horizons expensive. We instead view this problem as learning the system's time-invariant evolution operator, which jumps the state across a large time span in a single evaluation. To this end, we derive the consistency equations a time-invariant operator must satisfy, with differential and compositional objectives in physical time. These equations also connect the learned operator to the physics-prescribed instant dynamics, enabling physics embedding in consistency learning. Across five chaotic systems, we find that physics-distilled consistency makes both short-term trajectories and long-term statistics more accurate. The learned operator survives temporal extrapolation and requires one-tenth as many evaluations as autoregressive rollout, offering an efficient route to long-term simulation of chaotic dynamics.

0.39

A KKL Observer Perspective on Reservoir Computing

eess.SY cs.LGmath.DSmath.OC ·2026-10-03 ·Anastasia Bizyaeva, Fernando Castaños, Jaime A. Moreno
theory similarity 0.62
Abstract · 8 pages

Reservoir computing (RC) is a machine learning technique for data-driven modeling of dynamics for forecasting and control, primarily studied in computer science and physics literature with promising applications in neural network learning, physical computing, and neuroscience. Why reservoirs learn and how to choose good reservoir architectures are considered important open questions. We show that the RC problem is mathematically an extension of a classic problem in systems and control theory, the Kazantzis-Kravaris-Luenberger (KKL) observer design problem. As a consequence, many of the questions considered open for RC stand to benefit from a large body of theory in the mature KKL literature, non-exhaustively including on questions of embedding, transverse stability, local and global uniqueness guarantees, and effective data-driven solution constructions. Elaborating on this connection, we show that the surprising forecasting ability of reservoirs is in fact a direct consequence of the well-known observer internal model principle, derive an upper bound on the prediction error over a fixed forecast horizon, and provide a partial explanation for why linear readout training in RC works reasonably well. This work illustrates how classical ideas from systems and control can provide strong theoretical backing and open new questions for modern machine learning methods.

0.44

RC Prediction: A Python Package for Parameter-Aware Reservoir Computing

cs.LG eess.SYmath.DS ·2026-10-29 ·Jin-Cheng Rao, Zheng-Meng Zhai, Ying-Cheng Lai
benchmarkcode/data similarity 0.62
Abstract

A nonlinear dynamical system can be characterized by the autonomous evolution of its state in time and its dependence on system parameters. As a parameter varies, the dynamics can change quantitatively and, at bifurcation points, qualitatively. When the governing equations are unknown, a data-driven model should therefore capture both elements from observational data, rather than reproduce the dynamics at a single operating condition only. Parameter-aware reservoir computing (PARC) is a model-free framework for this purpose, where the parameter is supplied to a reservoir computer through an additional input channel. PARC is trained on time series recorded at several parameter values, and the trained reservoir, run in closed loop as an autonomous dynamical system, generates trajectories at parameter values that were never observed. rc_prediction is an open-source Python package that implements this workflow. It provides multi-parameter training of a reservoir, autonomous closed-loop prediction at user-specified parameter values, parameter scans, and a standard echo state network for forecasting at a fixed parameter. Hyperparameter optimization and optional GPU acceleration through PyTorch are also provided. We use three benchmark dynamical systems as examples to demonstrate its usage. As one of the featured applications, here we illustrate the prediction of critical transitions and system collapse: trained only on pre-critical data, the model is queried beyond the training range to predict whether the system collapses, to estimate the critical parameter $p_c^{*}$, and to characterize transient lifetimes.

0.19

Unrolled gradients in disguise: bridging interpolation-based and Jacobian regularization for stable neural dynamics

cs.LG math.NA ·2026-11-02 ·Maya Janvier, Etienne Meunier
top venue similarity 0.61
Abstract · Accepted at NeurIPS 2026

Hybrid models and neural differential equations (NDEs) are becoming increasingly important for modelling physical systems; however, they often encounter stability and accuracy issues during long-term integration. Training on unrolled trajectories is known to limit these divergences but quickly becomes too computationally expensive due to the need to compute gradients over an iterative process, making this method impractical for large-scale physical systems (e.g. weather and climate forecasting). Two popular paradigms for improving the stability of learned dynamics are to train on interpolated or noisy samples or to regularize the Jacobian of the learned representation. In this work, we demonstrate that these paradigms can be understood under a common lens and that they both correspond to an approximation of the gradients obtained in an unrolled learning strategy. Building on this understanding, we derive a principled and complete approach to regularize training and demonstrate its impact on the stability of learned dynamical systems.

0.39

Time Without Timesteps: Simulating Coupled Dynamical Systems via Self-Consistency

cs.LG ·2026-09-03 ·Liyu Zerihun, Mark Shinyoung Lee
similarity 0.61
Abstract

Numerical simulation of dynamical systems is usually organized as a causal march through time: each state is computed from the previous one. We explore a different formulation for coupled systems. For each subsystem type we train a neural surrogate mapping a full driving trajectory and initial condition directly to a full output trajectory; following classical waveform relaxation, coupled systems are assembled by enforcing self-consistency among these trajectories: simulation becomes a fixed-point problem over complete trajectories rather than a stepwise rollout. On coupled van der Pol oscillators and Hodgkin-Huxley neuron networks, sequential depth becomes the number of solver iterations: 4-10 Newton iterations where the reference integrator takes 1500 steps. The gradient likewise loses its time recursion: it becomes a linear system solved by GMRES at memory independent of solver depth. A single scalar measured from the learned operator, the spectral radius of its Jacobian, predicts in advance where the coupled solve will converge; past that boundary, unrolled backpropagation diverges and a Neumann adjoint fails, while the implicit gradient remains correct to 0.04%. We report where the approach succeeds and where surrogate error degrades it.

0.16

Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers

cs.LG nlin.CD ·2026-09-30 ·Yilun Liu, Yi Zhang, Ganyu Wu, Sikuan Yan, Mengyue Wang +3 more
similarity 0.61
Abstract

Autoregressive models are trained to predict a system's behavior one step at a time, and recursive generation allows the learned dynamics to unfold over long horizons. To what extent can such dynamics learned from local observations recover broader organization of an underlying system that was only partially observed during training? Here we study small autoregressive transformers trained from scratch on trajectories sampled from restricted parameter regimes of several non-linear dynamical systems, including logistic and sine maps, the Lorenz system, and the generalized Hopf system, with control parameters and state trajectories represented as sequences of continuous tokens. Under closed-loop evaluation at parameters far outside the training distribution, the models can recover self-similar period-doubling cascades, chaotic dynamics, and attractor structures with remarkable visual and numerical fidelity. For the logistic map, a transformer reproduces successive period doublings up to period 128, yielding a finite-order scaling ratio of 4.6687, matching the Feigenbaum constant to within $5\times10^{-4}$. We further investigate how these structures emerge over the course of training, and reveal with causal interventions how control-parameter information is processed through attention into state prediction and shapes the resulting closed-loop dynamics. These results suggest that a surprisingly narrow window into a system's local behavior may suffice for autoregressive transformers to generalize to its unseen global dynamical organization.

0.23