CS Paper Radar

Equation free data-driven modelling of chaotic processes

Aurora Poggi, Marco Martens, Hjalmar Brismar, Ozan Oktem, Liviana Palmisano

cs.IT math.DS ·submitted 2026-09-08 10:18 UTC · v1
unusual

Abstract

We introduce a method for constructing predictive models of non cyclic physical processes directly from time-series data, without assuming an underlying differential equation. The observations define a discrete evolution rule whose recurrent behaviour captures the essential dynamics of the process. Analysing this behaviour across multiple geometric scales leads to probabilistic models in the form of Markov chains. Hyperbolicity criteria identify when these models provide a consistent statistical description of the data. The method is inspired by, and illustrated through, the analysis of a biological imaging data set referred to as the Cell Process.

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers

cs.LG nlin.CD ·2026-09-30 ·Yilun Liu, Yi Zhang, Ganyu Wu, Sikuan Yan, Mengyue Wang +3 more
similarity 0.52
Abstract

Autoregressive models are trained to predict a system's behavior one step at a time, and recursive generation allows the learned dynamics to unfold over long horizons. To what extent can such dynamics learned from local observations recover broader organization of an underlying system that was only partially observed during training? Here we study small autoregressive transformers trained from scratch on trajectories sampled from restricted parameter regimes of several non-linear dynamical systems, including logistic and sine maps, the Lorenz system, and the generalized Hopf system, with control parameters and state trajectories represented as sequences of continuous tokens. Under closed-loop evaluation at parameters far outside the training distribution, the models can recover self-similar period-doubling cascades, chaotic dynamics, and attractor structures with remarkable visual and numerical fidelity. For the logistic map, a transformer reproduces successive period doublings up to period 128, yielding a finite-order scaling ratio of 4.6687, matching the Feigenbaum constant to within $5\times10^{-4}$. We further investigate how these structures emerge over the course of training, and reveal with causal interventions how control-parameter information is processed through attention into state prediction and shapes the resulting closed-loop dynamics. These results suggest that a surprisingly narrow window into a system's local behavior may suffice for autoregressive transformers to generalize to its unseen global dynamical organization.

0.23

Identifying Latent Neural Dynamics with Recognition-Parametrised Gaussian Process Dynamical Systems

cs.LG ·2026-11-12 ·Arielle Rosinski, Qianqian Feng, Lior Fox, Maneesh Sahani
top venue similarity 0.52
Abstract · Accepted at NeurIPS 2026

Neural circuits are densely interconnected systems, and many neural computations are thought to be mediated by the dynamical evolution of activity within these recurrent networks, a hypothesis often referred to as "computation through dynamics". Under this view, understanding computation within real neural populations depends on building models of the dynamical rules governing the temporal evolution of recorded high-dimensional neural activity. Most commonly, such models depend on explicit generative parameterisations of (i) the (nonlinear) intrinsic dynamical flow field and stochasticity, (ii) the (nonlinear) mapping from dynamical state to neuronal activity, and (iii) the variability of individual neural responses given that dynamical state. Misspecification of any of these components can bias estimates of dynamics and latent trajectories. In this paper, we circumvent generation-related issues by introducing the Recognition-Parametrised Gaussian Process dynamics (RP-GPdyn) model. RP-GPdyn models the dynamical flow field using a nonparametric Gaussian Process-defined transition function and models the relationship of dynamics to neural activity implicitly using the Recognition-Parametrised Model (RPM) framework. We show that this generation-free approach uncovers meaningful, behaviourally relevant latent variables and dynamics from both synthetic and experimental datasets.

0.39

Physics is the Best Teacher: Consistency Learning for Time-Invariant Operators of Chaotic Dynamics

cs.LG nlin.CD ·2026-10-02 ·Lufang Chiang, Jiachen Yao, Thomas Y. L. Lin, Anima Anandkumar
published similarity 0.52
Abstract · 23 pages, 7 figures, 10 tables. Accepted for the NeurIPS 2026 Workshop on AI for Stochastic Dynamics

Accelerating the prediction of long-term behavior in chaotic systems is crucial in scientific computing. However, existing methods rely on numerical solvers or autoregressive models that advance one small step at a time, which makes long horizons expensive. We instead view this problem as learning the system's time-invariant evolution operator, which jumps the state across a large time span in a single evaluation. To this end, we derive the consistency equations a time-invariant operator must satisfy, with differential and compositional objectives in physical time. These equations also connect the learned operator to the physics-prescribed instant dynamics, enabling physics embedding in consistency learning. Across five chaotic systems, we find that physics-distilled consistency makes both short-term trajectories and long-term statistics more accurate. The learned operator survives temporal extrapolation and requires one-tenth as many evaluations as autoregressive rollout, offering an efficient route to long-term simulation of chaotic dynamics.

0.39

Generative Modeling of Stochastic Dynamics for Long-Time Evolution

cs.LG cond-mat.stat-mechhep-lat ·2026-09-30 ·Yang-yang Tan, Jinyang Li, Lingxiao Wang
similarity 0.51
Abstract · 21 pages, 15 figures, comments are welcome!

Exact stochastic equations for non-equilibrium dynamics are rarely accessible. We show that the long-time evolution of stochastic dynamics can be predicted from configuration pairs at a fixed short time lag, without knowledge of the equation of motion. Generative diffusion models learn the finite-time transition kernel from these pairs, and iterating it propagates the dynamics far beyond the training lag. For two-dimensional Model B, the diffusive dynamics of a conserved order parameter, the learned kernels reproduce dynamic critical scaling and self-similar $t^{1/3}$ coarsening. Agreement with direct simulations persists on lattices twice the largest training size and for initial ensembles absent from training. For driven colloids in a periodic optical potential, ten minutes of measured trajectories suffice to predict the particle current and mean passage time over the next twenty minutes within experimental uncertainty. Short-time observations thus contain the information needed to predict emergent non-equilibrium dynamics at much longer times.

0.28

Spatiotemporal Dynamics of Conway's Game of Life in the Entropy--Complexity Plane

cs.IT nlin.CD ·2026-10-21 ·Lucas Malacarne Astore, Alejandro C. Frery, Petrônio Cândido de Lima e Silva, Frederico Gadelha Guimarães
similarity 0.50
Abstract

We investigate the dynamics of Conway's Game of Life (GoL) through the lens of Ordinal Pattern analysis. Each GoL generation is transformed into a one-dimensional time series, from which ordinal patterns are extracted to characterize its underlying dynamics. The resulting ordinal distributions are then represented in the Entropy--Statistical Complexity ($H \times C$) plane, enabling a quantitative analysis of the system's evolution. We evaluate different encoding strategies, including patch sizes and linearization methods, and assess their impact on the resulting $H \times C$ trajectories. Finally, we characterize the emergent dynamics in terms of convergence behavior, trajectory patterns, and statistical complexity, showing how the proposed entropy--complexity framework provides insights into the dynamics of cellular automata.

0.26

On the universal structure in deterministic generative diffusion

cs.LG cond-mat.stat-mechcs.CVstat.ML ·2026-11-07 ·Defang Chen, Zhenyu Zhou, Can Wang, Zeyu Zheng, Siwei Lyu
similarity 0.50
Abstract

Diffusion-based generative modeling has emerged as a general computational framework for simulating high-dimensional, structured data across various domains. Understanding its generative mechanisms is paramount for advancing model training and inference in a principled way. Here, we demonstrate that deterministic sampling trajectories share a universal geometric structure invariant to data modalities and diffusion model implementations. This structure can be largely explained by an exactly solvable model based on the optimal linear denoiser.

0.10

Kolmogorov-Chapman Maps: Trajectory-Free Learning for Simulating Molecular Dynamics

cs.LG ·2026-11-09 ·Majdi Hassan, Marta Skreta, Dominique Beaini, Kirill Neklyudov
similarity 0.50
Abstract

Stochastic differential equations (SDEs) describe stochastic processes across a wide range of scientific domains, including physics, biology, and finance. Although individual numerical integration steps are inexpensive, observing meaningful events or transitions can require millions of sequential steps, resulting in substantial wall-clock simulation time and poor hardware utilization. Deep learning offers an alternative by amortizing many integration steps into a single neural network forward pass, potentially enabling much faster simulation. However, existing supervised approaches typically require long simulated trajectory data, which restricts their applicability. In this work, we introduce Kolmogorov-Chapman Maps (KC-Maps), a method for learning the transition kernel of an SDE that relies only on the trajectory-free marginal samples together with the known drift and diffusion coefficients. Given an initial time and state of a process, KC-Maps models its distribution integrated to any given time, corresponding to the weak solution of the SDE. To recover the correct dynamics, KC-Maps satisfies two key properties: (i) it satisfies the boundary conditions, which we incorporate directly into the neural network architecture, and (ii) it respects the Kolmogorov--Chapman equation, which provides an efficient training objective. We empirically demonstrate that KC-Maps learns to integrate the dynamics of peptide molecular systems and outperforms classical molecular dynamics in terms of GPU-hours.

0.10

Neural Stochastic Forecasting for Lateral Molecular Diffusion Simulations

cs.LG ·2026-11-04 ·Jacob Ede Levine, Mario Hidalgo-Soria, Chen Yun Wen, Yun Lyna Luo, Sai Chandra Kosaraju
similarity 0.50
Abstract

Predicting the long-time diffusion of membrane proteins is challenging because molecular dynamics (MD) simulations are computationally expensive, while experimental single-particle tracking is often limited by finite observation times. Here, we introduce a neural stochastic (NS) model for forecasting the collective diffusion of membrane proteins from coarse-grained MD trajectories. The model combines a transformer-based representation of protein configurations, recurrent networks operating at multiple temporal scales, and a stochastic latent process with learned memory. A cross-attention decoder then generates correlated protein displacements while accounting for the instantaneous system geometry and periodic boundary conditions. We evaluate the model in two membrane systems: seven interacting PIEZO channels and a mixed system containing seven PIEZO and ten TREK channels. For the seven PIEZO system, the NS model reproduces the anomalous diffusion exponent measured in MD simulations $α\sim 1$, substantially improving on a previously developed variational autoregressive model that exhibits superdiffusive behavior. The model also generates trajectories extending to 40,000 frames and captures the distinct diffusion characteristics of PIEZO and TREK populations in the mixed system. Comparisons of time-averaged mean-square displacements, Van Hove displacement distributions, and non-Gaussian parameters show that the model preserves key statistical features of the simulated dynamics. These results establish neural stochastic modeling as a promising approach for generating long trajectories of multi-protein membrane diffusion and extending the statistical analysis of molecular dynamics simulations.

0.25