CS Paper Radar

Confronting Uncertainty in Mechanism-AI Coupled Dynamical Systems via Optimal Transport and Information Geometry: Part I. Distribution Learning

Pengfei Song, Yanni Xiao, Shuangshuang Yin

cs.LG math.DSmath.MGmath.PRstat.ML ·submitted 2026-11-07 08:06 UTC · v1
hot direction

Abstract

Mechanism-AI coupled dynamical systems are increasingly used to study complex biological systems. However, uncertainty associated with noisy, sparse, and partially observed data limits their reliability. This paper presents a systematic mathematical formulation for treating these uncertainties from the perspective of optimal transport and information geometry. We formulate the uncertainty quantification problem as the minimization of an energy functional on a probability density space equipped with a Riemannian metric, with the loss evaluated through a differential equation, and give a unified description of the gradient flows of the energy functional under specific metrics, such as the Wasserstein and Fisher-Rao metrics. Furthermore, we present corresponding numerical methods for solving these gradient flows using abstract adjoint sensitivity analysis. The formulation connects a range of Bayesian inference methods for dynamical systems; numerical experiments compare posterior approximation and predictive uncertainty under a common computational budget. Moreover, it also provides a geometric perspective on dynamical modeling and the study of heterogeneity evolution.

Closest papers

Nearest neighbours by meaning across the whole index.

Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning

cs.LG cond-mat.stat-mechcond-mat.dis-nncond-mat.soft+1 ·2026-09-14 ·Emmy Blumenthal, Nikolas Claussen, Benjamin Eysenbach, Catherine Ji, Gautam Reddy +2 more
similarity 0.63
Abstract · 5 Chapters, 62 pages, 16 figures

The last decade has seen the development of powerful methods for learning complex structure from high-dimensional data. These advances have brought to the foreground fundamental connections between subdisciplines of physics, applied mathematics, and machine learning. In this review, we bring together some of these ideas, often expressed in different languages, to highlight a conceptual thread that links five distinct fields: control theory, optimal transport, probabilistic inference, non-equilibrium thermodynamics, and machine learning. A common theme is the optimization of free-energy-like functionals under dynamical or statistical constraints. We offer a guided tour through this thread and present selected applications in reinforcement learning, variational inference, and generative modeling. The review does not assume prior familiarity with these topics, and begins with principles originating from physics.

0.37

The Advective Fisher-Rao Geometry of Deterministic Measure Transport

cs.LG math.OCmath.DGmath.PR ·2026-08-12 ·Benjamin Gess, Johannes Müller
similarity 0.63
Abstract · 80 pages, 6 figures

A novel advective Fisher-Rao metric is introduced for optimization tasks on paths of probability measures governed by the continuity equation. This metric is shown to lead to optimal descent directions. It is then shown that this metric arises naturally from three different perspectives: As the rescaled zero-noise limit of the Fisher-Rao metric on path measures, as the expected value of the second variation of the Freidlin--Wentzell large deviation rate functional, and as the Hessian of the Benamou--Brenier action functional from dynamic optimal transport. We supplement this geometric construction with computational experiments. Here, we demonstrate empirically that the advective Fisher-Rao metric yields the desired optimal fitting of probability densities, whereas the Gauss--Newton method yields optimal fitting of velocity fields.

0.10

Fixed-point acceleration on Neural Wasserstein manifolds

cs.LG math.OC ·2026-11-06 ·Vitalii Aksenov, Sebastian Gutierrez Hernandez
similarity 0.62
Abstract

We propose a fixed-point acceleration method for optimization over probability measures, applicable to a variety of machine learning problems. We represent probability measures as pushforwards of a reference distribution through a neural network map and equip the parameter space with the induced pullback Wasserstein metric. This geometric structure allows natural gradient descent to be interpreted as a fixed-point iteration on a Riemannian manifold. We accelerate this iteration using Riemannian Anderson mixing method, which exploits historical residuals to capture approximate second-order information without forming Hessians. In the present parametric setting, the manifold is represented by Euclidean coordinates endowed with a point-dependent metric, simplifying retraction and vector transport. We evaluate the method on multimodal sampling, PDE-based inverse problems, aggregation dynamics, Bayesian logistic regression, and generative modeling. Across the tested tasks, Anderson mixing reduces the number of natural-gradient iterations and achieves competitive performance relative to SGD and Adam in terms of both loss-gradient evaluations and wall-clock time. These results suggest that fixed-point acceleration is an efficient tool for improving the computational efficiency of training on parametric Wasserstein methods.

0.17

Point interpolation and distributional universality in flow-based generative models

cs.LG stat.MLmath.OC ·2026-11-03 ·Antonio Álvarez-López, Jingpu Cheng, Liyan Zhang, Qianxiao Li
similarity 0.62
Abstract · 45 pages, 3 figures

Motivated by the expressive power of neural ordinary differential equations in flow-based generative modeling, we study the approximation of probability measures by pushforwards generated by parameterized families of Lipschitz vector fields. For Wasserstein distances, we establish a quantitative relationship between finite-sample point interpolation and distributional approximation, and derive universality criteria based on $L^p$-approximation of transport maps. In particular, affine-invariant families containing a non-affine vector field are universal from compactly supported absolutely continuous base measures. For total variation, we show that coordinate-wise dynamics are insufficient in dimensions $d\geq 2$ and establish sufficient conditions based on one-dimensional Sobolev approximation and shear-type mixing. We further examine the role of point interpolation, establishing when different regimes relate to one another and when approximate interpolation can be made exact.

0.16

Bayesian Learning of Uncertain Linear System Behaviours

eess.SY ·2026-11-13 ·Noreen Abdelwahab, Alberto Padoan, Dominic Liao-McPherson
similarity 0.61
Abstract · Submitted to European Control Conference 2027

We present a Bayesian approach to learning uncertain behavioural representations of linear dynamical systems from noisy input-output data. In behavioural systems theory, the finite-horizon behaviour of a linear system is represented by a subspace. We quantify uncertainty in this subspace through probability distributions on the Grassmann manifold. This leads to a geometric formulation of Bayesian inference over the Grassmannian. We derive the posterior distribution under Gaussian measurement noise and discuss how uncertainty in the inferred behaviour can be propagated to trajectory predictions, with a view towards data-driven control.

0.27

Stochastic Latent Twins: Learning Stochastic Solution Operators

cs.CE math.NA ·2026-10-15 ·Matthias Chung, Jack Michael Solomon, Deepanshu Verma
similarity 0.60
Abstract · 47 pages, 15 figures, 6 tables

Scientific prediction under uncertainty requires more than a single future state: it requires the distribution of possible outcomes. We show that this distribution-valued evolution can be learned directly as a stochastic solution operator between arbitrary source and target times. We introduce Stochastic Latent Twins, which represent the physical state through a deterministic encoder-decoder while placing stochasticity entirely in a probability-valued latent evolution map. This separation makes the stochastic transition law independent of the state representation and enables direct probabilistic prediction without recursive time stepping. We establish an end-to-end Wasserstein approximation theory that separates representation and latent-transition errors, derive stability guarantees, and develop a distributional theory of physics conformity with latent-to-physical transfer bounds and conformity by construction. The resulting framework can be learned directly from observed transitions and supports forward prediction, backward conditional evolution, one-shot generation, and physics-conforming stochastic dynamics within the same formulation. Numerical experiments ranging from linear and non-Gaussian SDEs to stochastic Lorenz dynamics, generative modeling, a stochastic Hamiltonian system, and a two-dimensional stochastic Burgers equation verify the theory, expose the distinct roles of state representation and transition-family expressivity, compare favorably with recent stochastic and one-step generative methods, and demonstrate exact physical conservation by construction. More broadly, Stochastic Latent Twins provide a step toward scientific surrogates that represent not only the evolution of a system, but also its uncertainty and physical structure, opening new opportunities across uncertainty quantification, data assimilation, inverse problems, control, and digital twins.

0.18

Adaptive Control as an Information Gradient Flow: Excitation, Constraints, Energy, and Stochastic Learning

eess.SY ·2026-10-04 ·Omkar Sudhir Patil
similarity 0.59
Abstract

Adaptive control is usually developed through Lyapunov stability, excitation, and parameter convergence, whereas neighboring fields describe learning using convexity, information geometry, variational principles, and stochastic thermodynamics. This paper develops a constrained common language for these viewpoints. For linearly parameterized models, the excitation Gramian is simultaneously the Hessian of accumulated prediction loss and, under Gaussian observations, Fisher information up to scaling. Persistent, finite, and partial excitation become uniform, finite-horizon, and restricted temporal curvature; memory methods retain previously acquired curvature. On a closed convex parameter set, deterministic adaptation is a projected gradient/Onsager flow, with tangent and normal cones recovering projection, while composite learning supplies data-dependent symmetric dissipation. Reflected Langevin dynamics, no-flux Fokker--Planck evolution, and constrained free-energy flow provide the stochastic counterpart. The framework distinguishes information supplied by data from confinement supplied by regularization or hard constraints and connects familiar adaptive-control structures to modern variational and information-theoretic language.

0.31

RW-Flow: One-Step Generation on Compact Manifolds via Wasserstein Gradient Flows

cs.LG ·2026-09-30 ·Ualibyek Nurgulan, Seungwoo Yoo, Prin Phunyaphibarn, Minhyuk Sung
hot direction similarity 0.59
Abstract · 27 pages

Manifold-valued data, and consequently the distributions they induce, are prevalent across many domains, ranging from the locations of geospatial events, such as earthquakes, to biomolecular torsion angles that encode information about three-dimensional structure. While diffusion and flow-based generative models have been successfully extended to compact manifolds, sampling typically requires tens or hundreds of sequential network evaluations. We introduce RW-Flow, a theoretically grounded framework for learning one-step generative models on compact manifolds via Wasserstein gradient flows. The main challenge is identifiability: driving the velocity field to zero should guarantee that the model distribution matches the target distribution. We establish a necessary and sufficient condition for identifiability on compact, connected Riemannian manifolds. We specifically show that, for a symmetric, Lipschitz-continuous cost function, the velocity field induced by the Sinkhorn divergence is identifiable if and only if the associated Gibbs kernel is nondegenerate. This characterization provides a general principle for designing identifiable costs on compact manifolds. It also reveals that the squared geodesic distance, the natural manifold analogue of the squared Euclidean distance, does not always guarantee identifiability. Across benchmarks involving geospatial events, protein side chain torsion angles, RNA backbone torsion angles, and general manifolds discretized as triangular meshes, RW-Flow outperforms existing one-step methods in nearly all settings under fair comparison conditions.

0.25