CS Paper Radar

Drift-admissibility via Optimal Transport

Abigail Langbridge, Enrico Biffis, Jakub Mareček, Robert Shorten

cs.LG stat.MLmath.OC ·submitted 2026-09-10 09:17 UTC · v1

Abstract

We introduce structure-aware optimal transport diagnostics for assessing whether empirical time-series dynamics are compatible with a prescribed predictable-drift class. Our approach translates a pathwise property of stochastic processes into a finite-dimensional projection problem over empirical transition laws, encoding admissibility as row-wise moment constraints on local couplings and quantifying deviations via a Kullback--Leibler projection gap $G_{λ,k}$. This yields both a principled diagnostic and a scalable Bregman--Dykstra algorithm that retains the efficiency of Sinkhorn-type methods while incorporating structural constraints. Calibrated against a Brownian reference null, $G_{λ,k}$ separates process classes that are indistinguishable by second-order statistics alone---including fractional Brownian motion and BSS processes sharing identical Hurst indices---without asymptotic resampling or continuous-time recovery. This positions the method as a general tool for structure-aware model validation of sequential data.

Comment
10 pages; 3 figures; 2 tables

Closest papers

Nearest neighbours by meaning across the whole index.

One Intervention per Component is Enough: Towards Identifiability in Linear Stochastic Dynamics from Steady State

cs.LG ·2026-09-17 ·Saber Salehkaleybar
highly cited similarity 0.58
Abstract

We study the problem of recovering the parameters of a multivariate Ornstein-Uhlenbeck (OU) process from steady-state observational and interventional data. In many applications, such as large-scale gene perturbation experiments, only stationary "snapshot" measurements are available, making standard stochastic differential equation estimation methods that rely on time-series trajectories inapplicable. We first establish an identifiability result: one intervention per strongly connected component (SCC) of the drift graph suffices to recover all OU process parameters generically up to a global scaling factor. This holds provided that the SCC condensation graph is connected with a single root and certain spectral nondegeneracy assumptions hold. We propose a recursive learning algorithm that orders SCCs topologically and, for each component, isolates its marginal dynamics and solves a linear system derived from the steady-state moment equations, leveraging parameters recovered for upstream components. Building on this theoretical foundation, we propose a regularized least-squares estimator that jointly minimizes residuals of the steady-state mean and covariance equations across observational and interventional data. Experimental results validate our theoretical findings in recovering parameters of the underlying OU process.

0.52

Simulation-Free Learning of GP-SDEs from Irregular Observations

cs.LG eess.SPstat.ML ·2026-09-27 ·Zhidi Lin, Yuhao Liu, Ying Li, Edwin Fong, Petar Djurić
similarity 0.57
Abstract

Gaussian process stochastic differential equations (GP-SDEs) provide a flexible Bayesian model for unknown continuous-time state dynamics with uncertainty quantification, but learning and inference from noisy and irregular observations remain computationally challenging. To address this issue, we propose GP-SDE Matching, a simulation-free variational framework for Bayesian GP drift learning and continuous-time state smoothing. We analytically marginalize the sparse GP posterior to derive a tractable drift-matching objective that accounts for both the posterior mean and uncertainty of the unknown drift. To handle irregular observations, we further introduce an irregular-time-aware variational state posterior that incorporates the actual observation times during both encoding and continuous-time marginal querying. Experiments on the stochastic Lorenz--63 system demonstrate substantially improved drift recovery and state reconstruction under irregular observations, while five system identification benchmarks show robust forecasting under increasing observation sparsity and competitive performance against existing latent-SDE and state-space methods.

0.29

Instrumental Variables in Continuous-Time Stochastic Processes

cs.LG ·2026-11-05 ·Lars Pennig, Søren Wengel Mogensen, Niki Kilbertus
similarity 0.57
Abstract

Causal questions often arise in systems that evolve in continuous time. While instrumental variable (IV) methods provide a principled approach to identify causal effects in static or discrete-time settings, even in the presence of unobserved confounding, they do not yet extend to continuous-time dynamics. In this work, we develop an IV framework for stationary continuous-time stochastic processes parameterized by stochastic differential equations (SDE), where the instrument itself takes the form of a stochastic process. We encode the structural sparsity and causal effects directly at the infinitesimal level of the drift, and contrast these assumptions with the IV assumptions on the discretized version of the same process. Based on these structural assumptions, we derive moment restrictions using path-valued instruments. We show how these restrictions simplify for Ornstein-Uhlenbeck processes and present an identification condition together with a corresponding consistent estimation method. Finally, we extend our estimation framework to nonlinear causal effects by expressing the path-based moment restrictions leveraging the signature kernel. Empirically, our method recovers causal effects in confounded continuous-time systems where maximum-likelihood-based estimation and discrete-time IV methods are systematically biased.

0.14

StocBench: A Benchmark for Generative Modeling of Stochastic Dynamics

cs.LG ·2026-08-23 ·Sebastian Pfister, Benjamin Holzschuh, Nils Thuerey
benchmarkcode/data similarity 0.56
Abstract · Code available at https://github.com/tum-pbs/stocbench

We benchmark transport-based generative models as well as distillation-based few-step methods for the probabilistic forecasting of stochastic fluid flows, with a particular focus on performance under limited inference budgets. All methods are evaluated on a two-dimensional Kolmogorov flow with stochastic forcing. We measure one-step distributional accuracy against large simulated reference ensembles and assess whether the invariant measure is preserved during autoregressive rollouts via the enstrophy spectrum. On the stochastic task, flow matching achieves the most accurate one-step conditional distribution at high inference budgets, while the second-order exponential integrator DPM-2 is strongest at very low NFE. Few-step distillation methods are competitive with the multi-step methods and preserve the enstrophy spectrum particularly well. A deterministic control task, in which the forcing over the prediction interval is observed, separates aleatoric from epistemic uncertainty. Model performance does not translate between the two settings: the distilled models are competitive on the stochastic task but least accurate on the control task. While stochastic diffusion samplers such as DDPM better preserve the enstrophy spectrum during rollouts in the stochastic setting, deterministic samplers such as DDIM and DPM-2 show better spectral preservation in the deterministic setting.

0.49

Continuous-Time Modeling of Destination-Constrained Dynamic Systems via Doob's $h$-Transform

eess.SY ·2026-11-10 ·Sanfeng Hu, Liping Guo, Mengjiao Tang, Yao Rong, X. Rong Li
similarity 0.56
Abstract

Existing work on modeling destination-constrained dynamic systems has mainly focused on discrete-time formulations with linear destination constraints or Gaussian destination distributions. Since practical systems are more naturally modeled in continuous time and often subject to nonlinear/non-Gaussian constraints/distributions, this paper proposes a unified measure-transformation framework for continuous-time modeling of systems subject to deterministic or distributional constraints on a nonlinear function of the terminal state. The framework starts from an unconstrained Itô stochastic differential equation, typically derived from physical laws to describe the system's forward evolution without destination information, and takes its induced path measure as unconstrained measure. Doob's $h$-transform is employed to transform this measure into a constrained path measure incorporating destination information through an injected drift. The resulting system is proved to satisfy the constraints while preserving the laws of the unconstrained state process conditioned on the destination information. The transition density is derived, and the path measure of the distributionally constrained system is proved to uniquely minimize Kullback--Leibler divergence from the unconstrained path measure among those satisfying the same distributional constraint. Its injected drift is further shown to converge pointwise to that of the deterministically constrained system as the destination distribution shrinks to the prespecified value. For linear time-varying unconstrained systems, a simplified form of the constrained systems is derived in terms of the conditional expectation of the terminal state, leading to the development of trajectory-generation algorithms. Numerical simulations evaluate the proposed framework under both types of destination constraints.

0.23

Non-parametric Formal Synthesis of Unknown Stochastic Systems: Asymptotic Convergence Guarantees

eess.SY ·2026-09-05 ·Zhi Zhang, Sadegh Soudjani
theory similarity 0.56
Abstract

Data-driven techniques have shown promising potential for checking behavior of complex systems operating in safety-critical domains against safety and other temporal requirements. This paper studies a class of data-driven techniques that are based on learning a representation of the system from data using non-parametric estimation. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic specifications only using observation samples and without the knowledge of the model, and provides a probabilistic guarantee on the satisfaction of the specification. We first consider finite abstract representations of the system in the form of Markov decision processes (MDPs) and derive asymptotic convergence guarantees between the transition probabilities of the abstract MDP and their estimation using Bernstein's inequality and statistical properties of non-parametric estimators. We then propose theoretical results for estimating the asymptotic upper bound of the \emph{Lipschitz constant} (LC) of the stochastic system, which can determine the size of the finite abstract MDP for a given precision error. Under appropriate assumptions, our results prove that the asymptotic convergence rate of the estimations is $O(n^{-1/(3+d)})$ for both the transition probabilities and the LC, where $\mathsf d$ is the dimension of the system and $n$ is the data scale. By integrating these results, we can guarantee the asymptotic closeness in formal verification and policy synthesis performed on the original system and its finite abstraction based on the size of the dataset. Multiple case studies are presented to validate the effectiveness of the proposed method.

0.26

Forward-Evolution Error Analysis and Adaptive Design for Matrix-Valued Diffusion Models

cs.IT math.ST ·2026-08-15 ·Tongyao Pang, Zuowei Shen, Ruitong Zhang
similarity 0.55
Abstract

Diffusion models learn to reverse a predefined corruption process, but sampling still requires a costly time discretization and depends on the chosen noise schedule. We study these two issues for variance-preserving diffusions with matrix-valued schedules. Our analysis transfers reverse-time discretization errors to the forward corruption law and treats two numerical schemes within a common framework. The first freezes the score and yields, through a matrix-sensitive local comparison and forward information dissipation, an ambient-dimensional step complexity with leading factor $d/\varepsilon^2$ for KL accuracy $\varepsilon^2$. The second keeps the known Gaussian drift exact and freezes the posterior mean. For data of metric-entropy dimension $k$, a forward Markov identity, an anisotropic covering estimate, and Stieltjes integration by parts give the corresponding factor $k\log k/\varepsilon^2$. In both cases, the proof identifies a local error, accumulates it through the forward evolution, and inserts the result into a common KL decomposition. The local errors further provide directional criteria for matrix schedules and an asymptotically optimal square-root adaptive grid. A high-dimensional Gaussian-mixture experiment illustrates the resulting schedule and grid improvements.

0.32

Towards Universal Representation-Based Process Control

cs.LG ·2026-09-25 ·Jinmyeong Choi, Taesup Kim, Artur Dubrawski
similarity 0.54
Abstract

Many temporal process learning and monitoring pipelines operate in local windows, making window-level decisions unavoidable in practice. In such settings, classical statistical tests can be applied to individual windows, but they typically evaluate predefined parametric hypotheses-such as unit-root or moment-based conditions-thereby limiting flexibility when reference behavior is defined empirically from task- or domain-specific data. In this work, we view window-level monitoring as a process control problem and reformulate it as reference-based hypothesis testing, where the null hypothesis is specified by an empirical reference distribution rather than a fixed parametric model. We operationalize this perspective through a representation-based, nonparametric framework that combines pretrained time series encoders, kernel density estimation, and conformal calibration, yielding finite-sample valid inference in learned representation space. Classical notions such as stationarity and cyclostationarity arise as natural instantiations of empirical reference sets within this framework. Through experiments, we demonstrate sensitivity to window-level distributional deviations while maintaining well-calibrated inference under stable reference regimes, highlighting the applicability of the proposed approach to a broad class of time series process control and monitoring tasks.

0.21