CS Paper Radar

Wiener Space Cubature for Nonlinear Gaussian Filtering

Luke Snow, Daniel Waxman, Matthew E. Levine

eess.SP ·submitted 2026-10-02 20:48 UTC · v1
theory

Abstract

Continuous-discrete filtering is a classical problem in signal processing and control theory, whereby the state driving a stochastic differential equation (SDE) must be inferred from noisy, partial discrete-time observations. Corresponding filtering algorithms are often formed as discrete-time methods and applied to a discretization of the SDE, an approach limited by the incurred discretization error, or model a type of Gaussian moment ordinary differential equation (ODE) flow, which is approximate for nonlinear dynamics. We introduce a new method, the Wiener-space cubature Kalman filter (WSC-KF), for Gaussian filtering in this continuous-discrete setting. The WSC-KF combines spatial sigma-point representations with Wiener space cubature integration, effectively approximating iterated integral terms of the driving Brownian motion to higher-order than standard discretization (e.g., Ito-Taylor expansions), or approximate moment-ODE flows (e.g., as in the unscented Kalman filter). Theoretically, we characterize the path-law approximation degree of WSC-KF through a tunable model order parameter. We prove that, depending on the model order chosen, WSC-KF provides weak order bounds comparable to or dominating that of a cubature Kalman filter using a first-order Ito predict step. Numerically, we confirm that rate on a globally Lipschitz Levy-area diffusion. Degree-5 Wiener cubature matches mixed iterated integrals that existing continuous-discrete Kalman predictors omit, while remaining efficiently computable; this is the mechanism enabling higher-order weak path-law approximation.

Closest papers

Nearest neighbours by meaning across the whole index.

NANO: A Unified Optimization Framework for Nonlinear Gaussian Filtering

eess.SY ·2026-10-12 ·Zhenxuan Ma, Haoning Wang, Wenhan Cao, Shengbo Eben Li
similarity 0.55
Abstract · This manuscript was posted prematurely, before all coauthors had approved its public release. We therefore request its withdrawal

Conventional Gaussian filtering typically approximates nonlinear models or their statistical moments and retains the Kalman update structure. The resulting approximation errors can affect both state estimates and their uncertainty. This paper presents the Natural Gradient Gaussian Approximation (NANO) framework for nonlinear filtering. Both prediction and measurement update are formulated as optimization problems over Gaussian distributions, with the entire Gaussian distribution serving as the optimization variable. The framework integrates observation losses, distributional discrepancies, natural-gradient optimization, and finite-step update rules, providing a unified formulation for constructing different filters. Natural-gradient iterations account for the geometry of the Gaussian family and jointly update the distribution parameters. The framework incorporates the existing NANO-P method using the Kullback-Leibler divergence and introduces NANO-W using the Wasserstein distance. NANO-P maintains covariance positive definiteness through a positive-semidefinite curvature approximation, while NANO-W uses a covariance transport update that accommodates indefinite curvature. Their update rules and sufficient conditions for covariance positive definiteness are established within the common framework. Through these two realizations, the proposed framework achieves the best estimation accuracy among the evaluated methods on each of six benchmarks. Runtime evaluations further assess its computational feasibility for practical applications.

0.21

A simple derivation of the Kalman filter

eess.SP math.OCeess.SYmath.ST+1 ·2026-09-02 ·Marco Chiani, Giovanni Petris, Moe Z. Win
published similarity 0.55
Abstract · To be published in IEEE Signal Processing Magazine

In this lecture note, we present a concise and self-contained derivation of the discrete-time Kalman filter equations that requires only a basic understanding of least squares estimation. The treatment is designed to minimize mathematical overhead while preserving both rigor and generality.

0.33

Continuous-Time Modeling of Destination-Constrained Dynamic Systems via Doob's $h$-Transform

eess.SY ·2026-11-10 ·Sanfeng Hu, Liping Guo, Mengjiao Tang, Yao Rong, X. Rong Li
similarity 0.54
Abstract

Existing work on modeling destination-constrained dynamic systems has mainly focused on discrete-time formulations with linear destination constraints or Gaussian destination distributions. Since practical systems are more naturally modeled in continuous time and often subject to nonlinear/non-Gaussian constraints/distributions, this paper proposes a unified measure-transformation framework for continuous-time modeling of systems subject to deterministic or distributional constraints on a nonlinear function of the terminal state. The framework starts from an unconstrained Itô stochastic differential equation, typically derived from physical laws to describe the system's forward evolution without destination information, and takes its induced path measure as unconstrained measure. Doob's $h$-transform is employed to transform this measure into a constrained path measure incorporating destination information through an injected drift. The resulting system is proved to satisfy the constraints while preserving the laws of the unconstrained state process conditioned on the destination information. The transition density is derived, and the path measure of the distributionally constrained system is proved to uniquely minimize Kullback--Leibler divergence from the unconstrained path measure among those satisfying the same distributional constraint. Its injected drift is further shown to converge pointwise to that of the deterministically constrained system as the destination distribution shrinks to the prespecified value. For linear time-varying unconstrained systems, a simplified form of the constrained systems is derived in terms of the conditional expectation of the terminal state, leading to the development of trajectory-generation algorithms. Numerical simulations evaluate the proposed framework under both types of destination constraints.

0.29

Simulation-Free Learning of GP-SDEs from Irregular Observations

cs.LG eess.SPstat.ML ·2026-09-27 ·Zhidi Lin, Yuhao Liu, Ying Li, Edwin Fong, Petar Djurić
similarity 0.53
Abstract

Gaussian process stochastic differential equations (GP-SDEs) provide a flexible Bayesian model for unknown continuous-time state dynamics with uncertainty quantification, but learning and inference from noisy and irregular observations remain computationally challenging. To address this issue, we propose GP-SDE Matching, a simulation-free variational framework for Bayesian GP drift learning and continuous-time state smoothing. We analytically marginalize the sparse GP posterior to derive a tractable drift-matching objective that accounts for both the posterior mean and uncertainty of the unknown drift. To handle irregular observations, we further introduce an irregular-time-aware variational state posterior that incorporates the actual observation times during both encoding and continuous-time marginal querying. Experiments on the stochastic Lorenz--63 system demonstrate substantially improved drift recovery and state reconstruction under irregular observations, while five system identification benchmarks show robust forecasting under increasing observation sparsity and competitive performance against existing latent-SDE and state-space methods.

0.29

Inference for stochastic differential equations driven by weighted sub-fractional Brownian motion using neural networks and the Euler approximation

cs.LG stat.ML ·2026-09-30 ·J. H. Ramirez-Gonzalez
unusual similarity 0.53
Abstract · 22 pages

We consider the estimation of drift, diffusion, and noise covariance from discrete observations of stochastic differential equations driven by Gaussian processes. For a fixed observation horizon $T>0$ and a known initial state $x_0\in\mathbb R$, we study \begin{equation*} dX_t=a(X_t)\,dt+σ(X_t)\,dZ_t^{β,f}, \qquad X_0=x_0,\quad 0\leq t\leq T. \end{equation*} \smallskip\noindent Here $a:\mathbb R\to\mathbb R$ is the drift coefficient, $σ:\mathbb R\to(0,\infty)$ is the diffusion coefficient, and $Z^{β,f}$ is a centered Gaussian process from the weighted sub-fractional Brownian family, with covariance \begin{equation*} \operatorname{Cov}(Z_s^{β,f},Z_t^{β,f}) =\int_0^{s\wedge t} f(r)q_β(s-r,t-r)\,dr, \qquad 0\leq s,t\leq T. \end{equation*} \smallskip\noindent Here $s\wedge t=\min\{s,t\}$. The temporal weight $f:[0,T]\to[0,\infty)$ is measurable, bounded, and positive almost everywhere, and $β\in(0,2)$ is the covariance exponent. For $u,v\geq0$, the kernel is $q_β(u,v)=[u^β+v^β-(u+v)^β]/(1-β)$ when $β\ne1$. Its continuous extension at $β=1$ is $q_1(u,v)=(u+v)\log(u+v)-u\log u-v\log v$, with $0\log0=0$. Using the Euler approximation, we reconstruct the Gaussian driving increments from observed transitions and use their joint density to obtain a trajectory likelihood. Neural and radial-basis representations model the drift, diffusion, and normalized temporal weight, while a likelihood profile estimates the covariance exponent and diffusion scale. We compare the method with two neural alternatives on the same simulated trajectories in twenty coefficient settings.

0.27

Steady-State Convergence of Stochastic Approximation

cs.LG stat.MLmath.OCmath.PR ·2026-09-14 ·Yixuan Zhang, Qiaomin Xie
similarity 0.53
Abstract · 56 pages, 7 figures

For constant-stepsize stochastic approximation (SA), the iterates converge in distribution to a stationary law that depends on the stepsize $α.$ Steady-state convergence (SSC) concerns the limit of the scaled stationary distribution as $α\downarrow 0.$ Existing SSC theory requires i.i.d. or additive noise and global differentiability of the mean operator, and yields suboptimal rates. We develop a unified SSC theory for constant-stepsize contractive SA driven by Markovian, multiplicative noise, covering both locally differentiable and locally nondifferentiable mean operators. A key methodological contribution is a multi-step universality framework that progressively reduces the original stochastic recursion to tractable auxiliary dynamics while preserving its steady-state limit. Under local quadratic linearization at the fixed point, we obtain a Gaussian approximation of the scaled steady state at the optimal rate $O(\sqrtα)$ in Wasserstein-2 distance, which further gives finite-time Gaussian approximations for the raw iterates. In the locally nondifferentiable regime, we establish a general SSC result and show that the leading-order asymptotic bias can be of order $\sqrtα$, in contrast to the $α$-order bias in the smooth regime. We apply the theory to Markovian linear SA and asynchronous Q-learning, neither of which is covered by prior results. We further propose a bias-reduction scheme for Q-learning that requires no knowledge of the local smoothness regime, validated by numerical experiments.

0.45

Stochastic Gradient Descent over P2

cs.LG stat.MLmath.PR ·2026-09-11 ·Maria Oprea, Qin Li, Yunan Yang
similarity 0.53
Abstract

Stochastic gradient descent (SGD) admits diffusion approximations that replace the complicated randomness of stochastic gradients by Gaussian noise, providing a powerful tool for understanding its dynamics and long-time behavior. We investigate whether an analogous approximation principle holds for optimization over probability measures, where the objective is a functional defined on the Wasserstein space P2. The nonlinear geometry and infinite-dimensional nature of P2 prevent a direct extension of the classical Euclidean theory. Using Lions differentiability, we lift the problem to a linear Hilbert space, where higher-order differential calculus becomes available. We then construct a Gaussian random-field approximation whose velocity field matches the mean and covariance of the original stochastic gradient. By exploiting this moment matching through higher-order Taylor expansions, we show that the Gaussian approximation captures the SGD dynamics with second-order weak accuracy. Our result provides a rigorous foundation for replacing sample-driven randomness by analytically tractable Gaussian fluctuations in stochastic optimization over probability measures.

0.24

On asymptotic stability of the time-varying Kalman filter for unstabilizable linear systems: an optimization perspective

eess.SY ·2026-09-16 ·James B. Rawlings, Titus Quah, Matthias A. Müller
similarity 0.52
Abstract

This paper establishes the necessary and sufficient conditions for asymptotic stability of the time-varying Kalman filter applied to a linear time invariant system with semidefinite initial state covariance and positive definite process and measurement noise. Rather than analyze the discrete Riccati equation as in the classic literature, the equivalent state smoothing optimization problem is stated and all results are established using properties of this optimization problem. A Lyapunov-like function, termed a modified $Q$-function is derived and used for this analysis. This optimization approach removes the need for the classic but cumbersome Riccati iteration algebra and provides better generalization and application for nonlinear systems.

0.22