CS Paper Radar

Addendum to "Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part II"

Yongxin Chen, Tryphon T. Georgiou, Michele Pavon

eess.SY math.OC ·submitted 2026-10-29 19:08 UTC · v1
theory

Abstract

We hereby fill in a gap in an induction argument used in the proof of a theorem on state-covariance controllability of linear stochastic systems in an earlier paper by the authors. The mathematical statement is true. The missing point in the proof concerns the assertion that, in the canonical single-input case, the control can be assigned arbitrary endpoint values. We amend the argument by proving a slightly stronger induction statement that permits arbitrary finite endpoint jets of the control. An independent approach to homogeneous state-covariance controllability was provided in a paper by Abdelgalil and Georgiou (2025) as a corollary of strong controllability results on $\GLp(n,\mathbb R)$, and shown herein that it extends to the case of additive noise as well.

Comment
4 pages

Closest papers

Nearest neighbours by meaning across the whole index.

Feedback Stabilization for Sampled Linear Systems with Control-linear Noise

eess.SY math.OC ·2026-09-24 ·Cynthia Cheng, Xudong Chen
similarity 0.57
Abstract

In this paper, we consider linear stochastic systems with control-linear noise and periodically sampled measurements. We address the problem of feedback stabilization in the mean-square sense. The main contribution of the paper is to provide a necessary and sufficient condition for feedback stabilization. In particular, we relate feedback stabilizability of the stochastic system to the existence of a fixed point of a Riccati-type algebraic equation and, further, to the existence of a solution to an infinite-horizon optimal control problem.

0.22

Mean-covariance turnpikes in Wasserstein distributionally robust linear-quadratic control

eess.SY math.OC ·2026-08-27 ·Yanzhi Wu, Zhengping Ji
theory similarity 0.55
Abstract

We study long-horizon Wasserstein-penalized minimax control for discrete-time stochastic linear systems with empirical disturbance data, in which adversarial disturbance distributions induce time-varying mean and covariance dynamics, making standard turnpike arguments not directly applicable. For possibly uncentered data, we characterize the generally nonzero mean reference through a reduced convex-concave Hamiltonian saddle problem. We prove horizon-uniform, two-sided exponential turnpike estimates for the mean state, adjoint, control, worst-case disturbance mean, and closed-loop covariance, showing that they spend the majority of time near static references when the horizon is long. We further construct a hybrid policy combining time-independent affine feedback with finite-horizon steering over a terminal layer, proving that its worst-case cost gap decays exponentially with the terminal-layer length uniformly in the horizon, which helps reducing the computation cost for long-horizon robust controls. Numerical examples illustrate the estimates and their dependence on the Wasserstein penalty.

0.19

Benign Geometry and Distributional Robustness of $\mathcal{H}_2$ Synthesis

eess.SY math.OC ·2026-09-21 ·Arman Sharifi Kolarijani, Peyman Mohajerin Esfahani, Tamás Keviczky, Mohamad Amin Sharifi Kolarijani
similarity 0.53
Abstract

In this paper, we study standard and distributionally robust $\mathcal{H}_2$ synthesis problem of a stabilizing state-feedback controller for discrete-time linear time-invariant systems. Without requiring a nonsingular disturbance controllability Gramian or a positive-definite control penalty, we establish that stationarity of a stabilizing gain in standard $\mathcal{H}_2$ synthesis is equivalent to global optimality and derive an exact Pythagorean identity for the performance difference. We then generalize the $\mathcal{H}_2$ synthesis problem by considering i.i.d. disturbances with zero mean and uniformly bounded second moments, and extend the stationarity-optimality equivalence to the corresponding distributionally robust $\mathcal{H}_2$ synthesis. Moreover, we show that every standard $\mathcal{H}_2$-optimal gain is simultaneously optimal for every such distributionally robust problem. Finally, we specialize the framework to Frobenius, Kullback--Leibler, and Wasserstein-2 ambiguity sets and obtain explicit characterizations of their worst-case covariances, which, in turn, provide performance certificates for a common optimal controller.

0.20

Continuous-Time Covariance Steering with Common Free-Final Time: Finite-Horizon Solutions and Infinite-Horizon Limits

eess.SY math.OC ·2026-08-10 ·Akan Selim, Fengjiao Liu, Siddhartha Ganguly, Panagiotis Tsiotras
similarity 0.53
Abstract · 38 pages, submitted to a journal

This article studies the optimal common free-final time problem for steering the state covariance of a continuous-time stochastic linear system between prescribed initial and terminal covariance matrices. We first establish a deterministic reformulation of the SDE-constrained free-final time stochastic optimal control problem (SOCP). For the ensuing SOCP, we provide necessary conditions for optimality and establish sufficient conditions for the optimal common final time to be finite. Subsequently, we characterize the asymptotic behavior of the finite-horizon optimal solutions as the final time tends to infinity, the invariant sets and trajectories associated with this limiting regime, and derive the sensitivity of the Hamiltonian with respect to the common final time. Finally, leveraging these sensitivities, we develop a trust-region line-search algorithm together with an infinite-horizon case detection method, and demonstrate its performance on three different problems: (a) an illustrative covariance-steering example, (b) a demonstration of spacecraft maneuver using covariance control, and (c) Gaussian mixture to Gaussian mixture steering.

0.41

Polynomial Invariants for Probabilistic Transition Systems with Unbounded Support

cs.LO ·2026-09-02 ·Anne Schreuder, Lorenz Winkler, Laura Kovács, C. -H. Luke Ong
publishedtheory similarity 0.52
Abstract · 16 pages + 19 pages appendix, extended version of submission accepted at LPAR'26

We study the synthesis of polynomial invariants for probabilistic transition systems (PTS) based on martingale theory. We present tractable methods to verify that such polynomials are indeed invariants, in the sense that their expected value upon termination is the same as their value at the start of the computation. We do this by applying the Optional Stopping Theorem (OST) in the form of a specific precondition. This precondition requires the existence of an integrable dominating function for the martingale expression, which implies uniform integrability; we refer to this condition as dui. For linear PTS we simplify the dui property to proving finiteness of the expected value of an expression depending on the update matrix, the degree of the martingale expression, and the stopping time. Specifically, if all random samples have finite moments and we can verify a moment bound on the runtime of a linear loop, then we can automatically synthesise polynomial loop invariants that satisfy the OST. Notably, dui allows for the sampled distributions to have unbounded support, which is a novel contribution to the field.

0.40

On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

cs.LG stat.ML ·2026-11-02 ·Reza Sadeghi Hafshejani, Mohamad Kazem Shirani Faradonbeh
similarity 0.52
Abstract

System identification studies the canonical problem of reliably learning system-dynamics from state and input trajectories. One of its important applications consists of estimating a feedback gain matrix that can stabilize an unknown system. This paper focuses on the analysis of such adaptive stabilization schemes for multivariate linear time-invariant state-space models. The system instability practically renders trajectories short, i.e., the observed data is notably limited. So, it is crucial to tightly consider effects of \emph{all} involved quantities including length and number of trajectories, dimension, controllability Gramian, and signal-to-noise ratio. We put forward a simple, practical, and reliable relationship between the chance that adaptive stabilization (based on system identification) fails to stabilize the system, in terms of all the above-mentioned quantities. Our findings show that despite exponential effects of all other quantities on failure probability, such effects do not hold for signal-to-noise ratio. More specifically, this study shows that the strength of the excitation signal helps stabilization only \emph{logarithmically}; a very important phenomenon that we explain under the term \emph{signal saturation}.

0.29

Distribution Steering via Sliced Optimal Transport Control

cs.LG math.OCeess.SYstat.ML ·2026-08-13 ·Kaito Ito, Anqi Dong
similarity 0.52
Abstract · 39 pages

Distribution steering seeks feedback laws that drive the state law of a dynamical system between prescribed initial and terminal distributions. Optimal transport provides a natural geometric approach, but its implementation generally requires a transport map or coupling in the full state space. Sliced optimal transport avoids this full-dimensional construction through one-dimensional projections. Yet, the resulting projected maps specify only directional displacements and do not by themselves prescribe a realizable feedback law. To this end, we develop a finite-horizon control framework based on sliced optimal transport. At each sampling instant, a projected optimal transport map defines a directional terminal condition, whose minimum-energy realization yields a randomized single-direction controller. Averaging over projection directions gives a deterministic sliced feedback. For the single-integrator dynamics, the averaged feedback makes the sliced Wasserstein distance to the target non-increasing. For Gaussian endpoint laws, it is affine, preserves Gaussianity, and steers the mean and covariance to their prescribed terminal values. We further identify a law-dependent gain that yields linear decay of the sliced Wasserstein distance together with an explicit characterization of the control energy. We also prove that the randomized controller converges to the averaged sliced flow as the sampling period vanishes. Finally, we extend the construction to linear dynamical systems. Reachability-normalized coordinates allow instantaneous realization of the sliced velocity for uniformly fully actuated systems, while local controllability Gramians provide exact finite-step realization for general controllable systems. Numerical examples illustrate the resulting distributional flows.

0.10

Discrete-Time Stochastic Control Beyond i.i.d. Noise

eess.SY math.OC ·2026-11-10 ·Reyajul Hasan Leon, Ali Devran Kara
similarity 0.51
Abstract

We study discrete-time stochastic control problems where the noise driving the state dynamics is a stationary infinite-order chain rather than an i.i.d. sequence. We formulate the problem as a controlled Markov process by enlarging the state space to include the posterior distribution of the noise given the state-action history. Assuming that the sensitivity of the noise transition kernel to past noise values decays exponentially, we show that the expected total variation distance between the full-history and finite-memory noise filters decays at rate $\sqrt{N}ρ^{\sqrt{N}}$. We use this result to construct finite-memory control models and establish explicit near-optimality bounds for their policies. Finally, under suitable ergodicity conditions, we show that Q-learning converges to the optimal solution of the approximate model, so the same performance bounds apply to the learned policies.

0.26