CS Paper Radar

Feedback Stabilization for Sampled Linear Systems with Control-linear Noise

Cynthia Cheng, Xudong Chen

eess.SY math.OC ·submitted 2026-09-24 18:33 UTC · v3

Abstract

In this paper, we consider linear stochastic systems with control-linear noise and periodically sampled measurements. We address the problem of feedback stabilization in the mean-square sense. The main contribution of the paper is to provide a necessary and sufficient condition for feedback stabilization. In particular, we relate feedback stabilizability of the stochastic system to the existence of a fixed point of a Riccati-type algebraic equation and, further, to the existence of a solution to an infinite-horizon optimal control problem.

Closest papers

Nearest neighbours by meaning across the whole index.

Necessary and Sufficient Conditions for Adaptive Stabilizability of Continuous-Time Markov Jump Linear Stochastic Systems

eess.SY math.OC ·2026-10-25 ·Ziwei Guo
similarity 0.63
Abstract · 19 pages

The purpose of this paper is to provide a mathematically rigorous solution to a well-known problem in stochastic adaptive control, i.e., to find the weakest possible structural condition for global stabilizability of continuous-time Markov jump linear stochastic systems with known candidate modes but with an unobservable Markov parameter process. Under some regularity assumptions, it is shown that the necessary and sufficient condition for global adaptive stabilizability hinges on the solvability of the same coupled Riccati equations as in the non-adaptive case. This result highlights a fundamental difference between the continuous-time case considered here and the discrete-time case studied earlier by Xue and Guo (2001), in which the coupled Riccati equations for adaptive and non-adaptive stabilizability are different.

0.23

Infinite-Horizon Inverse Linear-Quadratic Differential Games with State- and Control-Dependent Noise

eess.SY ·2026-08-18 ·Lucas Günther, Karl Handwerker, Felix Thömmes, Balint Varga, Sören Hohmann
similarity 0.59
Abstract

This paper presents a method to solve the inverse problem for N-player infinite-horizon linear-quadratic (LQ) differential games with state- and control-dependent noise. For this stochastic setting, we derive necessary and sufficient conditions for linear feedback Nash equilibria, which take the form of coupled stochastic algebraic Riccati equations. We then derive a kernel representation of these equations to explicitly characterize the set of all cost function parameter combinations across players that are consistent with observed equilibrium trajectories, thereby solving the associated inverse problem. Numerical results illustrate the approach and confirm the theoretical findings, highlighting the inherent ambiguity of the inverse problem.

0.45

Addendum to "Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part II"

eess.SY math.OC ·2026-10-29 ·Yongxin Chen, Tryphon T. Georgiou, Michele Pavon
theory similarity 0.57
Abstract · 4 pages

We hereby fill in a gap in an induction argument used in the proof of a theorem on state-covariance controllability of linear stochastic systems in an earlier paper by the authors. The mathematical statement is true. The missing point in the proof concerns the assertion that, in the canonical single-input case, the control can be assigned arbitrary endpoint values. We amend the argument by proving a slightly stronger induction statement that permits arbitrary finite endpoint jets of the control. An independent approach to homogeneous state-covariance controllability was provided in a paper by Abdelgalil and Georgiou (2025) as a corollary of strong controllability results on $\GLp(n,\mathbb R)$, and shown herein that it extends to the case of additive noise as well.

0.30

On asymptotic stability of the time-varying Kalman filter for unstabilizable linear systems: an optimization perspective

eess.SY ·2026-09-16 ·James B. Rawlings, Titus Quah, Matthias A. Müller
similarity 0.57
Abstract

This paper establishes the necessary and sufficient conditions for asymptotic stability of the time-varying Kalman filter applied to a linear time invariant system with semidefinite initial state covariance and positive definite process and measurement noise. Rather than analyze the discrete Riccati equation as in the classic literature, the equivalent state smoothing optimization problem is stated and all results are established using properties of this optimization problem. A Lyapunov-like function, termed a modified $Q$-function is derived and used for this analysis. This optimization approach removes the need for the classic but cumbersome Riccati iteration algebra and provides better generalization and application for nonlinear systems.

0.22

A Frequency Domain Approach to Bounding Riccati Equation Perturbations

eess.SY math.OC ·2026-09-29 ·Rachel Newton, Laura Balzano, Peter Seiler
similarity 0.55
Abstract · 7 pages. Submitted to IEEE Control Systems Letters pending review

The discrete algebraic Riccati equation (DARE) is used to solve for the optimal feedback gain in linear-quadratic regulator (LQR) control of discrete-time systems. In this letter, we consider the effect of perturbations to the LQR data on the DARE solutions. We present a new frequency domain approach to derive an explicit bound on the difference in DARE solutions under such perturbations. Our bounds are similar to other results that have recently appeared in the literature with two distinctions. First, we use a frequency domain constant that measures the degree of closed-loop stability, in contrast to other results that use a time domain measure. Second, we start from weaker detectability assumptions on the LQR state cost matrix.

0.22

Stochastic Robust Linear W-infinity Control via Dynamic Output Feedback

eess.SY math.OC ·2026-08-18 ·Daniel Neri Cardoso, Guilherme Vianna Raffo
published similarity 0.54
Abstract · Accepted for publication at the 23rd IFAC World Congress (Busan, Korea)

This paper introduces a robust W-infinity optimal control framework for linear Itô diffusions using a weighted Sobolev-space performance measure. Because the sample paths of Itô diffusions are nondifferentiable, the formulation leverages the weak derivative of the expected state. An LMI-based semidefinite program is developed for dynamic output-feedback synthesis, and a rigorous stability analysis guarantees mean-square ultimate boundedness with minimized ultimate bound. A numerical example demonstrates that the proposed approach provides effective disturbance attenuation with fast transient performance.

0.35

On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

cs.LG stat.ML ·2026-11-02 ·Reza Sadeghi Hafshejani, Mohamad Kazem Shirani Faradonbeh
similarity 0.53
Abstract

System identification studies the canonical problem of reliably learning system-dynamics from state and input trajectories. One of its important applications consists of estimating a feedback gain matrix that can stabilize an unknown system. This paper focuses on the analysis of such adaptive stabilization schemes for multivariate linear time-invariant state-space models. The system instability practically renders trajectories short, i.e., the observed data is notably limited. So, it is crucial to tightly consider effects of \emph{all} involved quantities including length and number of trajectories, dimension, controllability Gramian, and signal-to-noise ratio. We put forward a simple, practical, and reliable relationship between the chance that adaptive stabilization (based on system identification) fails to stabilize the system, in terms of all the above-mentioned quantities. Our findings show that despite exponential effects of all other quantities on failure probability, such effects do not hold for signal-to-noise ratio. More specifically, this study shows that the strength of the excitation signal helps stabilization only \emph{logarithmically}; a very important phenomenon that we explain under the term \emph{signal saturation}.

0.29

Reinforcement learning for constrained stochastic linear--quadratic control in continuous time

cs.LG math.OC ·2026-10-26 ·Weiping Wu, Qitong Pan, Xun Li, Peng Wu
similarity 0.53
Abstract

We study continuous-time stochastic linear--quadratic control with a scalar state and nonnegative control constraints. With quadratic running costs, randomized exploration can change the optimal mean feedback. We introduce an auxiliary problem without entropy in which the conditional policy mean is nonnegative and the covariance is prescribed in proportion to the squared state. Moment reduction and state separation yield two regional Riccati equations and characterize the finite-horizon value function and optimal conditional mean. We give a sufficient control--cost compatibility condition under which this mean coincides with the optimal feedback of the original constrained problem. For time-invariant coefficients, we characterize the undiscounted infinite-horizon optimum and establish mean square asymptotic stability under the stated assumptions. For unknown dynamics, we develop model-free actor--critic schemes for finite and infinite horizons. Numerical experiments compare the learned policies with their analytical targets and examine the effect of exploration on the optimal mean.

0.25