CS Paper Radar

Data-Driven Stochastic LQR Control with Probabilistic Guarantees and Uncertainty Refinement

Amir Modares, Themistoklis Charalambous, Hamidreza Modares

eess.SY ·submitted 2026-11-03 19:28 UTC · v2

Abstract

This paper presents a probabilistic framework for the direct, data-driven synthesis of the stochastic linear- quadratic output-feedback control for linear systems sub- ject to process and measurement noise. Using delayed input-output measurements, we derive a lifted parameter- ization together with an equivalent lifted linear quadratic cost, enabling controller synthesis without explicitly identi- fying the lifted dynamics. Two complementary closed-loop formulations, based on trajectory and covariance represen- tations, are then developed, whose uncertainties depend only on the realized but unknown lifted noise. We char- acterize the relative performance of the two formulations in finite-data regimes. High-probability uncertainty bounds are developed for realized noises, leading to a convex optimization solution to the problem, whose feasibility cer- tifies probabilistic mean-square stability (p-MSS) and per- formance guarantees. To reduce conservatism, Gaussian zonotopes are used to refine uncertainty sets by elimi- nating noise realizations inconsistent with measured data, and a novel intersection rule enables the consistent fusion of data-driven and physics-informed information. These components are integrated into an adaptive framework that unifies indirect (identification-based) and direct (control- oriented) data-driven linear-quadratic output-feedback con- trol. Unlike existing direct data-driven LQR methods that verify stability a posteriori, our by-construction approach achieves robust stability alongside reduced conservatism and superior performance. Simulation results show that the proposed controller approaches the ideal optimal solution while outperforming existing data-driven methods under noisy measurements.

Closest papers

Nearest neighbours by meaning across the whole index.

Data-Driven LQR with Uncertainty Refinement and Domain Randomization---Part~II: Fisher-Majorized Certified Policy Iteration

eess.SY ·2026-10-24 ·Hamidreza Modares
theory similarity 0.65
Abstract

Building on the uncertainty description developed in Part~I, this paper introduces a Fisher-majorized domain-randomized generalized policy iteration framework for data-driven linear quadratic regulator (LQR) synthesis. At each iteration, partial Bellman evaluation over a fixed batch of uncertainty realizations produces a structured Sylvester policy-improvement step. A residual-weighted Fisher curvature controls the policy-induced variation in the stationary covariance and converts the Sylvester model into a certified upper bound on the cost change, thereby guaranteeing descent for every accepted step. A check-and-correct mechanism then certifies stability over the entire uncertainty support, rather than only over the sampled realizations. Consequently, every iterate is robustly stabilizing and monotonically decreases the fixed-batch objective. The Fisher truncation and stability correction become inactive after finitely many times. The objective gap then contracts linearly to a floor determined by the dispersion of the realization-wise Riccati targets and by measurement noise. In the absence of measurement noise, this floor vanishes when the realization-wise targets coincide.

0.30

Minimum-Energy Control for Stochastic Linear Systems: A Data-Driven Approach with Finite-Sample Guarantees

eess.SY math.OC ·2026-10-20 ·Vaishnavi Sharma, Vaibhav Katewa
similarity 0.63
Abstract

The open-loop minimum-energy control (MEC) problem asks for control inputs that minimize the control energy while ensuring the terminal state reaches a desired value. In this paper, we study the open-loop MEC problem for stochastic linear time-invariant systems. We consider a variety of stochastic constraints that enforce the terminal error to be small, and show that Stochastic MEC (SMEC) problem can be formulated as a QCQP. We obtain the optimal solution for SMEC and show that it generalizes the well-known Deterministic MEC problem by introducing novel stochastic variants of controllability and Gramian matrices. When the system dynamics is unknown, we obtain a direct data-driven solution to the SMEC problem using maximum-likelihood estimation and conformal calibration approaches. Finally, we quantify the sub-optimality and constraint violation of our data-driven solutions via finite-sample high-probability upper bounds, and highlight their dependence on the number of experiments, system dimension, and noise-to-signal ratio. We present numerical simulations to validate the theoretical results.

0.28

Stochastic Data-driven Predictive Control of Linear Systems with Sub-Gaussian Disturbances using Causal Predictors

eess.SY ·2026-09-22 ·Johannes Teutsch, Marion Leibold
published similarity 0.61
Abstract · This manuscript is a revised version of the article published in IFAC Journal of Systems and Control (2026), vol. 25, pp. 100399. It contain…

We present a stochastic data-driven predictive control (DPC) framework for discrete-time linear time-invariant systems subject to sub-Gaussian additive disturbances based solely on input--output data. In contrast to related methods that rely on exact disturbance data or at least sample generation for closed-loop guarantees, the proposed approach leverages a disturbance data estimate. By enforcing consistency of the disturbance data estimate with the available input--output data and system class, we first identify data-driven and provably causal subspace predictors for use in DPC. Then, we analyze statistical properties of the corresponding prediction error, yielding tightened constraints for the nominal predictions that guarantee satisfaction of chance constraints. The proposed DPC scheme comes with guarantees on recursive feasibility and conditional chance constraint satisfaction in closed-loop under standard assumptions. A numerical evaluation study demonstrates the performance of the proposed controller.

0.52

Robust Data-Driven Output Feedback for Systems With Unknown Input Delays

eess.SY ·2026-10-31 ·Ngoc Tuan Dinh, Ba Huy Nguyen, Alexey Peregudin, Egor Dogadin
similarity 0.60
Abstract · 6 pages, 1 figure. Submitted jointly to IEEE Control Systems Letters (L-CSS)

In a history-feedback realization, an input delay increases memory without increasing the number of unknown physical coefficients. We use this structure to design output-feedback controllers for discrete-time systems with one input, one output, and known undelayed order, using noisy input-output data. For a known delay, we derive a necessary and sufficient linear matrix inequality for common-quadratic stabilization of all models consistent with the data. Optimizing its equation-error bound gives a robustness margin for the measured record. For an unknown constant delay in a known interval, we characterize noiseless delay ambiguity and give a sufficient condition for one controller to stabilize all models for every delay consistent with the error bound. Under stated excitation and nondegeneracy assumptions, this procedure is feasible for all sufficiently small equation errors. Numerical examples compare robustness at equal controller memory and show that certified stabilization can succeed while distinct delay models remain compatible with the same data.

0.31

Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements

cs.RO eess.SY ·2026-09-02 ·Guanhua Liu, Tong Wu, Lixian Zhang, Weifeng Du, Minghao Han
similarity 0.59
Abstract

Intermittent state measurements pose fundamental challenges to model predictive control of constrained nonlinear systems because prediction uncertainty grows during feedback outages and measurement-triggered resets disrupt nominal state propagation, potentially compromising closed-loop stability and recursive feasibility. This paper develops a Koopman-based stochastic MPC framework with probabilistically truncated soft constraints. Specifically, a Lipschitz-constrained deep Koopman model provides a linear latent predictor, enabling computationally efficient online optimization. The intermittent measurement process is modeled as a two-mode discrete-time Markov chain, yielding a unified Markov jump error model for open-loop propagation and measurement-triggered resets. Under numerically verifiable sufficient conditions, the prediction error is shown to be mean-square ultimately bounded, and an explicit uniform second-moment bound is obtained. A distribution-free probabilistic error radius is then constructed for a prescribed confidence level and used to truncate dropout-dependent constraint tightening. An exact-penalty soft-constraint mechanism accommodates reset-induced jumps and prolonged dropouts. Under the stated terminal compatibility and bounded-disturbance conditions, recursive feasibility and mean-square ultimate boundedness of the closed-loop regulation error are established. Numerical simulations on a visual-servoing tracking task corroborate these theoretical results and demonstrate effective tracking under stochastic measurement unavailability.

0.21

Data-Driven Synthesis of Robust Positively Invariant Sets: From State Feedback to Output Feedback

eess.SY ·2026-08-24 ·Zhijie Ning
similarity 0.58
Abstract · 9 pages, 4 figures, 1 table

This paper develops a direct data-driven framework for robust positively invariant (RPI) set synthesis for unknown linear time-invariant systems under state-feedback and observer-based output-feedback scenarios. The feedback and observer gains, along with the RPI sets, are directly synthesized from noisy offline data by solving semidefinite programs (SDPs), avoiding intermediate model identification or explicit model-uncertainty set construction. In the state-feedback case, a linear-quadratic (LQ)-type feedback gain is first computed, and an ellipsoidal RPI set is then synthesized for the resulting closed-loop dynamics. In the observer-based output-feedback case, offline data are used to compute the observer gain and the corresponding RPI set for the system state through an augmented-state formulation. This design provides a unified method for invariant-set computation in both scenarios, and the direct data-driven formulation avoids the explicit construction and propagation of an intermediate model-uncertainty set. Numerical examples illustrate the effectiveness of the proposed method.

0.27

Robust Control Design for LTI Systems with Sampling-Time Jitter

eess.SY ·2026-11-12 ·Dieter Schwarzmann, Jan Lunze
similarity 0.58
Abstract · Submitted to ECC2027

Sampling-time jitter makes a sampled-data control loop time-varying, so standard LTI robust-control synthesis does not apply directly. This paper reformulates dynamic output feedback design under bounded, unmeasured sample-to-sample jitter as a robust-control problem. The exact zero-order-hold model is decomposed into a nominal time-invariant plant and a memoryless, time-varying uncertainty block with a norm bound representing the sampling-time jitter. As the block is memoryless, the operator small-gain condition for the time varying loop reduces to a standard robustness test with a matrix norm bound. It is shown that the same test also guarantees uniform exponential stability for every admissible jitter sequence. Embedding the decomposition into a generalized plant with performance channels serves two synthesis objectives with standard robust-control tools: Robust stability with optimized nominal performance through structured H-inf synthesis, and robust performance through mu synthesis with constant scalings. A numerical example shows that jitter can destabilize a control loop with a nominal H-inf controller, whereas both robust designs remain stable and the robust-performance design is less sensitive to jitter at the cost of nominal performance.

0.24

Distributionally Robust Indirect-Feedback Stochastic MPC with Gelbrich Ambiguity Sets

eess.SY math.OC ·2026-11-10 ·Jiaxun Sun, Riccardo Cescon, Marcell Bartos, Melanie N. Zeilinger
similarity 0.58
Abstract · 6 pages, 2 figures, 1 table. Submitted to the 2027 European Control Conference (ECC)

Stochastic model predictive control uses disturbance statistics to set safety margins. Errors in these statistics can invalidate the safety guarantees. This paper therefore describes the uncertainty in the disturbance mean and covariance by a prescribed Gelbrich ambiguity set. This contains distributions of any shape whose moments are close in the Gelbrich distance to the nominal values, including distributions with unbounded support. For linear time-invariant systems with additive disturbances, we build on the indirect feedback paradigm, propagate this moment uncertainty along the error dynamics, and obtain a closed-form constraint tightening that is computed offline. Robustness enters as a single additive term that grows with the size of the ambiguity set, so the online problem remains a quadratic program. Recursive feasibility and closed-loop satisfaction of conditional value-at-risk (CVaR) constraints hold for every disturbance distribution in the set. We illustrate the method on a linearized planar quadrotor.

0.30