CS Paper Radar

Minimum-Energy Control for Stochastic Linear Systems: A Data-Driven Approach with Finite-Sample Guarantees

Vaishnavi Sharma, Vaibhav Katewa

eess.SY math.OC ·submitted 2026-10-20 04:06 UTC · v2

Abstract

The open-loop minimum-energy control (MEC) problem asks for control inputs that minimize the control energy while ensuring the terminal state reaches a desired value. In this paper, we study the open-loop MEC problem for stochastic linear time-invariant systems. We consider a variety of stochastic constraints that enforce the terminal error to be small, and show that Stochastic MEC (SMEC) problem can be formulated as a QCQP. We obtain the optimal solution for SMEC and show that it generalizes the well-known Deterministic MEC problem by introducing novel stochastic variants of controllability and Gramian matrices. When the system dynamics is unknown, we obtain a direct data-driven solution to the SMEC problem using maximum-likelihood estimation and conformal calibration approaches. Finally, we quantify the sub-optimality and constraint violation of our data-driven solutions via finite-sample high-probability upper bounds, and highlight their dependence on the number of experiments, system dimension, and noise-to-signal ratio. We present numerical simulations to validate the theoretical results.

Closest papers

Nearest neighbours by meaning across the whole index.

Minimum-Energy Control for Stochastic Linear Systems

eess.SY math.OC ·2026-10-09 ·Vaishnavi Sharma, Vaibhav Katewa
theory similarity 0.87
Abstract

The open-loop minimum-energy control (MEC) problem asks for control inputs that minimize the control energy while ensuring the terminal state reaches a desired value. In this paper, we study the open-loop MEC problem for stochastic linear time-invariant systems. We consider a variety of stochastic constraints that enforce the terminal error to be \emph{small}, and show that Stochastic MEC (SMEC) problem can be formulated as a QCQP. We obtain the optimal solution for SMEC and show that it generalizes the well-known Deterministic MEC problem by introducing novel stochastic variants of controllability and Gramian matrices. Finally, we show that there exists a fundamental lower bound on the optimal control energy which cannot be overcome by increasing the time horizon of the problem.

0.44

Control-Gibbs Distribution: Sampling for Optimal Control and Diverse Actions

eess.SY ·2026-11-12 ·Shengling Shi
similarity 0.63
Abstract

While conventional optimal control selects an optimal input sequence, probabilistic control assigns probability mass over all possible inputs and exploits a distribution of control sequences. Control distributions help enable exploration, capture diverse solutions, and solve deterministic optimal control problems. This work reviews an important probabilistic model for control distributions, the control-Gibbs distribution, i.e., the Gibbs distribution with an optimal control objective as the energy function. We point out its fundamental role in various probabilistic control frameworks, e.g., maximum entropy control, control-as-inference framework, model predictive path integral control, and energy-based models for control. This provides a model-central perspective to unify these probabilistic control frameworks. We also review the associated extensions of dynamic programming for computing closed-loop control distributions. To sample the control-Gibbs distribution, we consider projected Langevin sampling and develop non-asymptotic guarantees. The guarantees show the dual benefits of sampling the control-Gibbs distribution: obtaining diverse control solutions and solving the deterministic optimal control problem. We provide a numerical example where diverse arm trajectories are sampled from a control-Gibbs distribution.

0.29

How suboptimal is my stochastic network controller allowed to be? Completion certificates with application to power grids hosting AI data centers

eess.SY math.DSphysics.soc-ph ·2026-10-02 ·Michael Chertkov
theory similarity 0.63
Abstract · 45 pages, 21 figures

Power grids are beginning to host AI data centers whose demand can change abruptly and in a correlated way, and operators and planners must decide whether existing controllers can absorb the resulting transients and where new flexibility is worth installing. We cast this as a question in stochastic control: how far from optimal is an implementable controller? For controlled diffusions with affine, state-independent actuation, additive and possibly degenerate noise and quadratic control cost, any Hamilton-Jacobi-Bellman (HJB) subsolution bounds the optimal cost from below and simulation bounds the deployed cost from above, so their gap certifies the permissible suboptimality. We construct subsolutions from path-integral control by completing the control geometry: enlarging the control Gramian until it matches the physical noise makes the problem linearly solvable, and its Feynman-Kac value is an automatic lower bound whose HJB residual is exactly the energy of the fictitious control. A dual noise-deflation construction can be tighter but requires a curvature condition. The geometry yields planning rules: price control authority in proportion to local noise variance, and use shadow values to guide sparse reinforcement. For nonlinear stochastic swing dynamics of the IEEE 118-bus system after a severe load loss, a simple generator controller is certified within 2.8% of optimal under homogeneous forcing; under heterogeneous forcing the gap is 39% with uniform prices and 1.2% once the same total authority is repriced, before any hardware is added.

0.24

Data-Driven Stochastic LQR Control with Probabilistic Guarantees and Uncertainty Refinement

eess.SY ·2026-11-03 ·Amir Modares, Themistoklis Charalambous, Hamidreza Modares
similarity 0.63
Abstract

This paper presents a probabilistic framework for the direct, data-driven synthesis of the stochastic linear- quadratic output-feedback control for linear systems sub- ject to process and measurement noise. Using delayed input-output measurements, we derive a lifted parameter- ization together with an equivalent lifted linear quadratic cost, enabling controller synthesis without explicitly identi- fying the lifted dynamics. Two complementary closed-loop formulations, based on trajectory and covariance represen- tations, are then developed, whose uncertainties depend only on the realized but unknown lifted noise. We char- acterize the relative performance of the two formulations in finite-data regimes. High-probability uncertainty bounds are developed for realized noises, leading to a convex optimization solution to the problem, whose feasibility cer- tifies probabilistic mean-square stability (p-MSS) and per- formance guarantees. To reduce conservatism, Gaussian zonotopes are used to refine uncertainty sets by elimi- nating noise realizations inconsistent with measured data, and a novel intersection rule enables the consistent fusion of data-driven and physics-informed information. These components are integrated into an adaptive framework that unifies indirect (identification-based) and direct (control- oriented) data-driven linear-quadratic output-feedback con- trol. Unlike existing direct data-driven LQR methods that verify stability a posteriori, our by-construction approach achieves robust stability alongside reduced conservatism and superior performance. Simulation results show that the proposed controller approaches the ideal optimal solution while outperforming existing data-driven methods under noisy measurements.

0.19

Stochastic Data-driven Predictive Control of Linear Systems with Sub-Gaussian Disturbances using Causal Predictors

eess.SY ·2026-09-22 ·Johannes Teutsch, Marion Leibold
published similarity 0.61
Abstract · This manuscript is a revised version of the article published in IFAC Journal of Systems and Control (2026), vol. 25, pp. 100399. It contain…

We present a stochastic data-driven predictive control (DPC) framework for discrete-time linear time-invariant systems subject to sub-Gaussian additive disturbances based solely on input--output data. In contrast to related methods that rely on exact disturbance data or at least sample generation for closed-loop guarantees, the proposed approach leverages a disturbance data estimate. By enforcing consistency of the disturbance data estimate with the available input--output data and system class, we first identify data-driven and provably causal subspace predictors for use in DPC. Then, we analyze statistical properties of the corresponding prediction error, yielding tightened constraints for the nominal predictions that guarantee satisfaction of chance constraints. The proposed DPC scheme comes with guarantees on recursive feasibility and conditional chance constraint satisfaction in closed-loop under standard assumptions. A numerical evaluation study demonstrates the performance of the proposed controller.

0.52

Optimal input design via Frank-Wolfe

eess.SY math.OC ·2026-09-08 ·Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
similarity 0.60
Abstract · 7 pages, 4 figures

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

0.28

On the suboptimality of stochastic MPC with varying constraint horizon

eess.SY math.OC ·2026-08-30 ·Allan Andre Do Nascimento, Andre Bertolace, Antonis Papachristodoulou, Kostas Margellos
publishedtheoryhot direction similarity 0.60
Abstract · Accepted for CDC 2026

Enforcing stochastic state constraints over the full prediction horizon in Model Predictive Control (MPC) can be computationally demanding. Here we study stochastic MPC without terminal ingredients in which chance constraints are enforced only over a shorter constraint horizon. Using stochastic relaxed dynamic programming, we derive an explicit upper bound on the average expected closed-loop cost that depends on both prediction and constraint horizons. For linear quadratic problems with affine chance constraints and bounded uniform disturbances, we provide a deterministic reformulation via coordinate transformation and constraint tightening. Simulations illustrate the trade-off between computational effort and performance.

0.38

A Bayesian Framework for Safe Optimal Control of Unknown Systems from Input-Output Data

eess.SY cs.LGmath.OC ·2026-11-02 ·Robert Lefringhausen, Annalena Daniels, Michael Fink, Sandra Hirche
code/data similarity 0.59
Abstract · 15 pages, 4 figures, 2 tables. Submitted to Automatica. Code available at https://github.com/TUM-ITR/PosteriorScenarioPlanning.jl

As control engineering is applied to increasingly complex systems, learning-based control, which uses empirical data to reduce the reliance on first-principles models, has emerged as a promising paradigm. However, such approaches must cope with nonlinear and stochastic dynamics, the absence of state measurements, and scarce data, while ensuring safe operation under constraints, which requires rigorous uncertainty quantification. Whereas existing methods treat these challenges in isolation, this article proposes a Bayesian framework that jointly addresses them. A prior in state-space form is updated from input-output data using particle Markov chain Monte Carlo methods, yielding a representation of joint uncertainty over dynamics and latent states. Building on this representation, a validation procedure is developed that provides probabilistic guarantees for constraint satisfaction under arbitrary causal control laws. For control synthesis, a formulation penalizing the conditional value-at-risk of the constraint function is proposed, together with an adaptive calibration mechanism that adjusts the performance-robustness trade-off to achieve a desired robustness level. The probability of successful certification is characterized theoretically. The framework is extended to a receding-horizon setting, where posterior updates from new measurements allow the controller to progressively reduce uncertainty and improve performance. The approach is demonstrated on the optimal control of a vertical farm.

0.42