CS Paper Radar

Direct and Indirect Data-Driven Control with Prior Information about the Equilibrium Manifold

Yi-Chun Liao, Valentina Breschi, Marco M. Nicotra

eess.SY ·submitted 2026-09-24 01:00 UTC · v1
published

Abstract

By hinging on the assumption that a system to be controlled is fully unknown, many data-driven control approaches do not leverage available or readily inferable priors. In contrast to this viewpoint, this paper analyzes the impact of using the system's equilibrium subspace to inform direct and indirect linear quadratic regulation. For the indirect case, we show how including a constraint on the equilibrium subspace in the identification problem changes the statistical properties of the learned model. In particular, we show that enforcing consistency with respect to the equilibrium subspace leads to a reduction in the estimator variance that, in turn, enhances model-based control performance. In the direct case, we show how this prior can be leveraged to gain insight into the controlled system without requiring an explicit identification step. These results are supported by both numerical and experimental evidence, showcasing the advantages of explicitly leveraging the equilibrium manifold as a prior in data-driven control.

Comment
Accepted at the 65th IEEE Conference on Decision and Control (CDC 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Generalization as a robust performance property of learning-enabled dynamical systems

eess.SY cs.LGmath.OC ·2026-08-31 ·Filippo Fabiani
similarity 0.64
Abstract

By focusing on algorithmic stability as a means of establishing out-of-sample bounds, we provide a system-theoretic interpretation of generalization in learning-enabled dynamical systems arising in data-driven optimization and feedback control approximation. Given two neighboring datasets, we specifically model sample replacement as an exogenous disturbance acting on a sensitivity system, while the incremental behavior of the data-dependent operator is encoded through an integral quadratic constraint. By relying on dissipativity arguments, we establish a matrix inequality-based certificate and a uniform stability bound that separates the one-sample sensitivity of the learned operator, and an algorithm-dependent dynamical gain. The latter can then be optimized, offering a tractable tool for certifying and comparing generalization capabilities of learning dynamics. We show that our results recover classical ones for gradient descent, apply naturally to momentum-based methods such as heavy-ball and Nesterov acceleration, and extend to data-driven control.

0.20

Data-Driven Hamiltonian for Neural Optimal Control

eess.SY ·2026-10-26 ·Christopher A. Strong, Aswin Surya, Namhoon Cho, Jason J. Choi, Claire J. Tomlin
benchmark similarity 0.62
Abstract · 21 pages, 9 figures

Reinforcement learning (RL) has emerged as a prominent data-driven approach to optimal control, but often requires substantial amounts of data and provides limited guarantees when encountering out-of-distribution state-action pairs. In this paper, we propose an alternative approach grounded in the well-established Hamilton-Jacobi framework in optimal control theory. Rather than requiring an explicit analytical model of the system dynamics to evaluate the Hamiltonian, we replace this with a data-driven Hamiltonian (DDH), which we generalize to a broad class of optimal control problems. In contrast to standard RL approaches, the DDH provides a principled mechanism, requiring only minimal prior system information such as a Lipschitz constant, for quantifying and accounting for uncertainty in regions not covered by the data, enabling the derivation of controllers with performance guarantees. Additional prior system knowledge, when available, can be readily incorporated to improve performance. For high-dimensional systems, we further introduce a physics-informed neural approximation of the value function, trained using a novel procedure that generates worst-case fictitious rollouts evaluated through the DDH. On an LQR problem, the DDH reaches near-optimal cost on every dataset we test, including random data on which offline RL methods remain far from optimal, and needs far fewer samples than online RL. On a nonlinear lunar lander benchmark, the DDH achieves an optimality gap to a trajectory-optimization reference more than $3\times$ smaller than CQL and FQL, and matches the performance of SAC with approximately $37\times$ fewer samples. These results establish the DDH as a promising framework for data-driven optimal control, particularly in settings where available data are limited in quantity or quality.

0.33

Weak and Strong Data Informativity with Structural Priors for System Analysis

eess.SY ·2026-10-28 ·Yuan Zhang, Wenxuan Xu, Yun Feng, Keke Huang, Keyou You
similarity 0.61
Abstract

When measurement data are insufficient for unique system identification, data informativity evaluates whether a dataset determines a property across all systems consistent with the data. This paper introduces a unified framework distinguishing between weak and strong data informativity under prior structural knowledge described by affine constraints: data are weakly informative if at least one system consistent with the data and prior knowledge possesses the target property, and strongly informative if every consistent system satisfies it. The latter is consistent with the notion of data informativity in the existing literature. By explicitly parameterizing all consistent systems as affine functions of free parameters via the Moore-Penrose pseudoinverse, we characterize these notions for fundamental system properties-including controllability, stabilizability, and stability. This formulation establishes that verifying weak and strong informativity, when tractable, reduces to rank tests of matrix pencils constructed from the data and prior knowledge. Our findings show that structural priors can lower data-excitation requirements and enable reliable analysis even when data fail to be strongly informative. Finally, the framework is extended to a class of noisy data.

0.32

Learning neural controllers for nonlinear systems from data

eess.SY ·2026-08-29 ·Zhongjie Hu, Zhi-Wei Liu, Chen Wang
similarity 0.60
Abstract

This article addresses the problem of designing neural feedback controllers for unknown nonlinear systems. We propose an indirect data-driven framework that uses offline data to identify the system dynamics, upon which a neural feedback controller and a neural Lyapunov function are jointly synthesized. Input constraints are enforced by integrating a hard-saturation structure into the controller architecture. Robust synthesis conditions are derived to account for data perturbations during identification. Formal stability is certified by combining SMT verification with local Lyapunov analysis near the equilibrium. Numerical examples validate the effectiveness of the proposed framework.

0.22

Stochastic Data-driven Predictive Control of Linear Systems with Sub-Gaussian Disturbances using Causal Predictors

eess.SY ·2026-09-22 ·Johannes Teutsch, Marion Leibold
published similarity 0.60
Abstract · This manuscript is a revised version of the article published in IFAC Journal of Systems and Control (2026), vol. 25, pp. 100399. It contain…

We present a stochastic data-driven predictive control (DPC) framework for discrete-time linear time-invariant systems subject to sub-Gaussian additive disturbances based solely on input--output data. In contrast to related methods that rely on exact disturbance data or at least sample generation for closed-loop guarantees, the proposed approach leverages a disturbance data estimate. By enforcing consistency of the disturbance data estimate with the available input--output data and system class, we first identify data-driven and provably causal subspace predictors for use in DPC. Then, we analyze statistical properties of the corresponding prediction error, yielding tightened constraints for the nominal predictions that guarantee satisfaction of chance constraints. The proposed DPC scheme comes with guarantees on recursive feasibility and conditional chance constraint satisfaction in closed-loop under standard assumptions. A numerical evaluation study demonstrates the performance of the proposed controller.

0.52

A Two-Stage, Model-Based Reinforcement Learning Approach for Active Flow Control of Bluff Body Wakes

eess.SY ·2026-09-08 ·Aayushman Sharma, Suman Chakravorty
hot direction similarity 0.59
Abstract · 9 pages, 7 figures

This paper develops a data-driven, output-feedback approach to the infinite-horizon optimal control of high-dimensional nonlinear systems with unknown and unstable equilibria, using sparse partial observations. The approach builds on the transfer-plus-regulation decomposition of the infinite-horizon problem: a finite-horizon nonlinear transfer drives the system into a region where the dynamics are well-approximated by a linear model about the unknown operating point, and an infinite-horizon linear regulator identified within that region completes stabilization. We extend this framework to the partially observed setting by combining an ARMA-based information-state construction with a two-stage control architecture: an iterative linear quadratic regulator (iLQR) approach on the information state drives the system to the equilibrium neighborhood, discovered implicitly without prior knowledge of the target, and a locally identified time-invariant ARMA model provides the infinite-horizon regulator for asymptotic stabilization. The method requires no adjoint solver, reduced-order model, or full-state access. We validate the approach on high-fidelity Navier-Stokes simulations of the cylinder wake at $\mathrm{Re}=100$ using only eight surface pressure sensors, an order of magnitude fewer than recent model-based RL methods. The controller achieves complete suppression of vortex-shedding-induced lift oscillations and a $44\%$ reduction in total drag relative to the uncontrolled baseline.

0.37

Optimal input design via Frank-Wolfe

eess.SY math.OC ·2026-09-08 ·Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
similarity 0.59
Abstract · 7 pages, 4 figures

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

0.28

A Bayesian Framework for Safe Optimal Control of Unknown Systems from Input-Output Data

eess.SY cs.LGmath.OC ·2026-11-02 ·Robert Lefringhausen, Annalena Daniels, Michael Fink, Sandra Hirche
code/data similarity 0.58
Abstract · 15 pages, 4 figures, 2 tables. Submitted to Automatica. Code available at https://github.com/TUM-ITR/PosteriorScenarioPlanning.jl

As control engineering is applied to increasingly complex systems, learning-based control, which uses empirical data to reduce the reliance on first-principles models, has emerged as a promising paradigm. However, such approaches must cope with nonlinear and stochastic dynamics, the absence of state measurements, and scarce data, while ensuring safe operation under constraints, which requires rigorous uncertainty quantification. Whereas existing methods treat these challenges in isolation, this article proposes a Bayesian framework that jointly addresses them. A prior in state-space form is updated from input-output data using particle Markov chain Monte Carlo methods, yielding a representation of joint uncertainty over dynamics and latent states. Building on this representation, a validation procedure is developed that provides probabilistic guarantees for constraint satisfaction under arbitrary causal control laws. For control synthesis, a formulation penalizing the conditional value-at-risk of the constraint function is proposed, together with an adaptive calibration mechanism that adjusts the performance-robustness trade-off to achieve a desired robustness level. The probability of successful certification is characterized theoretically. The framework is extended to a receding-horizon setting, where posterior updates from new measurements allow the controller to progressively reduce uncertainty and improve performance. The approach is demonstrated on the optimal control of a vertical farm.

0.42