CS Paper Radar

Active Informativity: Online Input Design for Data-Driven Control

Yishu Wang, Paolo Rapisarda, Jianquan Lu, Yang Liu

eess.SY ·submitted 2026-09-29 14:30 UTC · v1

Abstract

We develop a unified framework for online input design in data-driven control from noisy data. We introduce a performance measure and analyze how such quality measure changes as new data are added. Based on such analysis we propose an online method for selecting inputs that ensures that data quality does not decrease over time. We demonstrate the validity of our approach by formulating six common noisy data-driven control problems in our framework, and by solving numerical examples for three of them.

Closest papers

Nearest neighbours by meaning across the whole index.

Operator-based data embedding for data-driven control of continuous-time systems from noisy data

eess.SY math.OC ·2026-08-18 ·Masashi Wakaiki
theory similarity 0.58
Abstract · 24 pages

We propose a data-driven method for designing state-feedback gains that achieve stabilization, $H_2$-control, and $H_\infty$-control for continuous-time systems. The state-input data are assumed to be corrupted by process noise, measurement noise, and input disturbances. We first characterize the set of all systems consistent with the noisy data using operator-based data embedding. This characterization yields necessary and sufficient conditions for data informativity under a certain class of noise. These conditions are formulated as linear matrix inequalities, and the feedback gains are constructed from their solutions. To enable direct controller design from noisy sampled data for continuous-time systems, we also obtain an upper bound on the reconstruction error of continuous-time signals.

0.28

Safe Performance-aware Online Input Design

eess.SY ·2026-11-09 ·Diyou Liu, Mohammad Khosravi
similarity 0.56
Abstract

In this paper, we propose an input design framework for the safe online excitation and identification of uncertain linear systems without requiring informative initial data. The objective is to actively excite the system and collect sufficiently informative input-output data while maintaining safe operation and satisfactory control performance. Achieving this objective is challenging due to the potential conflict between the excitation required for learning and the safety and performance requirements, particularly when limited prior knowledge of the system is available. Inspired by the dual control principle, the proposed scheme balances exploitation for control performance with exploration for model improvement. A Bayesian learning approach is employed to update the model uncertainty online, starting from a conservative initial uncertainty set. As informative data are collected, the uncertainty set contracts, enabling progressively less conservative operation. To reduce the online computational burden, the resulting program is reformulated into a computationally tractable form. Furthermore, an online ellipsoidal terminal set with non-increasing conservatism is designed to guarantee the recursive feasibility of the proposed scheme. Numerical experiments are conducted to demonstrate the effectiveness of the proposed framework, particularly in terms of uncertainty reduction and control performance.

0.21

Direct and Indirect Data-Driven Control with Prior Information about the Equilibrium Manifold

eess.SY ·2026-09-24 ·Yi-Chun Liao, Valentina Breschi, Marco M. Nicotra
published similarity 0.55
Abstract · Accepted at the 65th IEEE Conference on Decision and Control (CDC 2026)

By hinging on the assumption that a system to be controlled is fully unknown, many data-driven control approaches do not leverage available or readily inferable priors. In contrast to this viewpoint, this paper analyzes the impact of using the system's equilibrium subspace to inform direct and indirect linear quadratic regulation. For the indirect case, we show how including a constraint on the equilibrium subspace in the identification problem changes the statistical properties of the learned model. In particular, we show that enforcing consistency with respect to the equilibrium subspace leads to a reduction in the estimator variance that, in turn, enhances model-based control performance. In the direct case, we show how this prior can be leveraged to gain insight into the controlled system without requiring an explicit identification step. These results are supported by both numerical and experimental evidence, showcasing the advantages of explicitly leveraging the equilibrium manifold as a prior in data-driven control.

0.25

Generalization as a robust performance property of learning-enabled dynamical systems

eess.SY cs.LGmath.OC ·2026-08-31 ·Filippo Fabiani
similarity 0.51
Abstract

By focusing on algorithmic stability as a means of establishing out-of-sample bounds, we provide a system-theoretic interpretation of generalization in learning-enabled dynamical systems arising in data-driven optimization and feedback control approximation. Given two neighboring datasets, we specifically model sample replacement as an exogenous disturbance acting on a sensitivity system, while the incremental behavior of the data-dependent operator is encoded through an integral quadratic constraint. By relying on dissipativity arguments, we establish a matrix inequality-based certificate and a uniform stability bound that separates the one-sample sensitivity of the learned operator, and an algorithm-dependent dynamical gain. The latter can then be optimized, offering a tractable tool for certifying and comparing generalization capabilities of learning dynamics. We show that our results recover classical ones for gradient descent, apply naturally to momentum-based methods such as heavy-ball and Nesterov acceleration, and extend to data-driven control.

0.20

A Decade of Learning-Based Control: From Theoretic Foundations to Practical Deployment

eess.SY cs.LG ·2026-10-21 ·Angela P. Schoellig, Matthias A. Müller, Sebastian Trimpe, Melanie N. Zeilinger, Mahathi Anand +6 more
similarity 0.51
Abstract

Motivated by ten years of Learning-Based Control Invited Sessions at the IEEE Conference on Decision and Control (CDC), this tutorial paper reviews key advances at the intersection of machine learning and control. We focus on methods that combine the flexibility of machine learning techniques with the structure and theoretical foundations of control to design autonomous systems that are capable, reliable, and safe. We first introduce core notions for establishing stability and safety guarantees, then review approaches that learn dynamics models to improve control under uncertainty, and finally discuss data-driven methods that directly synthesize or learn policies, including reinforcement learning, imitation learning, and Bayesian optimization. We further discuss representative applications and open challenges. The goal is to provide an accessible entry point to the field and to support continued progress toward reliable learning-based control in real-world systems. To support learning and practical exploration, we share implementations and illustrative examples along with our discussion, together with additional resources on our website: https://learning-based-control.github.io/tutorial/.

0.51

A Unified Framework for Robust Data-Driven Model Predictive Control with Terminal Ingredients

eess.SY ·2026-10-04 ·Zhaohua Yang, Nan Bai, Pengyu Wang, Ling Shi
similarity 0.50
Abstract · Submitted for publication

This paper proposes a unified framework for robust data-driven model predictive control (MPC) with terminal ingredients for unknown linear time-invariant systems. Based on Willems' fundamental lemma, a single offline input-output trajectory is used as an implicit model, while online implementation only requires past input-output measurements. Bounded measurement noise is considered in both offline and online output data. The framework consists of an offline stage, where robust terminal ingredients are designed directly from noisy data, and an online stage, where these ingredients are incorporated into a one-step MPC scheme. Recursive feasibility of the proposed framework and practical exponential stability of the closed-loop system are established. Numerical results illustrate the performance tuning capability of the terminal set, with particularly pronounced benefits for short prediction horizons, and show that the proposed framework achieves performance comparable to data-driven MPC without terminal ingredients while requiring a reduced prediction horizon and less online computation.

0.13

Stochastic Data-driven Predictive Control of Linear Systems with Sub-Gaussian Disturbances using Causal Predictors

eess.SY ·2026-09-22 ·Johannes Teutsch, Marion Leibold
published similarity 0.50
Abstract · This manuscript is a revised version of the article published in IFAC Journal of Systems and Control (2026), vol. 25, pp. 100399. It contain…

We present a stochastic data-driven predictive control (DPC) framework for discrete-time linear time-invariant systems subject to sub-Gaussian additive disturbances based solely on input--output data. In contrast to related methods that rely on exact disturbance data or at least sample generation for closed-loop guarantees, the proposed approach leverages a disturbance data estimate. By enforcing consistency of the disturbance data estimate with the available input--output data and system class, we first identify data-driven and provably causal subspace predictors for use in DPC. Then, we analyze statistical properties of the corresponding prediction error, yielding tightened constraints for the nominal predictions that guarantee satisfaction of chance constraints. The proposed DPC scheme comes with guarantees on recursive feasibility and conditional chance constraint satisfaction in closed-loop under standard assumptions. A numerical evaluation study demonstrates the performance of the proposed controller.

0.52

Learning neural controllers for nonlinear systems from data

eess.SY ·2026-08-29 ·Zhongjie Hu, Zhi-Wei Liu, Chen Wang
similarity 0.49
Abstract

This article addresses the problem of designing neural feedback controllers for unknown nonlinear systems. We propose an indirect data-driven framework that uses offline data to identify the system dynamics, upon which a neural feedback controller and a neural Lyapunov function are jointly synthesized. Input constraints are enforced by integrating a hard-saturation structure into the controller architecture. Robust synthesis conditions are derived to account for data perturbations during identification. Formal stability is certified by combining SMT verification with local Lyapunov analysis near the equilibrium. Numerical examples validate the effectiveness of the proposed framework.

0.22