CS Paper Radar

Forgetting While Remembering, an Invariant Online Data-Driven Predictive Control Formulation

Alessandro Chiuso, Florian Dörfler, Keith Moffat

eess.SY ·submitted 2026-09-16 15:32 UTC · v1

Abstract

Low signal-to-noise ratio (SNR) data is a core challenge of online Data-Driven Predictive Control (DPC) for linear, time-varying systems. This paper proposes a Bayesian, online DPC framework based on autoregressive models with exogenous inputs (ARX) that uses an externally-provided prior, which encodes inductive bias such as smooth system dynamics and stability, to safeguard performance when SNR is low. The posterior estimate of the ARX parameter is propagated forward in time using a Kalman filter with a state equation defined by an adaptation-rate hyperparameter, which is adjusted online to track the rate at which the underlying system dynamics evolve. The Kalman filter's posterior mean and covariance determine the DPC's Final Control Error cost function, which is the posterior expectation of the quadratic cost function. Critically, the Kalman filter's process equation is chosen so that, regardless of the hyperparameter adaptation, the prior distribution is invariant over time. Thus, while old data is forgotten, the prior is not. DPC tracking experiments on a time-varying second-order system demonstrate the efficacy of the proposed method.

Comment
8 pages, 3 figures, conference paper (CDC)

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive Koopman Predictive Control without Persistent Excitation via Matrix Normal Invariant Priors

eess.SY ·2026-11-16 ·Mircea Lazar
theory similarity 0.69
Abstract

Finite-dimensional Koopman models are increasingly used in predictive control, but their accuracy remains limited by truncation errors and offline identification data. Adaptive Koopman predictive control promises to address this limitation, but typically requires closed-loop persistent excitation (PE). Since this is difficult to achieve in practice, in this paper we develop an adaptive generalized Koopman (GeKo) predictive controller that does not require PE. To this end, we formulate a recursive matrix regression in fixed lifted coordinates that extends the Kalman filter with back-to-the-prior forgetting to matrix-valued operators and uses a matrix normal invariant prior, centered at the operator identified offline. For any regressor sequence, and thus under any feedback law, we prove that the covariance remains between two multiples of the prior covariance and that the estimation error is input-to-state stable. On an academic example, a differential-drive robot and a power system with plant changes and little excitation, the invariant-prior estimator yields the lowest overall tracking error among the compared estimators and prevents covariance windup.

0.24

Information-theoretic receding-horizon active learning of nonlinear dynamical systems

eess.SY cs.LG ·2026-09-29 ·Juncal Arbelaiz, Anushri Arora, Jonathan W. Pillow
published similarity 0.59
Abstract · 8 pages, 3 figures. Accepted to the 2026 IEEE Conference on Decision and Control (CDC)

Accurately learning nonlinear dynamics from a finite-duration experiment requires the efficient collection of informative data. We address this challenge for stochastic controlled nonlinear dynamical systems whose state is observed along a single trajectory. Our goal is to reconstruct the unknown controlled state-increment map over a prescribed compact subset of state-input space. We construct a parametric estimator of the map using fixed nonlinear features, so that the model is nonlinear in the state and input, but linear in the unknown parameters. A Gaussian prior over the parameters yields recursive Bayesian posterior updates as data stream in, enabling online quantification of predictive uncertainty in the reconstructed dynamics over the target set. We formulate an optimal adaptive-design problem over an information state, using a prediction-oriented acquisition criterion based on the mean marginal mutual information between candidate future trajectories and the reconstructed dynamics over the target set. We then approximate the resulting adaptive-design problem by a non-myopic receding-horizon formulation, evaluate its remaining expectation using a scenario-based sample average, and solve the resulting deterministic program with the cross-entropy method, leveraging parallel candidate-scenario evaluations. Numerical experiments on a noisy multistable system demonstrate that the proposed adaptive information-seeking strategy reduces predictive uncertainty and reconstruction error more efficiently than common excitation baselines under comparable experimental constraints.

0.37

Entropic Control for Homeostatic Optimization: Pre-empting Catastrophic Forgetting via Dynamic Feedback

cs.LG cs.AIcs.CL ·2026-10-25 ·Shangxi Wu, Xiaorong Yan, Xiaojun Meng, Yuxiang Zhang, Jiansheng Wei
similarity 0.59
Abstract

Supervised Fine-Tuning (SFT) of LLMs suffers from catastrophic forgetting, and prevailing mitigation strategies struggle to reconcile the plasticity-stability dilemma. To address this, we propose Entropic Control for Homeostatic Optimization (ECHO), a closed-loop control framework. By decomposing the KL divergence, we identify output entropy as a dominant observable component of KL variation. This enables us to leverage entropy as a computationally efficient online proxy to monitor forgetting risks in real-time, bypassing expensive reference-model inference. Consequently, ECHO employs an elastic controller that dynamically modulates the gradient weight of replay data via a proportional control law, using deviations from the pre-trained entropic equilibrium as an error signal. Empirical evaluations across 0.6B to 9B parameter architectures demonstrate that ECHO lies on, and in several comparisons extends, the observed plasticity-stability frontier and maintains high operational robustness against varying data mixing ratios.

0.21

Stochastic Data-driven Predictive Control of Linear Systems with Sub-Gaussian Disturbances using Causal Predictors

eess.SY ·2026-09-22 ·Johannes Teutsch, Marion Leibold
published similarity 0.59
Abstract · This manuscript is a revised version of the article published in IFAC Journal of Systems and Control (2026), vol. 25, pp. 100399. It contain…

We present a stochastic data-driven predictive control (DPC) framework for discrete-time linear time-invariant systems subject to sub-Gaussian additive disturbances based solely on input--output data. In contrast to related methods that rely on exact disturbance data or at least sample generation for closed-loop guarantees, the proposed approach leverages a disturbance data estimate. By enforcing consistency of the disturbance data estimate with the available input--output data and system class, we first identify data-driven and provably causal subspace predictors for use in DPC. Then, we analyze statistical properties of the corresponding prediction error, yielding tightened constraints for the nominal predictions that guarantee satisfaction of chance constraints. The proposed DPC scheme comes with guarantees on recursive feasibility and conditional chance constraint satisfaction in closed-loop under standard assumptions. A numerical evaluation study demonstrates the performance of the proposed controller.

0.51

Sample-Covariance Regularization for Data-Driven Predictive Control from Frequency Response Functions under Colored Noise

eess.SY ·2026-11-06 ·M. Wind, T. J. Meijer, V. S. Dolk, W. P. M. H. Heemels
similarity 0.59
Abstract

In this work, we investigate how sample covariance obtained from frequency-response functions (FRFs) can be exploited to improve performance of data-driven frequency-domain predictive control (FreePC) in the presence of colored measurement noise. In case of periodic multisine excitation, this covariance is obtained directly from repeated periods and provides a frequency-dependent measure of uncertainty without requiring an additional parametric noise model. To incorporate this information into both indirect and direct predictive control, we develop a frequency-domain subspace predictive controller (FD-SPC) and establish its equivalence to the direct FreePC formulation in the noiseless setting. Regularization terms for both formulations are then motivated by expected prediction-error criteria and constructed from the sample covariance of the FRF estimates. Across all tested noise models and data sizes, regularization consistently reduces the median realized control cost relative to the corresponding controller without covariance regularization, with reductions of up to 35%.

0.24

A Unified Framework for Robust Data-Driven Model Predictive Control with Terminal Ingredients

eess.SY ·2026-10-04 ·Zhaohua Yang, Nan Bai, Pengyu Wang, Ling Shi
similarity 0.59
Abstract · Submitted for publication

This paper proposes a unified framework for robust data-driven model predictive control (MPC) with terminal ingredients for unknown linear time-invariant systems. Based on Willems' fundamental lemma, a single offline input-output trajectory is used as an implicit model, while online implementation only requires past input-output measurements. Bounded measurement noise is considered in both offline and online output data. The framework consists of an offline stage, where robust terminal ingredients are designed directly from noisy data, and an online stage, where these ingredients are incorporated into a one-step MPC scheme. Recursive feasibility of the proposed framework and practical exponential stability of the closed-loop system are established. Numerical results illustrate the performance tuning capability of the terminal set, with particularly pronounced benefits for short prediction horizons, and show that the proposed framework achieves performance comparable to data-driven MPC without terminal ingredients while requiring a reduced prediction horizon and less online computation.

0.13

On sparsity and directional forgetting in adaptive control

eess.SY ·2026-09-20 ·Tochukwu E. Ogri, Trivikram Satharasi, Muzaffar Qureshi, Kyle Volle, Rushikesh Kamalapurkar
similarity 0.59
Abstract

This paper develops a sparsity-promoting memory regressor extension (MRE) adaptation law with directional forgetting for nonlinear control-affine systems with linearly parameterized uncertainty. The objective is to use directional forgetting to selectively discount obsolete information and leverage $\ell_1$ regularization to promote sparsity of the parameter estimates. While $\ell_1$ regularization has been applied to the system identification problem in an offline setting, a contribution of this paper is to develop a recursive least squares update law to implement $\ell_1$ regularization in online adaptive control. In particular, we show that $\ell_1$-regularized recursive least squares is realized via a sliding mode update law. A nonsmooth Lyapunov-based stability analysis is then used to show that the tracking and parameter estimation errors are ultimately bounded under a subspace excitation condition. Simulation results on a Van der Pol oscillator demonstrate the ability of the developed sparsity-promoting MRE controller to recover sparse dynamics while maintaining stable tracking.

0.09

Neural Kalman Filtering for Unknown Dynamics: Task-Aware Learning with a Koopman Backbone

eess.SP ·2026-09-21 ·Mintaek Oh, Jeonghun Park, Nir Shlezinger, Yonina C. Eldar, Jinseok Choi
hot direction similarity 0.58
Abstract · 13 pages, 6 figures

Recent years have witnessed a growing interest in AI-aided Kalman filters. While emerging methodologies, such as KalmanNet, were shown to facilitate tracking in partially known state-space models, they are not directly applicable when the underlying dynamics is unknown. To overcome this limitation, we extend the KalmanNet philosophy to the unknown-dynamics regime by developing blind Kalman filtering frameworks that learn both the predictor and the correction gain from data, assuming that the state-evolution function and the noise statistics are both unavailable. To this end, we first introduce a task-aware neural Kalman filtering framework, Blind-KalmanNet, which carries the learning principle of the Kalman gain into the prediction step through a two-head neural architecture that jointly learns a state-dependent linear surrogate and the Kalman gain from data. Building on this formulation, we then develop our main framework, Koopman-aided Blind-KalmanNet, which incorporates Koopman operator theory to lift the unknown dynamics into a latent space where the state evolves linearly. The lifted linear predictor integrates seamlessly into the Blind-KalmanNet structure: the pre-trained deep Koopman network serves as a globally structured predictor, augmented by the task-aware residual surrogate and the learned Kalman gain inherited from Blind-KalmanNet. Extensive experiments demonstrate that the proposed frameworks achieve competitive performance against baselines, with Koopman-aided Blind-KalmanNet attaining the best accuracy across all considered settings.

0.33