CS Paper Radar

Adaptive Koopman Predictive Control without Persistent Excitation via Matrix Normal Invariant Priors

Mircea Lazar

eess.SY ·submitted 2026-11-16 00:30 UTC · v1
theory

Abstract

Finite-dimensional Koopman models are increasingly used in predictive control, but their accuracy remains limited by truncation errors and offline identification data. Adaptive Koopman predictive control promises to address this limitation, but typically requires closed-loop persistent excitation (PE). Since this is difficult to achieve in practice, in this paper we develop an adaptive generalized Koopman (GeKo) predictive controller that does not require PE. To this end, we formulate a recursive matrix regression in fixed lifted coordinates that extends the Kalman filter with back-to-the-prior forgetting to matrix-valued operators and uses a matrix normal invariant prior, centered at the operator identified offline. For any regressor sequence, and thus under any feedback law, we prove that the covariance remains between two multiples of the prior covariance and that the estimation error is input-to-state stable. On an academic example, a differential-drive robot and a power system with plant changes and little excitation, the invariant-prior estimator yields the lowest overall tracking error among the compared estimators and prevents covariance windup.

Closest papers

Nearest neighbours by meaning across the whole index.

Forgetting While Remembering, an Invariant Online Data-Driven Predictive Control Formulation

eess.SY ·2026-09-16 ·Alessandro Chiuso, Florian Dörfler, Keith Moffat
similarity 0.69
Abstract · 8 pages, 3 figures, conference paper (CDC)

Low signal-to-noise ratio (SNR) data is a core challenge of online Data-Driven Predictive Control (DPC) for linear, time-varying systems. This paper proposes a Bayesian, online DPC framework based on autoregressive models with exogenous inputs (ARX) that uses an externally-provided prior, which encodes inductive bias such as smooth system dynamics and stability, to safeguard performance when SNR is low. The posterior estimate of the ARX parameter is propagated forward in time using a Kalman filter with a state equation defined by an adaptation-rate hyperparameter, which is adjusted online to track the rate at which the underlying system dynamics evolve. The Kalman filter's posterior mean and covariance determine the DPC's Final Control Error cost function, which is the posterior expectation of the quadratic cost function. Critically, the Kalman filter's process equation is chosen so that, regardless of the hyperparameter adaptation, the prior distribution is invariant over time. Thus, while old data is forgotten, the prior is not. DPC tracking experiments on a time-varying second-order system demonstrate the efficacy of the proposed method.

0.32

Policy-Conditioned Koopman Representations for Parameterized Closed-Loop Systems

eess.SY ·2026-11-13 ·Kiran G. Krishnan, Shankar A. Deka
similarity 0.66
Abstract

Predicting the response of a nonlinear system across different feedback controllers requires a model that captures how the closed-loop dynamics change with the controller parameters. In a finite-dimensional Koopman model, these changes may affect both the latent dynamics and the observable coordinates used to represent them. In this paper, we propose a policy-conditioned Koopman representation framework to address this problem. This framework allows a single learned model to predict a family of closed-loop trajectories without retraining for each controller. We test the framework on four nonlinear prediction benchmarks, where the model stays below a 15% error threshold on every system, while each baseline exceeds it on at least one. As an example application, the resulting surrogate supports one-shot feedback-parameter selection: an optimization at the initial state selects a controller that then operates with fixed parameters and ongoing state feedback. On nonlinear control benchmarks including MuJoCo, the selected controllers stabilize every system with 3 to 97 times less online computation than nonlinear model predictive control. These results demonstrate how policy-dependent coordinates can support both prediction across closed-loop systems and controller selection without repeated online trajectory optimization.

0.15

Physics-based Online Adaptive Koopman Model Predictive Attitude Control for Combined Spacecraft with Dynamic Uncertainties

eess.SY ·2026-09-02 ·Yicheng Sun, Yueyong Lyu, Yuhan Liu, Yanning Guo, Wei Pan
top venue similarity 0.63
Abstract · 16 pages, 13 figures, 3 tables

This paper proposes a physics-based adaptive Koopman Model Predictive Control (MPC) strategy for combined spacecraft attitude stabilization under inertia uncertainties and active target maneuverability. A novel, quaternion-based Koopman model is constructed from a set of analytical lifting functions derived from the quaternion kinematics, which provides a more compact and physically interpretable linear representation of the nonlinear dynamics compared with the conventional black-box EDMD and higher-dimensional DCM-based model. Leveraging the linear structure of this nominal model, a gradient descent-based update law is employed to efficiently identify time-varying inertial uncertainties from real-time input/output data. By integrating this adaptive linear model into the MPC framework, the optimal control problem reduces to a computationally efficient Quadratic Program (QP), thereby significantly lowering the online computational burden compared to nonlinear adaptive MPC. Recursive feasibility and regional input-to-state stability are formally established through the design of terminal ingredients for the MPC. The effectiveness and superiority of the proposed strategy are validated through comparative simulations of an attitude stabilization task for combined spacecraft in a high-fidelity 3D simulator.

0.48

Multirate Data-Driven Predictive Control: Rank Obstructions, Identifiability, and Noise Conditioning

eess.SY math.OC ·2026-11-01 ·Robert Vrabel
similarity 0.62
Abstract

We develop rank, identifiability, and noise-conditioning results for compact input--output predictors in multirate data-driven predictive control. The inverse of a square zero-input response matrix used in an existing compact-lifting construction is shown to be undefined under its observability and minimal-polynomial assumptions. We derive exact replacements using rank-complete data, characterize all predictor extensions, and establish the minimum-norm and minimax Euclidean noise properties of the canonical Moore--Penrose extension. A joint predictor is identified directly from mixed experiments with arbitrary initial states. Deterministic perturbation bounds quantify reconstruction errors through informative singular-value margins, while a positive-definite reduced weighting preserves the nominal quadratic cost. Sampling-rate observability and event-triggering analyses identify additional conditions needed for reconstruction and stability guarantees.

0.30

On sparsity and directional forgetting in adaptive control

eess.SY ·2026-09-20 ·Tochukwu E. Ogri, Trivikram Satharasi, Muzaffar Qureshi, Kyle Volle, Rushikesh Kamalapurkar
similarity 0.61
Abstract

This paper develops a sparsity-promoting memory regressor extension (MRE) adaptation law with directional forgetting for nonlinear control-affine systems with linearly parameterized uncertainty. The objective is to use directional forgetting to selectively discount obsolete information and leverage $\ell_1$ regularization to promote sparsity of the parameter estimates. While $\ell_1$ regularization has been applied to the system identification problem in an offline setting, a contribution of this paper is to develop a recursive least squares update law to implement $\ell_1$ regularization in online adaptive control. In particular, we show that $\ell_1$-regularized recursive least squares is realized via a sliding mode update law. A nonsmooth Lyapunov-based stability analysis is then used to show that the tracking and parameter estimation errors are ultimately bounded under a subspace excitation condition. Simulation results on a Van der Pol oscillator demonstrate the ability of the developed sparsity-promoting MRE controller to recover sparse dynamics while maintaining stable tracking.

0.09

Making Koopman Control Guarantees Hold on Robots

cs.RO cs.AIeess.SY ·2026-11-16 ·Abulikemu Abuduweili, Changliu Liu
similarity 0.60
Abstract · https://walleclipse.github.io/tik-koopman/

A Koopman controller can stabilize its learned latent-space linear model yet fail to stabilize the nonlinear plant. The learned model propagates predictions in latent space, while the deployed controller repeatedly re-encodes the measured physical state. We show that nominal closed-loop stability transfers to the nonlinear plant when the learned and true closed-loop dynamics agree to first order on the embedding's tangent space at the target. We derive a robustness margin for approximate matching and show that a stable open-loop latent model cannot exactly match an unstable equilibrium. We introduce Tangent-Invariant Koopman (TIK), which estimates a local plant linearization from offline transitions and enforces first-order matching to this estimate. TIK recovers the fitted LQR gain at the target, while a bilinear predictor captures state-dependent actuation during large maneuvers. Across four simulated unstable benchmarks, all 40 Standard Koopman controllers have stable latent closed loops, but their deployed nonlinear systems are locally unstable. In contrast, all 40 TIK controllers locally stabilize their respective nonlinear plants. An offline stability test using empirical curvature estimates identifies stable TIK controllers on two cart-pole systems, but is inconclusive under high noise. Under explicit model-error and curvature bounds, an invariant terminal set guarantees constraint satisfaction after entry under local feedback. TIK achieves 88\% constrained cart-pole swing-up success with a 0.25 ms planning budget and controls simulated seven-joint arms within 1-5 ms per step.

0.38

Taylor-Informed Predictive Cost Adaptive Control for Quadrotors with Online Gravity-Trim Adaptation

eess.SY ·2026-09-03 ·Tam W. Nguyen
similarity 0.60
Abstract · 6 pages, 4 figures

This paper develops Taylor-informed predictive cost adaptive control (PCAC) for quadrotors with online gravity-trim adaptation. First-, second-, and third-order expansions of the nonlinear dynamics about nominal hover define sparse sampled-data dictionaries for row-wise recursive least-squares identification with variable-rate forgetting. At each step, the identified predictor is linearized at the current state, and its Jacobian is fixed over the prediction horizon. The identified vertical dynamics also estimate the vehicle mass and gravity-trim input, eliminating fixed nominal gravity compensation. Simulations with an abrupt payload change and aggressive helix tracking show that the higher-order predictors improve prediction and tracking while preserving the standard PCAC formulation.

0.29

Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements

cs.RO eess.SY ·2026-09-02 ·Guanhua Liu, Tong Wu, Lixian Zhang, Weifeng Du, Minghao Han
similarity 0.60
Abstract

Intermittent state measurements pose fundamental challenges to model predictive control of constrained nonlinear systems because prediction uncertainty grows during feedback outages and measurement-triggered resets disrupt nominal state propagation, potentially compromising closed-loop stability and recursive feasibility. This paper develops a Koopman-based stochastic MPC framework with probabilistically truncated soft constraints. Specifically, a Lipschitz-constrained deep Koopman model provides a linear latent predictor, enabling computationally efficient online optimization. The intermittent measurement process is modeled as a two-mode discrete-time Markov chain, yielding a unified Markov jump error model for open-loop propagation and measurement-triggered resets. Under numerically verifiable sufficient conditions, the prediction error is shown to be mean-square ultimately bounded, and an explicit uniform second-moment bound is obtained. A distribution-free probabilistic error radius is then constructed for a prescribed confidence level and used to truncate dropout-dependent constraint tightening. An exact-penalty soft-constraint mechanism accommodates reset-induced jumps and prolonged dropouts. Under the stated terminal compatibility and bounded-disturbance conditions, recursive feasibility and mean-square ultimate boundedness of the closed-loop regulation error are established. Numerical simulations on a visual-servoing tracking task corroborate these theoretical results and demonstrate effective tracking under stochastic measurement unavailability.

0.21