CS Paper Radar

Koopman--Lyapunov and Koopman--Riccati Controller Synthesis

Wentao Tang

eess.SY math.OC ·submitted 2026-10-30 02:00 UTC · v1

Abstract

While the Koopman operator-based lifted representations of nonlinear autonomous and controlled systems have been well covered in the literature, the direct controller synthesis problem largely remains open. As the controlled system is generally a bilinear (instead of fully linear) Koopman model, controller synthesis appears to lose the linear--quadratic structures of the classical Lyapunov and Riccati methods for finite-dimensional linear systems. However, in infinite dimensions, bilinearity in the feature map should be merely artifactual and hence reducible to linearity in principle. In this work, by considering the operator semigroups in the reproducing kernel Hilbert space with a linear--Sobolev kernel and utilizing the Yosida approximation of their generators, the synthesis problems of a stabilizing controller and an input-unconstrained optimal controller can be formulated as an operator Lyapunov inequality and an operator Riccati equation, respectively. These formulations recover the desirable linear--quadratic structures, and hence, with sample data, they are solvable efficiently in analogous ways to usual linear systems by semidefinite programming solvers and Kleinman iterations, respectively. In addition to proving control performance bounds dependent on the sampling denseness and Yosida regularization, through numerical comparison to linearized LQR, bilinear EDMD-based synthesis, nonlinear MPC, and Koopman MPC methods on numerical models and process control examples, this work demonstrates the proposed Koopman--Riccati synthesis as a computationally efficient approach to obtain a near-optimal state-feedback control law.

Comment
56 pages, 9 figure, 5 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Constrained Koopman Control Parametrization: Convex Controller Synthesis for Tracking under Input Constraints

eess.SY ·2026-10-21 ·Taha Ondogan, Ran Jing, Andrew P. Sabelhaus, Roberto Tron
similarity 0.60
Abstract · 16 pages, 8 figures

Koopman operator theory represents nonlinear systems with linear and bilinear terms in the state and input observables, greatly simplifying control design. However, incorporating input constraints into Koopman-based controller synthesis remains challenging, limiting their applicability to constrained control tasks such as tracking. This paper develops a constrained Koopman Control Parametrization (cKoCoP) framework for synthesizing state-feedback controllers that satisfy prescribed input constraints with Lyapunov-certified stability of the identified lifted closed loop. The cKoCoP offers nonlinear state-feedback via linear-in-observables feedback, enabling linear controller design. The proposed controller is obtained through convex optimization: we incorporate ellipsoidal or polytopic input constraints with the S-procedure or Farkas-lemma-based conditions. We also introduce a Control Lyapunov Function (CLF) for trajectory tracking which incorporates input constraints. The approach is validated on two canonical nonlinear systems, a double pendulum and a unicycle, demonstrating data-driven tracking while respecting input constraints. Experiments validate the method's robustness to measurement noise, and runtime improvements over Koopman Model Predictive Control (KMPC) baselines. The results demonstrate that cKoCoP achieves competitive tracking performance with substantially reduced online computational cost, supporting its potential for real-time constrained tracking applications.

0.25

On asymptotic stability of the time-varying Kalman filter for unstabilizable linear systems: an optimization perspective

eess.SY ·2026-09-16 ·James B. Rawlings, Titus Quah, Matthias A. Müller
similarity 0.55
Abstract

This paper establishes the necessary and sufficient conditions for asymptotic stability of the time-varying Kalman filter applied to a linear time invariant system with semidefinite initial state covariance and positive definite process and measurement noise. Rather than analyze the discrete Riccati equation as in the classic literature, the equivalent state smoothing optimization problem is stated and all results are established using properties of this optimization problem. A Lyapunov-like function, termed a modified $Q$-function is derived and used for this analysis. This optimization approach removes the need for the classic but cumbersome Riccati iteration algebra and provides better generalization and application for nonlinear systems.

0.22

Riccati Stability Without Auxiliary Matrices

eess.SY math.OCmath.FAmath.SP ·2026-09-05 ·Jeffrey Humpherys
similarity 0.55
Abstract

In the 2004 collection \emph{Unsolved Problems in Mathematical Systems and Control Theory}, Erik Verriest posed the problem of characterizing Riccati stability ``without invoking additional matrices.'' We give such a characterization through a scalar invariant of the resolvent family. The invariant is defined by covariance balances using at most $n^2+1$ frequency--direction pairs. A finite-dimensional separation argument shows that this covariance radius equals the optimal common ellipsoidal norm of the resolvent family. Combined with the strict bounded real lemma, this yields a necessary and sufficient condition for Riccati stability involving only the Hurwitz property of the first matrix and a single scalar inequality. The invariant reduces to the ordinary spectral radius for one matrix, lies between the pointwise spectral-radius and unscaled small-gain levels of the resolvent family, and coincides with the operator-space spectral radius of Shalit and Shamovich for the natural resolvent function space. The main results have been formally verified in the Lean proof assistant.

0.19

A Behavioral approach to Constrained Linear Quadratic Control: Feasibility and Optimality

eess.SY math.OC ·2026-10-29 ·Soutrik Bandyopadhyay, Debasattam Pal, Shubhendu Bhasin
published similarity 0.54
Abstract · Accepted for publication at IEEE Indian Control Conference 2027

This paper develops a constrained linear-quadratic (LQ) optimal control framework within the behavioral approach. Unlike classical formulations that rely on state-input representations, our method treats both the system dynamics and the constraints as trajectory-level objects. The system is modeled through a kernel representation, while inequality constraints are captured using behavioral inequalities defined over infinite-dimensional convex cones. Using quadratic differential forms (QDFs) to encode performance indices, we formulate the constrained LQ problem as a convex variational optimization over trajectories. By employing Gateaux differentials, we derive the stationarity and complementarity conditions and show that they admit a representation as an augmented behavioral system whose unique decomposition into autonomous and controllable sub-behaviors yields a complete parameterization of all optimal constrained trajectories. The resulting conditions constitute a behavioral analogue of the Karush-Kuhn-Tucker (KKT) framework. A numerical example illustrates the effect of inequality constraints on the optimal behavior. The framework provides a general, trajectory-level representation for constrained optimal control and opens avenues for closed-loop and data-driven extensions.

0.41

Demystifying Linear Operator Learning for Control Systems

eess.SY cs.LG ·2026-09-16 ·Max Beier, Nicolas Hoischen, Sandra Hirche, Petar Bevanda
published similarity 0.54
Abstract · accepted to the 65th IEEE Conference on Decision and Control; authors' version

This paper proposes a structured approach to learning linear operators for control systems from data. We address both structural and learning-theoretic aspects of the problem. To derive structural assumptions, we propose using the well-established framework of (semi)groups for evolution equations, as operators in control systems are of the same type. Further, we propose analyzing learning algorithms through the lens of the inverse problems framework. This reveals how a learned model depends on the data via error decompositions, convergence guarantees, and optimal regularization -- enabling us to compare existing methods and derive provably advantageous algorithms. In order to obtain these results, we restrict our scope to bounded operators on Hilbert spaces. Although this may appear restrictive, existing approaches often make this assumption implicitly to obtain matrix-like representations. We demonstrate the power of using these frameworks by deriving a convergent estimator for time-varying systems.

0.27

Model Predictive Control of Heating Systems via Koopman-Operator Bilinearization

eess.SY ·2026-11-02 ·Paula Chanfreut, Erfan Shakhesi, Mircea Lazar, Maurice Heemels
similarity 0.54
Abstract

Hydronic heat emitters are widely used in buildings, but their control is challenging due to nonlinear dynamics, arising from both the heat transfer in each emitter and the hydraulic coupling among those that share a circulating pump. These nonlinearities are often simplified or neglected in the literature. In this paper, we use Koopman theory to make the resulting model more tractable for control. In particular, we propose an input reparameterization and construct an infinite-dimensional set of observables that yields an exact bilinear representation of the system in the chosen lifted space. We then show that truncating the infinite-dimensional representation leads to bounded approximation errors that decrease as the truncation order increases, as well as bounded trajectory deviations over a finite horizon. The resulting bilinear model is incorporated into a model predictive control (MPC) framework to provide thermal comfort in multi-zone buildings while reducing energy use. Using a numerical case study of a five-story building with 20 zones, we show that the proposed Koopman-based MPC achieves a realized performance cost close to that of nonlinear MPC with faster solve times, and outperforms MPC formulations based on time-invariant and time-varying linearizations.

0.27

Adaptive Koopman Predictive Control without Persistent Excitation via Matrix Normal Invariant Priors

eess.SY ·2026-11-16 ·Mircea Lazar
theory similarity 0.53
Abstract

Finite-dimensional Koopman models are increasingly used in predictive control, but their accuracy remains limited by truncation errors and offline identification data. Adaptive Koopman predictive control promises to address this limitation, but typically requires closed-loop persistent excitation (PE). Since this is difficult to achieve in practice, in this paper we develop an adaptive generalized Koopman (GeKo) predictive controller that does not require PE. To this end, we formulate a recursive matrix regression in fixed lifted coordinates that extends the Kalman filter with back-to-the-prior forgetting to matrix-valued operators and uses a matrix normal invariant prior, centered at the operator identified offline. For any regressor sequence, and thus under any feedback law, we prove that the covariance remains between two multiples of the prior covariance and that the estimation error is input-to-state stable. On an academic example, a differential-drive robot and a power system with plant changes and little excitation, the invariant-prior estimator yields the lowest overall tracking error among the compared estimators and prevents covariance windup.

0.16

Learning and Control Beyond Linearity: Towards a Non-asymptotic Theory for Bilinear Systems

eess.SY cs.LGcs.ROmath.OC+1 ·2026-09-16 ·Yahya Sattar, Yassir Jedra, Robin Strässer, Frank Allgöwer, Maryam Fazel +1 more
benchmark similarity 0.53
Abstract

This tutorial provides a unified view of the emerging area of bilinear learning and control. Using linear systems as a benchmark, it explains what fundamentally changes in the bilinear settings, how recent theory addresses finite-sample learning and control, and how these ideas connect to broader themes in nonlinear control, representation learning, and data-driven decision making. For learning, we emphasize tools that are particularly useful in the bilinear settings, such as one-sided Bernstein's inequality for dependent and heavy-tailed covariates, blocking arguments, and martingale concentration for input-dependent noise. We then apply these tools to obtain finite-sample learning guarantees for fully observed bilinear systems, partially observed bilinear systems, and linear systems with bilinear observations. For control, we discuss quadratic control from bilinear observations, where the classical separation principle fails, and review tractable approaches based on belief-space receding horizon control. We also cover stabilization of bilinear dynamics under state feedback using semi-definite programming, LMI relaxations, sum-of-squares methods, and Koopman-based lifting. We conclude by discussing connections to reinforcement learning and machine learning, and some open problems in combined learning and control of bilinear systems.

0.17