CS Paper Radar

A Frequency Domain Approach to Bounding Riccati Equation Perturbations

Rachel Newton, Laura Balzano, Peter Seiler

eess.SY math.OC ·submitted 2026-09-29 20:36 UTC · v1

Abstract

The discrete algebraic Riccati equation (DARE) is used to solve for the optimal feedback gain in linear-quadratic regulator (LQR) control of discrete-time systems. In this letter, we consider the effect of perturbations to the LQR data on the DARE solutions. We present a new frequency domain approach to derive an explicit bound on the difference in DARE solutions under such perturbations. Our bounds are similar to other results that have recently appeared in the literature with two distinctions. First, we use a frequency domain constant that measures the degree of closed-loop stability, in contrast to other results that use a time domain measure. Second, we start from weaker detectability assumptions on the LQR state cost matrix.

Comment
7 pages. Submitted to IEEE Control Systems Letters pending review

Closest papers

Nearest neighbours by meaning across the whole index.

Riccati Stability Without Auxiliary Matrices

eess.SY math.OCmath.FAmath.SP ·2026-09-05 ·Jeffrey Humpherys
similarity 0.66
Abstract

In the 2004 collection \emph{Unsolved Problems in Mathematical Systems and Control Theory}, Erik Verriest posed the problem of characterizing Riccati stability ``without invoking additional matrices.'' We give such a characterization through a scalar invariant of the resolvent family. The invariant is defined by covariance balances using at most $n^2+1$ frequency--direction pairs. A finite-dimensional separation argument shows that this covariance radius equals the optimal common ellipsoidal norm of the resolvent family. Combined with the strict bounded real lemma, this yields a necessary and sufficient condition for Riccati stability involving only the Hurwitz property of the first matrix and a single scalar inequality. The invariant reduces to the ordinary spectral radius for one matrix, lies between the pointwise spectral-radius and unscaled small-gain levels of the resolvent family, and coincides with the operator-space spectral radius of Shalit and Shamovich for the natural resolvent function space. The main results have been formally verified in the Lean proof assistant.

0.19

Data-Driven LQR with Uncertainty Refinement and Domain Randomization---Part~II: Fisher-Majorized Certified Policy Iteration

eess.SY ·2026-10-24 ·Hamidreza Modares
theory similarity 0.58
Abstract

Building on the uncertainty description developed in Part~I, this paper introduces a Fisher-majorized domain-randomized generalized policy iteration framework for data-driven linear quadratic regulator (LQR) synthesis. At each iteration, partial Bellman evaluation over a fixed batch of uncertainty realizations produces a structured Sylvester policy-improvement step. A residual-weighted Fisher curvature controls the policy-induced variation in the stationary covariance and converts the Sylvester model into a certified upper bound on the cost change, thereby guaranteeing descent for every accepted step. A check-and-correct mechanism then certifies stability over the entire uncertainty support, rather than only over the sampled realizations. Consequently, every iterate is robustly stabilizing and monotonically decreases the fixed-batch objective. The Fisher truncation and stability correction become inactive after finitely many times. The objective gap then contracts linearly to a floor determined by the dispersion of the realization-wise Riccati targets and by measurement noise. In the absence of measurement noise, this floor vanishes when the realization-wise targets coincide.

0.30

Iterative State- and Control-Dependent Model Predictive Control: A Jacobian-Free Formulation for Constrained Nonlinear Systems

eess.SY math.OC ·2026-08-15 ·Mohammadreza Kamaldar
theory similarity 0.58
Abstract

This paper presents an iterative model predictive control algorithm that stabilizes constrained nonlinear systems without evaluating a single plant derivative. By factoring the exact nonlinear dynamics into a pseudo-linear form using state- and control-dependent coefficients (SCDCs), we replace the standard nonconvex optimization with a sequence of constrained linear-quadratic programs. Refreezing the coefficient matrices along the previously predicted trajectory drives the iteration. Near the origin, we prove this sequence contracts to a unique fixed point. We explicitly bound the number of iterations required to reach any stopping tolerance, and we quantify the distance from the fixed point to a true Karush-Kuhn-Tucker point, showing this optimality gap vanishes quadratically as the state approaches the origin. Inflating the discrete algebraic Riccati equation generates terminal ingredients that guarantee recursive feasibility and asymptotic stability, even when the solver terminates early. We adapt the terminal penalty online, proving it remains uniformly bounded, and we secure output feedback through the block-observable canonical form, which extracts the exact system state directly from past inputs and outputs. Retaining the block-banded structure of the subproblem forces the computational cost to scale linearly with the horizon length $\ell$. This $O(\ell)$ complexity matches the iterative linear quadratic regulator (iLQR) but sharply undercuts the $O(\ell^3)$ scaling of dense sequential quadratic programming (SQP). Numerical studies on a saturated quadrotor, a nonholonomic integrator, and a nonminimum-phase plant illustrate the theoretical bounds and map how the algorithm compares with iLQR, SQP, and linear-parameter-varying MPC.

0.34

Finite-time boundary collision in planar linear quadratic regulator gradient flows

eess.SY math.OCmath.DS ·2026-09-26 ·Kang Liu
similarity 0.56
Abstract

Policy gradient methods for the linear quadratic regulator optimize feedback gains using a cost over an infinite horizon. When this cost is evaluated at one fixed initial state, it need not diverge near every part of the stability boundary. We study whether the Euclidean gradient flow can reach this boundary in finite optimization time. For controllable planar systems with one input and positive definite quadratic weights, an exact representation of the cost yields a necessary and sufficient condition for the existence of such a collision. The condition reduces to a scalar root calculation and includes the critical case, where a double direction root attracts an open set of stabilizing gains. For a triangular family, the criterion gives an explicit algebraic parameter region, and every trajectory either converges to the Riccati gain or collides with the stability boundary. A sharp threshold for compact cost sublevels provides a convergence certificate. Along every colliding trajectory, the stability margin and the smallest eigenvalue of the accumulated state Gramian vanish linearly, although the Gramian remains positive definite before collision. Numerical experiments examine the dependence on initialization, slow passage near a critical direction, and the effect of adding excitation in a second state direction.

0.22

On asymptotic stability of the time-varying Kalman filter for unstabilizable linear systems: an optimization perspective

eess.SY ·2026-09-16 ·James B. Rawlings, Titus Quah, Matthias A. Müller
similarity 0.56
Abstract

This paper establishes the necessary and sufficient conditions for asymptotic stability of the time-varying Kalman filter applied to a linear time invariant system with semidefinite initial state covariance and positive definite process and measurement noise. Rather than analyze the discrete Riccati equation as in the classic literature, the equivalent state smoothing optimization problem is stated and all results are established using properties of this optimization problem. A Lyapunov-like function, termed a modified $Q$-function is derived and used for this analysis. This optimization approach removes the need for the classic but cumbersome Riccati iteration algebra and provides better generalization and application for nonlinear systems.

0.22

Stability Transfer for Autonomous Systems via Higher-Order Taylor-Truncated Lyapunov Certificates

eess.SY math.OC ·2026-10-13 ·Jose D. Hoyos, Zehui Lu, Shaoshuai Mou
published similarity 0.55
Abstract

We develop analytical sufficient conditions for certifying the local asymptotic stability of nonlinear autonomous systems based on Lyapunov functions derived from their finite-order Taylor polynomial approximations. This approach translates the stability analysis problem from the original nonlinear dynamics to a more computationally tractable polynomial domain. The derived conditions allow for the explicit calculation of a guaranteed inner approximation of the region of attraction ($\mathrm{ROA}$). We show how sum-of-squares (SOS) programming and grid search can be used to systematically search for polynomial Lyapunov functions that yield a large certified threshold radius and extract a certified invariant set inner approximation of the $\mathrm{ROA}$ of the nonpolynomial original system. The framework is then applied to a control tuning problem: finding reduced-effort Linear Quadratic Regulator (LQR) controllers that ensure that a given initial state of interest belongs to the certified $\mathrm{ROA}$ of the nonpolynomial closed loop system. The effectiveness of the overall methodology is demonstrated using a pendulum with nonlinear damping and a nonlinear control system.

0.29

Worst-Case Finite-Horizon Analysis of Perturbed LQR via Performance Estimation Problem

eess.SY math.OC ·2026-10-21 ·Anthony Couthures, Gianluca Bianchin, Julien M. Hendrickx
similarity 0.55
Abstract

We propose a framework to assess the robustness of a given state-feedback controller by evaluating its worst-case finite-horizon cost over a class of norm-bounded perturbations. To compute this cost, we show how to apply the Performance Estimation Problem (PEP) framework, originally developed to analyze optimization algorithms, and reformulate the worst-case search as a rank-constrained Semidefinite Program (SDP). Our results suggest that the perturbations that induce the highest finite-horizon costs can differ substantially from those identified using standard asymptotic metrics. Intuitively, worst-case perturbations are obtained by aligning slowly decaying modes with specific initial conditions to drive transient growth, causing a bifurcation in the worst-case behavior as the horizon length changes. These findings open new possibilities to certify finite-horizon performance of broader system classes, including data-driven models or nonlinear components.

0.18

Feedback Stabilization for Sampled Linear Systems with Control-linear Noise

eess.SY math.OC ·2026-09-24 ·Cynthia Cheng, Xudong Chen
similarity 0.55
Abstract

In this paper, we consider linear stochastic systems with control-linear noise and periodically sampled measurements. We address the problem of feedback stabilization in the mean-square sense. The main contribution of the paper is to provide a necessary and sufficient condition for feedback stabilization. In particular, we relate feedback stabilizability of the stochastic system to the existence of a fixed point of a Riccati-type algebraic equation and, further, to the existence of a solution to an infinite-horizon optimal control problem.

0.22