CS Paper Radar

Finite-time boundary collision in planar linear quadratic regulator gradient flows

Kang Liu

eess.SY math.OCmath.DS ·submitted 2026-09-26 14:07 UTC · v1

Abstract

Policy gradient methods for the linear quadratic regulator optimize feedback gains using a cost over an infinite horizon. When this cost is evaluated at one fixed initial state, it need not diverge near every part of the stability boundary. We study whether the Euclidean gradient flow can reach this boundary in finite optimization time. For controllable planar systems with one input and positive definite quadratic weights, an exact representation of the cost yields a necessary and sufficient condition for the existence of such a collision. The condition reduces to a scalar root calculation and includes the critical case, where a double direction root attracts an open set of stabilizing gains. For a triangular family, the criterion gives an explicit algebraic parameter region, and every trajectory either converges to the Riccati gain or collides with the stability boundary. A sharp threshold for compact cost sublevels provides a convergence certificate. Along every colliding trajectory, the stability margin and the smallest eigenvalue of the accumulated state Gramian vanish linearly, although the Gramian remains positive definite before collision. Numerical experiments examine the dependence on initialization, slow passage near a critical direction, and the effect of adding excitation in a second state direction.

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Regions of Attraction for Transverse Feedback Linearization under Controller Singularities

cs.AI eess.SY ·2026-11-17 ·Abdullah Waqar Malik, Hamza Tariq, Adeel Akhtar
code/data similarity 0.61
Abstract · 27 pages (10 main + references + appendix), 1 figure, 8 tables

Transverse feedback linearization (TFL) achieves path following by exactly linearizing the error dynamics, but its controller is undefined on a singular set, such as zero speed for a unicycle or zero thrust for a quadrotor. The constrained region of attraction, the set of initial states from which the closed loop converges to the path without violating state or regularity constraints, determines where the controller can be safely activated. Exploiting the exact linear error dynamics, we show that this region is the largest forward invariant subset of the admissible set. We then decompose its state-constrained Zubov value function into an analytically known quadratic cost-to-go and a safety value function. We learn only the latter, by fitted value iteration without infinite-horizon trajectory labels. The resulting estimate combines an inner layer verified by interval branch and bound with a learned outer layer tested on samples. On a unicycle following a circle and a sinusoid and on a planar quadrotor, it covers on average 72.0%, 83.4% and 19.1% of the simulated region of attraction. In comparison, the quadratic cost-to-go and two physics-informed neural network (PINN) solvers of Zubov's equation cover at most 11.3%, 4.0% and 0.0% on average. Code and animations are available at https://gradslab.github.io/roa_tfl

0.48

On the recursive feasibility and stability of MPC without terminal constraints

eess.SY math.OC ·2026-11-17 ·Mara Perez, Ignacio Sanchez, Filiberto Fele, Daniel Limon
similarity 0.60
Abstract · 6 pages, 1 figure. Comments are welcome!

In this paper, we analyze stability and recursive feasibility of a model predictive control (MPC) scheme that does not rely on terminal ingredients -- such as terminal constraints or a terminal cost based on a terminal controller. In the proposed formulation, we augment the cost function by a weighted finite tail which is optimized online, and we show it plays the role of a stabilizing terminal cost. Under a relaxed, local dynamic programming condition on the tail, we certify a family of regions -- parameterized by the tail's weight coefficient -- on which the problem is recursively feasible and the origin is asymptotically stable. These regions are larger as the weight increases: in particular, we show that any state that can be steered within the control horizon to a predefined neighborhood of the origin is contained in a certified region for a sufficiently large weight. Finally, we characterize the closed-loop performance over the certified region, bounding the suboptimality of the closed loop with respect to the infinite-horizon optimal cost. We conclude the discussion by illustrating these results on a simple numerical example.

0.29

Iterative State- and Control-Dependent Model Predictive Control: A Jacobian-Free Formulation for Constrained Nonlinear Systems

eess.SY math.OC ·2026-08-15 ·Mohammadreza Kamaldar
theory similarity 0.59
Abstract

This paper presents an iterative model predictive control algorithm that stabilizes constrained nonlinear systems without evaluating a single plant derivative. By factoring the exact nonlinear dynamics into a pseudo-linear form using state- and control-dependent coefficients (SCDCs), we replace the standard nonconvex optimization with a sequence of constrained linear-quadratic programs. Refreezing the coefficient matrices along the previously predicted trajectory drives the iteration. Near the origin, we prove this sequence contracts to a unique fixed point. We explicitly bound the number of iterations required to reach any stopping tolerance, and we quantify the distance from the fixed point to a true Karush-Kuhn-Tucker point, showing this optimality gap vanishes quadratically as the state approaches the origin. Inflating the discrete algebraic Riccati equation generates terminal ingredients that guarantee recursive feasibility and asymptotic stability, even when the solver terminates early. We adapt the terminal penalty online, proving it remains uniformly bounded, and we secure output feedback through the block-observable canonical form, which extracts the exact system state directly from past inputs and outputs. Retaining the block-banded structure of the subproblem forces the computational cost to scale linearly with the horizon length $\ell$. This $O(\ell)$ complexity matches the iterative linear quadratic regulator (iLQR) but sharply undercuts the $O(\ell^3)$ scaling of dense sequential quadratic programming (SQP). Numerical studies on a saturated quadrotor, a nonholonomic integrator, and a nonminimum-phase plant illustrate the theoretical bounds and map how the algorithm compares with iLQR, SQP, and linear-parameter-varying MPC.

0.34

Decentralized Safe Path Following for Multiple Quadrotors on Intersecting Paths with Theoretical Guarantees

eess.SY cs.ROmath.OC ·2026-09-20 ·Hamza Tariq, Adeel Akhtar
code/datahot direction similarity 0.58
Abstract · 8 pages, 3 figures

This paper studies decentralized safe path following for multiple quadrotors on intersecting paths, where safety requires both collision avoidance and strict adherence to pre-assigned routes. The proposed controller reformulates transverse feedback linearization as a constrained quadratic program with four equality constraints: two enforce convergence to and strict adherence to the path, and two prescribe the desired speed and heading. Safety is achieved by relaxing only the along-path speed constraint, while the path and heading constraints remain hard. Under the stated assumptions, and for admissible initial conditions, the controller guarantees that all agents converge to and thereafter follow their assigned paths, avoid collisions, and avoid attitude singularities. We evaluate the controller in the Drake physics engine on non-planar intersecting paths and compare it against two nominal-plus-safety-filter cascades. Code and additional results are available at https://gradslab.github.io/safe_multiquad_pf/.

0.64

Optimal Decay Matrix Control Barrier Functions: Soundness and Completeness for Matrix Safety Constraints

eess.SY math.OC ·2026-10-13 ·Samuel G. Gessow, Albert Wu, Aaron D. Ames, Brett T. Lopez
similarity 0.57
Abstract

Many safety requirements, such as keeping a manipulator away from kinematic singularities, a network connected, or a system observable, amount to keeping a state-dependent matrix positive definite. Matrix control barrier functions (MCBFs) enforce such requirements with a semidefinite program that minimally modifies a nominal control input. The MCBF constraint bounds how fast the safety margin, the smallest eigenvalue of the matrix, may decay. Yet a fixed decay rule is conservative, rejecting safe controls that drive the state quickly toward, but never across, the boundary of the safe set. Scalar optimal decay (SOD) addresses this issue by scaling the decay term by a scalar weight that is optimized together with the control. For scalar barrier functions, SOD then rejects a control at the boundary only if the control would decrease the margin. For MCBFs, however, SOD can reject controls that leave the margin unchanged, and near the safety boundary SOD accepts such controls only at a high cost. We introduce matrix optimal decay (MOD), which replaces the scalar weight with a matrix multiplier while keeping the semidefinite program convex. MOD is provably sound and complete, certifying at the boundary exactly the controls that do not decrease the margin. If some control can strictly increase the margin at every boundary point, the MOD-MCBF filtered controller is continuous and renders the safe set forward invariant. We also add an optional recovery condition that drives the system toward the safe set after a violation without affecting soundness or completeness. On a planar two-link arm avoiding singularities, MOD-MCBF certifies safe motions that both a fixed decay rule and SOD reject, and tracks an end-effector target more closely than SOD.

0.21

Parallel Policy-Gradient Methods for Parameter Optimization of Nonlinear Feedback Controllers

eess.SY math.OC ·2026-09-12 ·An Nguyen, Leilei Cui
similarity 0.57
Abstract

Structured feedback controllers provide rigorous stability guarantees, but often require manual parameter tuning to achieve good closed-loop performance. Policy-gradient methods offer a systematic approach to parameter optimization; however, conventional gradient evaluation requires sequential forward state rollout and backward costate propagation. This letter develops a time-parallel policy-gradient framework for discrete-time nonlinear control-affine systems. We derive the policy-gradient expression where the state and costate rollouts required for policy-gradient evaluation are formulated as residual-minimization problems and solved using Gauss-Newton (GN) iterations with parallel associative scans. For closed-loop systems that are globally asymptotically stable and locally exponentially stable, we show that the residual-minimization problems satisfy a local Polyak-Lojasiewicz (PL) inequality and that the GN iterates converge locally at a quadratic rate. Moreover, the PL constant, the size of the convergence neighborhood, and the quadratic convergence bound are independent of the rollout horizon T. We also prove that, for any finite horizon T, the state solver recovers the exact trajectory from any initialization in at most T iterations. Finally, an inertia-wheel pendulum example with interconnection and damping assignment passivity-based control (IDA-PBC) demonstrates improved closed-loop performance and the computational benefits of the proposed parallel policy-gradient framework.

0.19

General-Sum Linear Regulator Games for Positive Systems

eess.SY math.OC ·2026-08-24 ·Alba Gurpegui, Monika Tomar, Takashi Tanaka
publishedtheory similarity 0.56
Abstract · 6 pages and 3 figures. Accepted for presentation at the 65th IEEE Conference in decision and control 2026 (CDC)

This paper studies a continuous-time general-sum non-cooperative game with linear costs, positive linear system dynamics, and elementwise linear input constraints. In the finite-horizon case, we present a verification theorem characterizing feedback Nash equilibria, in terms of absolutely continuous solutions of a coupled system of vector-valued ordinary differential equations, realized by time-varying feedback laws. Unlike linear-quadratic differential games, whose Riccati-based equilibria scale quadratically with the state dimension, this formulation scales linearly. However, the resulting piecewise-constant feedback saturates between its constraint bounds rather than varying smoothly, and additional mathematical challenges arise when characterizing the solutions of the differential equations, which are generally discontinuous due to the switching nature of the feedback gains. In this work, we study the case where switching occurs only at isolated time instants. In the infinite-horizon case, under stabilizability assumptions, the equilibrium is characterized by coupled vector-valued algebraic equations. For this game, we propose iterative methods to compute both finite and infinite-horizon equilibria. The approach is illustrated through a large-scale pollution game.

0.26

A Frequency Domain Approach to Bounding Riccati Equation Perturbations

eess.SY math.OC ·2026-09-29 ·Rachel Newton, Laura Balzano, Peter Seiler
similarity 0.56
Abstract · 7 pages. Submitted to IEEE Control Systems Letters pending review

The discrete algebraic Riccati equation (DARE) is used to solve for the optimal feedback gain in linear-quadratic regulator (LQR) control of discrete-time systems. In this letter, we consider the effect of perturbations to the LQR data on the DARE solutions. We present a new frequency domain approach to derive an explicit bound on the difference in DARE solutions under such perturbations. Our bounds are similar to other results that have recently appeared in the literature with two distinctions. First, we use a frequency domain constant that measures the degree of closed-loop stability, in contrast to other results that use a time domain measure. Second, we start from weaker detectability assumptions on the LQR state cost matrix.

0.22