CS Paper Radar

Square Root Gauss-Newton iLQR

Maximilian Haas-Heger, Jur van den Berg

cs.RO math.OC ·submitted 2026-09-17 20:14 UTC · v1

Abstract

The iterative Linear Quadratic Regulator (iLQR) is a widely used algorithm for nonlinear trajectory optimization. At each iteration, it solves a local linear-quadratic approximation of the problem via dynamic programming, propagating a quadratic cost-to-go function. If the Hessian of the cost-to-go approximation is positive-semidefinite, one can derive a square root formulation of iLQR that propagates its Cholesky factor instead. This offers significant numerical advantages - much as square root Kalman filters improve upon their conventional counterparts - particularly when iLQR is used within an augmented Lagrangian framework for handling constraints, where large penalties degrade conditioning. Previous square root formulations of iLQR and related algorithms exist, but they are either numerically suboptimal, algorithmically complex, or both. In this paper, we show that the key to an effective square root formulation lies in the Gauss-Newton (weighted least-squares) structure of the cost function: this yields a positive semidefiniteness property that extends beyond the Hessian to the full augmented cost-to-go matrix, and enables a backward pass of remarkable simplicity in which each step reduces to a single QR-decomposition, from which the feedback gain and propagated Cholesky factor are extracted directly.

Comment
16 pages, 2 figures, ISRR 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Moving Horizon Estimation for Quadrotors: An $\mathcal{L}_1$ Adaptive Optimizer Approach

cs.RO eess.SY ·2026-09-25 ·Thinh Nguyen, Minkyung Kim, Sandeep Banik, Jinrae Kim, Naira Hovakimyan
published similarity 0.67
Abstract

Moving Horizon Estimation (MHE) is a state estimation method based on finite-horizon optimization that can offer higher accuracy at the cost of increased computation compared to Kalman filter-based approaches. We present a linear smoothing MHE formulation as a dense Quadratic Program (QP), and a solver consisting of a continuous-time Newton's method augmented with the $\mathcal{L}_1$ Adaptive Optimizer ($\mathcal{L}_1$-AO). While MHE is inherently time-varying, conventional approaches treat it as a sequence of independent, time-invariant problems and employ iterative solvers at each time step, which can be both inaccurate and computationally burdensome. In contrast, time-varying solvers track the optimal solution with fewer iterations by exploiting the temporal evolution of the problem, thereby reducing the computational load. In this research, we enhance both the performance and efficiency of MHE through a time-varying solver with an $\mathcal{L}_1$-AO augmentation that compensates for the prediction inaccuracy, which is common in practice due to noisy sensors and the lack of prior knowledge of the system. Simulation results on a quadrotor platform show that the $\mathcal{L}_1$-AO-augmented approach solves the MHE optimization problem more efficiently than the baseline time-invariant solver and achieves higher estimation accuracy under challenging conditions, compared with both the Extended Kalman Filter and the standard MHE.

0.28

Inverse Linear Quadratic Gaussian Games: Constrained Setting and Transferability

eess.SY ·2026-09-24 ·Kai Ren, Maryam Kamgarpour
similarity 0.61
Abstract

This work addresses finite-horizon inverse linear quadratic Gaussian games. In a constrained setting, we characterize the set of cost parameters and optimal dual values that generate a given generalized Nash equilibrium, and we propose an algorithm to compute these parameters. In an unconstrained setting, we address transferability, namely, we bound the cost value perturbation between two policies: one induced by the identified cost parameters, the other by the expert parameters, under a set of different dynamics. This cost value perturbation scales linearly with the deviations in the dynamics and the identified cost parameters. Through numerical simulations, we show that, in a constrained setting, our algorithm identifies the cost parameters and dual values that can reproduce the policy and trajectories corresponding to the observed generalized Nash equilibrium. In an unconstrained setting, we show with a traffic simulation and real-robot experiments that the identified cost parameters can be used to control sufficiently close dynamics, with performance degrading linearly with the deviations in the dynamics and the identified cost parameters.

0.33

No Spurious Local Minima in Full-Order Linear Quadratic Gaussian Control

eess.SY math.OC ·2026-09-26 ·Yang Zheng, Yujie Tang
similarity 0.59
Abstract

This paper studies the nonconvex optimization landscape of Linear Quadratic Gaussian (LQG) control under direct state-space parameterization. Although the LQG cost may possess suboptimal stationary points, whether it admits suboptimal local minima has remained open. We answer this question negatively: Every local minimum of the full-order LQG cost is globally optimal. More generally, at any controller order, every local minimum corresponding to an uncontrollable or unobservable realization attains the globally optimal LQG cost over all stabilizing policies of arbitrary orders. We further show that any suboptimal policy can be augmented with decoupled stable controller states, so that the augmented policy admits a direction of negative curvature with probability one. Consequently, any suboptimal stationary point in full-order LQG cost can be converted into a strict saddle with probability one. One key proof idea connects the state-space Hessian to a frequency-domain global-optimality condition derived from the Youla parameterization. These results reveal a benign local-minimum landscape despite the presence of suboptimal stationary points.

0.47

Control and Estimation Co-Design via Envelope-Theorem Gradients

eess.SY math.OC ·2026-09-28 ·Mohammad S. Ramadan, Philip Dinenis, Mihai Anitescu
theory similarity 0.59
Abstract

Instead of the sequential plant--control--estimator design pipeline, which is in general not optimal, we propose the Control and Estimation Co-Design (ContEst) framework, which poses the entire system design as a single two-stage problem solved by first-order methods. A key enabler is that the gradient of each inner control/estimation optimal cost with respect to the design parameters is available from the dual variables the inner solver already returns, by the envelope theorem: exactly under mild regularity (a unique inner minimizer), and as a subgradient under more relaxed conditions. That is, no differentiation through the optimizer or its optimality conditions is needed. We first present the framework in a linear quadratic Gaussian (LQG) regime, where the control and estimation costs become two semidefinite programs (SDPs) whose design gradients are read from the duals of the Lyapunov constraints. We extend the results to robust ($H_\infty$) formulation to cover worst-case control and filtering problems. We also present an extension to constrained and nonlinear systems, using an extended Kalman filter (eKF) and a local linearization of the information-state dynamics to yield an approximate but convex model predictive control (MPC) problem whose design gradients are read directly from the costates. We apply our methods to a variety of realistic design examples from different fields and report significant design improvements.

0.18

A Behavioral approach to Constrained Linear Quadratic Control: Feasibility and Optimality

eess.SY math.OC ·2026-10-29 ·Soutrik Bandyopadhyay, Debasattam Pal, Shubhendu Bhasin
published similarity 0.59
Abstract · Accepted for publication at IEEE Indian Control Conference 2027

This paper develops a constrained linear-quadratic (LQ) optimal control framework within the behavioral approach. Unlike classical formulations that rely on state-input representations, our method treats both the system dynamics and the constraints as trajectory-level objects. The system is modeled through a kernel representation, while inequality constraints are captured using behavioral inequalities defined over infinite-dimensional convex cones. Using quadratic differential forms (QDFs) to encode performance indices, we formulate the constrained LQ problem as a convex variational optimization over trajectories. By employing Gateaux differentials, we derive the stationarity and complementarity conditions and show that they admit a representation as an augmented behavioral system whose unique decomposition into autonomous and controllable sub-behaviors yields a complete parameterization of all optimal constrained trajectories. The resulting conditions constitute a behavioral analogue of the Karush-Kuhn-Tucker (KKT) framework. A numerical example illustrates the effect of inequality constraints on the optimal behavior. The framework provides a general, trajectory-level representation for constrained optimal control and opens avenues for closed-loop and data-driven extensions.

0.41

An Adaptive, Parallel, and Inexact Newton Method for Large-scale Nonlinear Optimal Control

eess.SY math.OC ·2026-09-27 ·Luke Bhan, Michael W. Mahoney, Sen Na
theory similarity 0.59
Abstract · 31 pages

We design adaptive overlapping temporal decomposition (AOTD), a parallel sequential quadratic programming (SQP) method for long-horizon nonlinear optimal control problems (OCPs). As designed, AOTD is the first overlapping temporal decomposition (OTD) algorithm that adapts the overlap size online, eliminating the need to fix a suitable overlap a priori. Specifically, at each iteration, it partitions the long horizon into overlapping nonlinear subproblems, performs one SQP step on each in parallel, and adaptively selects both the overlap size and the accuracy to which the resulting local KKT systems are solved. Two conditions govern the accepted step: an adaptive residual condition bounding the distance from the concatenated inexact direction to the exact Newton direction of the full problem, and a descent condition on the adaptive penalty parameters that certifies descent for a carefully chosen exact augmented Lagrangian. The residual condition is solver independent and accommodates both deterministic iterative solvers and randomized sketching solvers. Under standard regularity assumptions, we prove that the KKT residual converges to zero from any initialization and establish a local linear rate for sequences converging to a strict local minimizer. We validate AOTD on a power-system frequency regulation OCP and a Burgers PDE OCP, attaining a reduction in estimated FLOPs of approximately $2.5\times$ to the best fixed-overlap variant while converging across multiple horizon lengths with a single parameter setting.

0.28

Data-Driven LQR with Uncertainty Refinement and Domain Randomization---Part~II: Fisher-Majorized Certified Policy Iteration

eess.SY ·2026-10-24 ·Hamidreza Modares
theory similarity 0.59
Abstract

Building on the uncertainty description developed in Part~I, this paper introduces a Fisher-majorized domain-randomized generalized policy iteration framework for data-driven linear quadratic regulator (LQR) synthesis. At each iteration, partial Bellman evaluation over a fixed batch of uncertainty realizations produces a structured Sylvester policy-improvement step. A residual-weighted Fisher curvature controls the policy-induced variation in the stationary covariance and converts the Sylvester model into a certified upper bound on the cost change, thereby guaranteeing descent for every accepted step. A check-and-correct mechanism then certifies stability over the entire uncertainty support, rather than only over the sampled realizations. Consequently, every iterate is robustly stabilizing and monotonically decreases the fixed-batch objective. The Fisher truncation and stability correction become inactive after finitely many times. The objective gap then contracts linearly to a floor determined by the dispersion of the realization-wise Riccati targets and by measurement noise. In the absence of measurement noise, this floor vanishes when the realization-wise targets coincide.

0.30

A Local-Linearly Convergent Algorithm for Nonconvex Equality-Constrained Optimization

cs.LG math.OCstat.ML ·2026-08-12 ·Frank E. Curtis, Lingjun Guo, Daniel P. Robinson
similarity 0.59
Abstract

For solving nonconvex equality-constrained optimization problems, a recent Gradient-Eigenstep Algorithm by Goyens et al.~is an iteration-efficient approach, based on minimizing Fletcher's augmented Lagrangian function, for finding an approximate second-order stationary point from an arbitrary starting point. In this paper, the analysis of this algorithm is extended, offering a two-fold contribution. First, it is shown that a local-linear rate of convergence can be obtained by this method if it is initiated sufficiently close to a strong second-order stationary point and employs a sufficiently small step-size parameter and sufficiently large penalty parameter. In this case, the algorithm reduces to a gradient descent algorithm applied to minimize Fletcher's augmented Lagrangian. Second, as a particularly useful application of the first result, it is shown that the Gradient-Eigenstep algorithm can be used as an iteration-efficient subproblem solver in the context of a progressive sampling strategy for solving equality-constrained optimization problems when the objective and constraint functions are defined by large sample averages, ultimately offering an algorithm with an improved worst-case sample complexity when compared to an approach that solves a full-sample problem directly.

0.04