CS Paper Radar

Generalized Semi-Infinite Programming for Robust Optimal Control with Decision-Dependent Uncertainty

J. Wehbeh, E. C. Kerrigan, E. Scaccia

eess.SY math.OC ·submitted 2026-09-01 17:05 UTC · v1
benchmark

Abstract

Generalized semi-infinite programs (GSIPs) arise in robust optimal control whenever the admissible uncertainty depends on the state or controls. Existing GSIP methods either impose restrictive structural assumptions or require global optimization that scales poorly to control problems. We present a general framework that reformulates any GSIP with mild regularity as an existence-constrained semi-infinite program, smoothing its disjunctive feasibility condition into differentiable existence constraints over a fixed index superset. The resulting program is solved by established adaptive discretization (cutting-plane) methods using only off-the-shelf nonlinear-programming solvers, and converges under standard assumptions. Treating the state trajectory as part of the uncertainty extends the framework to robust nonlinear optimal control with state-dependent uncertainty. We demonstrate it on a nonconvex benchmark GSIP and a satellite de-tumbling problem with dynamically varying inertia.

Comment
6 pages, 0 figures, submitted to Transactions on Automatic Control

Closest papers

Nearest neighbours by meaning across the whole index.

Robust Game-theoretic Motion Planning over Extended Time Horizons

cs.MA eess.SY ·2026-09-26 ·Bennet Outland, Vishala Arya
similarity 0.60
Abstract

This work presents a solution to nonconvex, game-theoretic motion planning problems subject to disturbances over long time horizons. The problem is posed as a partially-decoupled generalized Nash equilibrium problem, in which each agent's dynamics depend only on its own state and control, admitting fast solution methods for competitive multi-agent motion planning. An algorithm, WOLF, is developed that applies receding-horizon model predictive control to an open-loop differential games solver based on sequential convexification. In contrast to robust formulations that fix the uncertainty description offline, the robustness tube here is itself a dynamic state, co-optimized with the trajectory, and its thickness directly sets the tightening of the shared coupling constraints. A sufficient condition is derived under which a nominal trajectory satisfying constraints tightened against all agents' error bounds remains feasible for every admissible disturbance realization. The method is demonstrated on two adversarial on-orbit games with coupled translational-attitude dynamics: a stealthy co-orbital jamming game under an active detection-probability bound, and a sun-blocking game in which an adversary disables an evader by decreasing solar power

0.25

Constrained minmax density transportation for linear parabolic PDEs: a numerical optimal control perspective

eess.SY math.OC ·2026-08-19 ·Siddhartha Ganguly, Vaibhav Upadhyay, Kenji Kashima, Debasish Chatterjee
similarity 0.60
Abstract · Revised version of a journal submission; 15 pages (2-col)

This article introduces a numerical optimal control framework for minmax constrained density control for a class of noisy linear parabolic partial differential equations (PDEs), in particular the noisy heat equation. The goal is to transport an initial density to a target density while minimizing a specified cost with respect to control actions and maximizing it with respect to disturbances, all within a fixed time horizon while satisfying given convex path constraints. To address this, the spatial derivatives in the PDE are discretized using finite-difference approximations, transforming the problem into a system of ordinary differential equations in time. The admissible space of control and disturbance trajectories is then finitely parametrized, and the resulting optimal control problem is formulated as a convex semi-infinite program (SIP) under mild assumptions. By leveraging new numerical tools from convex SIP theory, we establish guarantees for exact solutions that account for constraint satisfaction under an infinite family of disturbance realizations, and we establish an optimization-based computationally efficient algorithm to recover these solutions. Comprehensive numerical examples to demonstrate and validate our findings are included.

0.18

Weak Convexity and Proximal Bundle Methods for Nonsmooth Policy Optimization in Robust Control

eess.SY math.OC ·2026-09-05 ·Yuto Watanabe, Feng-Yi Liao, Yang Zheng
similarity 0.58
Abstract · 36 pages, 15 figures

We study policy optimization for discrete-time robust $\mathcal{H}_\infty$ control with static output-feedback, and present the first feasibility-preserving algorithm with a deterministic, non-asymptotic complexity guarantee. This problem naturally leads to a nonsmooth and nonconvex optimization over the set of stabilizing feedback gains. We first establish several structural properties of the $\mathcal{H}_\infty$ cost. In particular, we show that the cost is weakly convex on every convex subset of a sublevel set. For the state-feedback case, we further establish a weak Polyak--Łojasiewicz inequality, which ensures that every stationary point is globally optimal. Building on these properties, we develop a proximal bundle method for $\mathcal{H}_\infty$ policy optimization. The proposed method can be viewed as an implementable approximation of the proximal point method and uses only function value and subgradient information. We show that all iterates remain stabilizing and establish a deterministic non-asymptotic complexity bound of $\mathcal{O}(\max\{η^{-4},ε^{-2}\})$ for finding an $(η,ε)$-stationary point. Numerical experiments illustrate our theoretical results.

0.30

Regret-Optimal Linear-Quadratic Control under Distributional Drift

eess.SY math.OC ·2026-10-06 ·Lukas-Benedikt Fiechtner, Jose Blanchet
similarity 0.58
Abstract · 16 pages, 2 figures, 1 table. Submitted to the 2027 American Control Conference (ACC); under review

We study finite-horizon LQR with independent disturbances whose laws may drift over time. We address uncertainty in this evolution through ex-ante distributionally robust regret optimization (DRRO), which minimizes worst-case excess expected cost relative to the optimal causal controller that knows the law sequence. To specify the admissible law sequences, we introduce a temporally coupled moment ambiguity set with a Gelbrich kinetic-energy budget and a second budget limiting departures from reference moments and persistent cumulative mismatch. Despite the coupling of moments across time, affine disturbance-feedback synthesis reduces exactly to a semidefinite program. An optimal policy uses past disturbances to predict the correction to nominal LQR determined by current and future disturbance means. The SDP solution also yields worst-case moment paths and corresponding laws. For standard distributionally robust optimization (DRO), the analogous SDP relaxation can have a duality gap. Portfolio liquidation experiments show substantially lower worst-case regret over the drifting ambiguity set than common-law DRRO and nominal control.

0.29

First-Order Model-Free Policy Gradient for Undiscounted LQR with Global Optimality and Convergence Guarantees

eess.SY math.OC ·2026-11-16 ·Vipul K Sharma, S Sivaranjani
similarity 0.57
Abstract

We provide a first-order model-free policy gradient (PG) framework for learning undiscounted infinite-horizon linear quadratic regulator (LQR) policies with global optimality and convergence guarantees. We first construct a stochastic wrapper policy class parameterized by the LQR gain to enable exploration around a deterministic linear control law. We analyze the additional cost induced by exploration over infinite-horizon, and establish a weak gradient dominance condition that characterizes global optimality under exploration. We then construct a model-free first-order PG algorithm using sampled trajectory information, without identifying the dynamics or approximating a value function. Finally, we establish finite-time convergence guarantees, providing the sufficient number of samples required for near-global optimality with our proposed PG algorithms.

0.21

Adaptive dynamic programming using Lyapunov function constraints

eess.SY math.OCmath.DS ·2026-10-08 ·Thomas Göhrt, Pavel Osinenko, Stefan Streif
publishedhighly cited similarity 0.57
Abstract

This work is concerned with a stabilizing adaptive dynamic programming (ADP) approach to approximate solution of a given infinite-horizon optimal control problem. Since the latter problem cannot, in general, be solved exactly, a parametrized function approximator for the infinite-horizon cost function is introduced in ADP (so called ``critic''). This critic is used to adapt the parameters of the function approximator. The so called ``actor'' in turn derives the optimal input of the system. It is a notoriously hard problem to guarantee closed-loop stability of ADP due to the use of approximation structures in the control scheme. Since at least stabilizability is always assumed in the analyses of ADP, it is justified to invoke a respective Lyapunov function. The proposed ADP scheme explicitly uses the said Lyapunov function to simultaneously optimize the critic and guarantee closed-loop stability. A Hessian-free optimization routine is utilized for the actor and critic optimization problems. Convergence to prescribed vicinities of the optima is shown. A computational study showed significant performance improvement for the critic-based approach compared a nominal stabilizing controller for a range of initial conditions.

0.65

Safe Receding-Horizon Control of Fixed-Wing Aircraft Using Constrained Approximate Dynamic Programming

eess.SY ·2026-10-05 ·Felipe Arenas-Uribe, Ricardo Gutierrez, Jesse B. Hoagg
similarity 0.56
Abstract

We present a receding-horizon optimal control for fixed-wing aircraft subject to state constraints. These constraints include operational constraints such as altitude, geofencing, and obstacle avoidance, as well as bounds on flight-path angle, roll angle, and airspeed. The state constraints are composed into a single soft-minimum control barrier function (CBF). We use this composite CBF in a constrained-approximate dynamic program to obtain a sequence of analytic closed-form control functions that approximately minimize a quadratic finite-horizon integral cost subject to the CBF constraint. The resulting receding-horizon control is non-myopic in the sense that it approximately optimizes the integral cost while satisfying the state constraint at all times along the entire prediction horizon. We demonstrate constraint satisfaction and performance in simulations of a fixed-wing aircraft navigating an obstacle-filled airspace under wind uncertainty. We also compare this receding-horizon control with 2 other methods.

0.14

No Spurious Local Minima in Full-Order Linear Quadratic Gaussian Control

eess.SY math.OC ·2026-09-26 ·Yang Zheng, Yujie Tang
similarity 0.56
Abstract

This paper studies the nonconvex optimization landscape of Linear Quadratic Gaussian (LQG) control under direct state-space parameterization. Although the LQG cost may possess suboptimal stationary points, whether it admits suboptimal local minima has remained open. We answer this question negatively: Every local minimum of the full-order LQG cost is globally optimal. More generally, at any controller order, every local minimum corresponding to an uncontrollable or unobservable realization attains the globally optimal LQG cost over all stabilizing policies of arbitrary orders. We further show that any suboptimal policy can be augmented with decoupled stable controller states, so that the augmented policy admits a direction of negative curvature with probability one. Consequently, any suboptimal stationary point in full-order LQG cost can be converted into a strict saddle with probability one. One key proof idea connects the state-space Hessian to a frequency-domain global-optimality condition derived from the Youla parameterization. These results reveal a benign local-minimum landscape despite the presence of suboptimal stationary points.

0.47