CS Paper Radar

Conditions for Normality of Pontryagin's Maximum Principle in the Absence of State Constraints

André Tits, Pierre-Antoine Absil, Noé Tits

eess.SY math.OC ·submitted 2026-11-03 23:30 UTC · v2

Abstract

Pontryagin's Maximum Principle is said to be "normal" for the problem at hand when it has a solution (maximizer u*) that explicitly involves the problem's cost function, making the maximum principle helpful (while in the opposite situation it is of no help). The aim of the present paper is, for Lagrange optimal control problems without state constraints, to identify classes of problems for which the Principle is normal. General conditions are introduced that guarantee normality, and classes of problems that satisfy these conditions are identified. Such classes include problems for which the constrained (by bounds on the control values) "augmented" reachable set, with cost along an upward vertical axis, has a convex lower-boundary function and the optimal terminal state lies in the relative interior of the reachable state set, with the terminal constraint within the affine hull of that set. Such classes include problems for which the constrained (by bounds on the values of the control signal) "augmented" (with the cost value along an upward "vertical axis") reachable set has a "convex" lower boundary for which the optimal terminal state lies in the relative interior of the set of reachable states. Special attention is given to Lagrange steering problems: sufficient conditions are obtained on a nested sequence of sub-classes of such problems, culminating with the class of steering problems with scalar control signal and linear time-invariant (LTI) state dynamics and objective integrand, for which normality is guaranteed whenever all eigenvalues of the state dynamics matrix A are real (e.g., if A is symmetric or triangular or the system is overdamped) or have small enough imaginary parts; simple 2 x 2 examples show that, in contrast with the situation in the finite-dimensional case, this property does not extend to arbitrary A matrices.

Closest papers

Nearest neighbours by meaning across the whole index.

Advances in Continuous-Time Multiparametric Optimal Control: The Role of Time-Varying Active Constraints

eess.SY math.OC ·2026-10-02 ·Lida Lamakani, Efstratios N. Pistikopoulos
similarity 0.62
Abstract

Multiparametric optimal control in continuous time partitions the space of initial states into critical regions, each with its own control law involving a set of time-varying active constraints. The boundaries between two neighbouring regions are either hyperplanes, which are given in closed form by one linear equation, or curved boundaries, which must be computed. The sequence of time-varying active constraints plays a key role in defining the linear or nonlinear shape of a critical-region boundary. In this paper we show how to determine that shape prior to any computation. In particular, we show that the boundary is a hyperplane under two conditions. First, the new constraint becomes active at the same instant at every point of the boundary. Second, the durations for which the other constraints stay active are the same at every point of the boundary. Otherwise, the boundary is curved. Both conditions can be read from the sequences of active constraints of the two neighbouring regions, which gives five rules, each yielding a hyperplane or a curved boundary. We illustrate the rules on the Newell-Lee evaporator, where they classify the eight boundaries of a seven-region partition into four hyperplanes, given in closed form, and four curved boundaries, computed exactly.

0.45

Minimax optimal dual control of positive systems: an exact solution for scalar input-sign uncertainty

eess.SY math.OC ·2026-08-15 ·Fethi Bencherki, Tomas J. Meijer, Anders Rantzer
similarity 0.62
Abstract

While recent advances in minimax dual control have led to exact solutions for uncertain general linear time-invariant systems as well as (sub)optimal dual controllers, corresponding results for linear positive systems are still lacking. This paper aims to fill this gap and thereby pave the way toward scalable dual control algorithms. We study the general minimax optimal dual control problem for positive linear systems with unknown dynamics and reformulate it as a standard zero-sum dynamic game. By allowing randomized control inputs, we solve the corresponding Bellman equation exactly for the scalar case with sign uncertainty in the input. This yields an implicit dual control policy that is optimal both in terms of cost and $\ell_1$-gain. The optimal dual policy uses exploration in a specific region of the hyperstate space to conduct optimal probing. Outside this exploration regime, the controller reduces to a deterministic certainty equivalence policy, indicating that sufficient information has been obtained to identify the correct input direction. In addition, these results allow us to analyze fundamental limitations of minimax dual control for positive systems and provide a foundation for more general dual control problems for positive systems for future work.

0.04

First-Order Optimization as Minimum-Time Control

eess.SY math.OC ·2026-08-14 ·Liraz Mudrik, Isaac Kaminer, Pramod P. Khargonekar
benchmark similarity 0.60
Abstract · 13 pages, 4 figures

We formulate first-order optimization as a minimum-time control problem. The iterate is the state, the update, a combination of the gradients observed so far, is the control, and the points with gradient norm at most a prescribed tolerance form the target set. For a fixed objective and start, the minimum number of oracle queries needed to reach the target is a value function: it measures the complexity of the instance, not the worst case over a class. On a strongly convex quadratic, the conjugate gradient iterates emerge from the discrete Pontryagin conditions, and the value is a controllability index. Beyond the quadratic, a Hessian-generated reachable span replaces the controllability matrix, and feasibility becomes a reachability question: whether a critical point can be reached at all, and in how many steps, is read from the span. Curvature is a resource: a checkable condition certifies that an instance needs fewer steps than the controllability index of its quadratic model at the minimizer, and the gap can grow without bound with the dimension. The value is thus a benchmark for the intrinsic difficulty of each instance, against which any first-order method can be measured.

0.10

Constrained minmax density transportation for linear parabolic PDEs: a numerical optimal control perspective

eess.SY math.OC ·2026-08-19 ·Siddhartha Ganguly, Vaibhav Upadhyay, Kenji Kashima, Debasish Chatterjee
similarity 0.59
Abstract · Revised version of a journal submission; 15 pages (2-col)

This article introduces a numerical optimal control framework for minmax constrained density control for a class of noisy linear parabolic partial differential equations (PDEs), in particular the noisy heat equation. The goal is to transport an initial density to a target density while minimizing a specified cost with respect to control actions and maximizing it with respect to disturbances, all within a fixed time horizon while satisfying given convex path constraints. To address this, the spatial derivatives in the PDE are discretized using finite-difference approximations, transforming the problem into a system of ordinary differential equations in time. The admissible space of control and disturbance trajectories is then finitely parametrized, and the resulting optimal control problem is formulated as a convex semi-infinite program (SIP) under mild assumptions. By leveraging new numerical tools from convex SIP theory, we establish guarantees for exact solutions that account for constraint satisfaction under an infinite family of disturbance realizations, and we establish an optimization-based computationally efficient algorithm to recover these solutions. Comprehensive numerical examples to demonstrate and validate our findings are included.

0.18

On the Value Function of Infinite-Horizon Optimal Control of Piecewise Affine Systems

eess.SY math.OC ·2026-08-20 ·Francesco Cordiano, Kanghui He, Bart De Schutter
similarity 0.59
Abstract · Submitted to IEEE Transactions on Automatic Control

In this paper, we study the structure of the value function in constrained infinite-time optimal control (CITOC) problems of piecewise affine (PWA) systems, with $\ell_1$ or $\ell_\infty$ stage cost. Existing works, such as [1], establish that the resulting value function is PWA in the state. However, existing results do not analyze whether the value function is a proper PWA function, i.e., with a finite number of affine pieces over compact sets, or whether the number of pieces can be infinite. We show that the latter case is indeed possible by means of an explicit example, which is also instrumental in establishing rigorous and easily verifiable sufficient conditions that ensure that the resulting value function is a proper PWA function. Our theoretical findings complement well-known results, e.g., the linear-quadratic case, and serve as support for recent learning-based control schemes for PWA systems. Throughout the paper, the proposed results are illustrated by means of a numerical example.

0.15

Joint-Feasibility Margin Feedback for Bounded-Input Second-Order Control Barrier Functions

cs.RO ·2026-10-12 ·Siyuan Yang, Shaoming He
code/data similarity 0.59
Abstract · 6 pages, 3 figures

Multiple second-order control barrier function constraints can exhaust their common control authority under bounded acceleration, even when the current state remains feasible. We define a signed local joint-feasibility margin whose sign exactly identifies whether the current barrier half-spaces intersect the admissible input set. For unit-scaled distance constraints, it has acceleration units and a support-function dual that identifies weighted constraint conflicts. We predict the margin one sample ahead for nine task-directed candidates, selecting either the least-deviating candidate that attains a desired margin or the candidate with the largest predicted margin before solving the same hard HOCBF quadratic program. A controlled one-step case shows that, at the state predicted under the hard-QP command, two constraints remain individually feasible but become jointly infeasible, whereas the margin-feedback controller retains a positive next margin. Separately, across 20 paired initial conditions, the margin-feedback controller retains the hard-QP command in a low-pressure task and acts at positive margin in a critical task before the hard-QP problem becomes infeasible; its trajectories remain feasible at that time and complete the task. Source code is publicly available. https://github.com/xirhxq/cbf/tree/robio2026-preventive-regulation

0.26

Boundary-Seeking Policy Gradient for Safe Reinforcement Learning

cs.LG ·2026-08-10 ·Chenhua Fan, Jiahui Zhu, Yuhang Zhang, Honghao Wei
similarity 0.59
Abstract · CDC 2026

Safe reinforcement learning maximizes reward subject to safety constraints. For Constrained Markov Decision Processes, the linear-programming view over occupancy measures implies that whenever the constraint is active at optimality, the optimal policy lies exactly on the constraint boundary, yet standard gradient-based methods do not exploit this structure and often settle in the feasible interior. We introduce Boundary-Seeking Policy Gradient (BSPG), a first-order method whose update combines a tangential component that improves reward while preserving cost to first order with a signed, residual-driven normal component that regulates the policy toward the active boundary from either side; the combined direction admits an algebraic Lagrangian form with an induced coefficient and no learned dual variable. Under exact gradients and stated regularity conditions, the constraint residual converges to zero from either side with a finite-horizon $O(1/\sqrt{T})$ bound, the tangential component is a reward-ascent direction on the boundary, and any convergent parameter sequence is stationary on the active constraint set, satisfying the KKT conditions when the limit is also a local maximizer over the feasible set. This complements existing analyses, which certify feasibility but do not characterize the constraint value at convergence. On a standard Safety-Gymnasium navigation task, BSPG attains higher reward while tracking the boundary more tightly than the compared baselines.

0.12

On Exact Critical-Region Boundaries in Continuous-Time Multiparametric Optimal Control Problems

eess.SY math.OC ·2026-10-23 ·Lida Lamakani, Efstratios N. Pistikopoulos
similarity 0.58
Abstract

Continuous-time multiparametric model predictive control solves the optimal control problem once, offline, for every initial state, and divides the initial-state space into critical regions, each with its own control law and sequence of active constraints. A boundary between two regions is either a hyperplane, given by one linear equation, or curved. The curved boundaries have not been computed to date; a classifier has been trained instead to distinguish the regions, so the partition has been known only approximately. In this paper we show that a curved boundary can be computed exactly, without solving any optimal control problem. The method rests on one property. Once the sequence of active constraints is fixed, together with the instants inside it at which a constraint becomes active or inactive (the switching times) and the instant at which the change of the neighboring region first appears (the event time), every condition on a boundary is a linear equation in the initial state, so the computation of a boundary, curved or not, is exact. We fix one of these instants, a switching time or the event time, and solve the linear equations that correspond to it for the corresponding initial state on the boundary; stepping the fixed instant along the horizon yields the whole boundary. A hyperplane is the case in which no instant is left to fix. We illustrate the method on the Newell-Lee evaporator, which has seven critical regions and eight boundaries, four hyperplanes and four curved, computing one boundary of each type in full with the adjacent regions at its ends.

0.08