CS Paper Radar

Bounded Linear Programs for Data-Driven Optimal Control via Moment-Matching

Andrea Martinelli, Lucia Pezzetti, Niklas Schmid, Florian Dorfler, John Lygeros

eess.SY math.OC ·submitted 2026-08-25 15:27 UTC · v1
published

Abstract

Linear programming (LP) formulations offer a conceptually elegant approach to infinite-horizon, model-free nonlinear optimal control in continuous spaces. However, in addition to the curse of dimensionality, their practical use is limited by the difficulty of consistently obtaining bounded solutions. In this work, we use moment-matching techniques to derive sufficient boundedness conditions in terms of the available dataset and the cost vector of the LP. Moreover, we discuss practical design methods for nonlinear systems and polynomial features.

Journal ref
IEEE Control System Letters, vol. 10, pp. 2065-2070, 2026
DOI
10.1109/LCSYS.2026.3706924

Closest papers

Nearest neighbours by meaning across the whole index.

HALO-LP: A Homogeneous All-Shifted Non-Interior-Point Method for Linear Programming

cs.RO ·2026-10-31 ·Jose Rojas, Ana Aguilar, Eusebio Bugarin
similarity 0.53
Abstract

This letter introduces HALO-LP, a novel homogeneous all-shifted non-interior-point method for linear programming (LP). The proposed method combines a homogeneous self-dual (HSD) embedding with all-shifted nonlinear complementarity (NCP) functions and proximal primal-dual regularization, enabling arbitrary primal-dual warm starts without requiring strictly interior iterates. The resulting Newton equations admit a condensation based on a positive-definite matrix that can be efficiently factorized using Cholesky decomposition, while the HSD embedding enables primal and dual infeasibility detection through Farkas certificates. Numerical evaluations on perturbed LP instances derived from the Netlib test set demonstrate state-of-the-art warm-starting performance, outperforming the competing solvers in the evaluated setting. We further validate optimality and infeasibility detection on analytically characterized LP problems. Finally, we demonstrate HALO-LP's applicability to robotic optimal control through sequential linear programming (SLP) for centroidal walking and trotting of quadrupedal robots.

0.30

Antagonistic Control: Foundations, Scalability and Nonlinearity

eess.SY math.OC ·2026-08-23 ·Sribalaji C. Anand, André M. H. Teixeira
similarity 0.52
Abstract · Under review

This paper studies the worst-case impact of constrained control inputs: an input seeks to maximize the average cost of some outputs, measured in the $L_2$ or $L_1$ norm, while remaining bounded in terms of other outputs. This problem template subsumes classical metrics such as the $H_\infty$ norm and the output-to-output gain, and arises in adversarial control, security assessment, and robust control. For linear time-invariant systems, we provide an exact semi-definite program (SDP) when there is a single constraint, and SDPs computing upper bounds when there are multiple constraints. We derive sufficient conditions, in terms of system zeros and relative degrees, under which the worst-case cost is unbounded, together with a constructive closed-loop modification that removes the unboundedness. From a security standpoint, unbounded values reveal structural limitations in detecting certain attack inputs. For positive systems, we provide scalable formulations whose complexity grows linearly in the state dimension: a scalable SDP for quadratic costs, and an exact linear program for linear costs. The results extend to nonlinear polynomial systems via a sum-of-squares program. We illustrate the results with numerical examples.

0.20

A New Approach for Feedback Stabilization and its Application for Data-Driven Control of Polynomial Systems

eess.SY math.OC ·2026-08-10 ·Diego de S. Madeira, Joao Gabriel N. Silva, Wilkley B. Correia, Antonis Papachristodoulou
theory similarity 0.52
Abstract

Inspired by recent developments in dissipativity-based control, this work proposes new sufficient conditions for asymptotic stabilization of nonlinear systems using state feedback. We prove that this new framework is well suited for data-driven control of polynomial systems using noisy measurements, a topic that has lately attracted considerable attention. Two iterative procedures for data-based state feedback design are provided using the proposed framework, that use sum-of-squares (SOS) optimization. Typical limitations of conventional SOS methods based on alternating (D-K) procedures for controller design, such as the need to provide an initialization for a control-Lyapunov function (CLF), are overcome in this paper. Numerical examples demonstrate the applicability and the advantages of the new strategies.

0.04

Towards Passivity-informed Data-driven Predictive Control

eess.SY ·2026-11-09 ·Guanru Pan, Oleksii Molodchyk, Mohammad Itani, Timm Faulwasser
similarity 0.52
Abstract

We propose a passivity-informed data-driven predictive control framework based on passivity-preserving sampling of unknown continuous-time linear systems. We incorporate the passive supply rate into the objective functional alongside an output-regulation cost, thereby explicitly accounting for energy extraction. Despite being practically motivated, the resulting objective is not always convex; its convexity depends on the collected input-output training data. We exploit passivity-induced positive semidefiniteness to derive an equivalent reformulation that remains a convex quadratic program independently of the data. Furthermore, we establish recursive feasibility and asymptotic output convergence using passivity and a terminal equality constraint. Numerical simulations illustrate the closed-loop performance and computational benefits of the proposed approach.

0.24

On the Value Function of Infinite-Horizon Optimal Control of Piecewise Affine Systems

eess.SY math.OC ·2026-08-20 ·Francesco Cordiano, Kanghui He, Bart De Schutter
similarity 0.52
Abstract · Submitted to IEEE Transactions on Automatic Control

In this paper, we study the structure of the value function in constrained infinite-time optimal control (CITOC) problems of piecewise affine (PWA) systems, with $\ell_1$ or $\ell_\infty$ stage cost. Existing works, such as [1], establish that the resulting value function is PWA in the state. However, existing results do not analyze whether the value function is a proper PWA function, i.e., with a finite number of affine pieces over compact sets, or whether the number of pieces can be infinite. We show that the latter case is indeed possible by means of an explicit example, which is also instrumental in establishing rigorous and easily verifiable sufficient conditions that ensure that the resulting value function is a proper PWA function. Our theoretical findings complement well-known results, e.g., the linear-quadratic case, and serve as support for recent learning-based control schemes for PWA systems. Throughout the paper, the proposed results are illustrated by means of a numerical example.

0.15

Dynamic Programming for A Linear-Gaussian Dual Control Problem

eess.SY math.OC ·2026-10-13 ·Ying Wang, Yuchao Li, Håkan Hjalmarsson
similarity 0.52
Abstract

We consider an infinite-horizon discounted dynamic programming (DP) problem for a countable-innovation belief-state model. The model is a surrogate for a linear-Gaussian dual control problem involving an unknown parameter vector and Gaussian observation noise. The surrogate preserves the first two moments of the Gaussian innovation and the resulting posterior second-moment structure. We allow unbounded belief and control spaces and nonnegative stage costs with quadratic growth in the posterior mean and covariance. Using a posterior-moment weight, we show that the Bellman operator is a contraction in a weighted sup-norm space. We characterize the optimal cost as the unique solution of the Bellman equation in this space, establish the existence of optimal stationary policies. We further prove weighted sup-norm convergence of value iteration, policy iteration, and optimistic policy iteration under vanishing approximation errors. The convergence results under vanishing approximation errors rely on general weighted sup-norm contraction properties and are applicable beyond the particular dual control problem considered here.

0.31

A Behavioral approach to Constrained Linear Quadratic Control: Feasibility and Optimality

eess.SY math.OC ·2026-10-29 ·Soutrik Bandyopadhyay, Debasattam Pal, Shubhendu Bhasin
published similarity 0.51
Abstract · Accepted for publication at IEEE Indian Control Conference 2027

This paper develops a constrained linear-quadratic (LQ) optimal control framework within the behavioral approach. Unlike classical formulations that rely on state-input representations, our method treats both the system dynamics and the constraints as trajectory-level objects. The system is modeled through a kernel representation, while inequality constraints are captured using behavioral inequalities defined over infinite-dimensional convex cones. Using quadratic differential forms (QDFs) to encode performance indices, we formulate the constrained LQ problem as a convex variational optimization over trajectories. By employing Gateaux differentials, we derive the stationarity and complementarity conditions and show that they admit a representation as an augmented behavioral system whose unique decomposition into autonomous and controllable sub-behaviors yields a complete parameterization of all optimal constrained trajectories. The resulting conditions constitute a behavioral analogue of the Karush-Kuhn-Tucker (KKT) framework. A numerical example illustrates the effect of inequality constraints on the optimal behavior. The framework provides a general, trajectory-level representation for constrained optimal control and opens avenues for closed-loop and data-driven extensions.

0.41

Reinforcement learning for constrained stochastic linear--quadratic control in continuous time

cs.LG math.OC ·2026-10-26 ·Weiping Wu, Qitong Pan, Xun Li, Peng Wu
similarity 0.51
Abstract

We study continuous-time stochastic linear--quadratic control with a scalar state and nonnegative control constraints. With quadratic running costs, randomized exploration can change the optimal mean feedback. We introduce an auxiliary problem without entropy in which the conditional policy mean is nonnegative and the covariance is prescribed in proportion to the squared state. Moment reduction and state separation yield two regional Riccati equations and characterize the finite-horizon value function and optimal conditional mean. We give a sufficient control--cost compatibility condition under which this mean coincides with the optimal feedback of the original constrained problem. For time-invariant coefficients, we characterize the undiscounted infinite-horizon optimum and establish mean square asymptotic stability under the stated assumptions. For unknown dynamics, we develop model-free actor--critic schemes for finite and infinite horizons. Numerical experiments compare the learned policies with their analytical targets and examine the effect of exploration on the optimal mean.

0.25