CS Paper Radar

Economic Model Predictive Control with Policy-Guided Terminal Ingredients

Salim Msaad, Robert D. McAllister

eess.SY ·submitted 2026-09-02 14:07 UTC · v1

Abstract

Conventional designs for model predictive control typically rely on terminal costs and constraints derived from a steady state to guarantee closed-loop stability and performance. However, this dependence on a steady-state assumption limits the applicability of this control method to systems in which such a fixed operating point is either not available or not desirable. This work introduces a novel framework, termed policy-guided MPC, to address this limitation. Our approach constructs terminal costs and constraints using a known sub-optimal control policy. Specifically, the terminal region is defined around a center determined by a rollout of the policy, and a penalty on deviation from this center is used to define the terminal cost. This method obviates the need for a steady state or reference trajectory. Closed-loop performance guarantees are established relative to the guiding policy, for both finite and infinite horizon problems. The effectiveness of the proposed framework is demonstrated through numerical simulations on an energy management example.

Closest papers

Nearest neighbours by meaning across the whole index.

On the recursive feasibility and stability of MPC without terminal constraints

eess.SY math.OC ·2026-11-17 ·Mara Perez, Ignacio Sanchez, Filiberto Fele, Daniel Limon
similarity 0.76
Abstract · 6 pages, 1 figure. Comments are welcome!

In this paper, we analyze stability and recursive feasibility of a model predictive control (MPC) scheme that does not rely on terminal ingredients -- such as terminal constraints or a terminal cost based on a terminal controller. In the proposed formulation, we augment the cost function by a weighted finite tail which is optimized online, and we show it plays the role of a stabilizing terminal cost. Under a relaxed, local dynamic programming condition on the tail, we certify a family of regions -- parameterized by the tail's weight coefficient -- on which the problem is recursively feasible and the origin is asymptotically stable. These regions are larger as the weight increases: in particular, we show that any state that can be steered within the control horizon to a predefined neighborhood of the origin is contained in a certified region for a sufficiently large weight. Finally, we characterize the closed-loop performance over the certified region, bounding the suboptimality of the closed loop with respect to the infinite-horizon optimal cost. We conclude the discussion by illustrating these results on a simple numerical example.

0.29

On the suboptimality of stochastic MPC with varying constraint horizon

eess.SY math.OC ·2026-08-30 ·Allan Andre Do Nascimento, Andre Bertolace, Antonis Papachristodoulou, Kostas Margellos
publishedtheoryhot direction similarity 0.71
Abstract · Accepted for CDC 2026

Enforcing stochastic state constraints over the full prediction horizon in Model Predictive Control (MPC) can be computationally demanding. Here we study stochastic MPC without terminal ingredients in which chance constraints are enforced only over a shorter constraint horizon. Using stochastic relaxed dynamic programming, we derive an explicit upper bound on the average expected closed-loop cost that depends on both prediction and constraint horizons. For linear quadratic problems with affine chance constraints and bounded uniform disturbances, we provide a deterministic reformulation via coordinate transformation and constraint tightening. Simulations illustrate the trade-off between computational effort and performance.

0.38

Asynchronous Model Predictive Control Under Model Mismatch: Stability and Performance Guarantees

eess.SY ·2026-09-08 ·Changrui Liu, Anil Alan, Shengling Shi, Bart De Schutter
similarity 0.70
Abstract · This is the first work to characterize the joint effects of model mismatch, general asynchronous feedback, and prediction horizon on stabili…

Certainty-equivalence model predictive control (CE-MPC) is widely used for its simplicity and efficiency, but theoretical guarantees under asynchronous feedback remain limited. This paper establishes stability and performance guarantees for asynchronous CE-MPC of input-constrained nonlinear systems. We first derive a nominal stability condition and competitive-ratio bound that explicitly account for inter-execution intervals without prescribing a feedback mechanism. A value-function perturbation analysis for quadratic stage costs then accommodates additive, potentially non-smooth model mismatch without constraint qualification conditions. Combining these results yields stability criteria and competitive-ratio bounds for CE-MPC under general asynchronous feedback, including event/self-triggered and multi-step MPC. The guarantees explicitly relate prediction horizon, inter-execution time, and uncertainty magnitude, quantifying performance degradation relative to an ideal infinite-horizon controller. These results clarify tradeoffs between feedback frequency, model accuracy, and horizon length, guiding asynchronous MPC design using approximate or learned models.

0.29

Approximate Feedback Nash Equilibria in Constrained Differential Games via Model Predictive Control with Upper Bound Guarantees

eess.SY cs.GT ·2026-10-03 ·Balint Varga, Karl Handwerker, Imre Rudas, Peter Galambos
theory similarity 0.70
Abstract

Physical human--machine interaction and other multi-agent control settings require decision-making policies that adapt online. Differential games provide a principled framework where each agent optimizes an individual objective while anticipating the other's response. The relevant solution concept in many applications is the feedback Nash equilibrium (FNE), which yields time-consistent state-feedback strategies. However, computing the FNE is demanding and becomes intractable when state and input constraints must be enforced, motivating the need for approximate methods. This paper presents a Model Predictive Control (MPC) approach that approximates infinite-horizon FNE trajectories through repeated solution of finite-horizon open-loop games. An auxiliary-game formulation is introduced that selects prediction horizons and terminal costs to approximate the feedback-game optimality conditions. The approach is extended to incorporate hard constraints via a constrained open-loop game formulation. For the unconstrained setting, an analytic upper bound on the state-trajectory deviation between the MPC-induced and FNE trajectories is derived, enabling quantitative performance certification. Numerical examples illustrate the effectiveness of the proposed method compared with baseline approaches from the literature.

0.26

Finite sample guarantees of MPPI: suboptimality, sample complexity and closed-loop guarantees

eess.SY math.OC ·2026-11-17 ·Changyi Lei, Dragan Nesic, Ye Pu
theoryhot direction similarity 0.68
Abstract

This paper considers model predictive path integral (MPPI) control for nonlinear finite-horizon optimal control problems with bounded inputs, allowing nonconvex and nonsmooth costs. We prove theoretical guarantees that quantify the suboptimality caused by positive temperature and finite sampling on MPPI and establish their implications for closed-loop guarantees. Specifically, we derive a suboptimality bound for infinite-sample MPPI that characterizes the effects of temperature and prior coverage, followed by a high-probability finite-sample approximation error bound that reveals the dependence on sample size, temperature, and cost variability. By incorporating these bounds into a terminal-constraint-free MPC framework, we further establish semi-global practical recurrence of the closed-loop system. Numerical examples involving a four-link planar manipulator illustrate the temperature-sampling tradeoff and the influence of prior quality on approximation accuracy and closed-loop performance.

0.31

A Unified Framework for Robust Data-Driven Model Predictive Control with Terminal Ingredients

eess.SY ·2026-10-04 ·Zhaohua Yang, Nan Bai, Pengyu Wang, Ling Shi
similarity 0.68
Abstract · Submitted for publication

This paper proposes a unified framework for robust data-driven model predictive control (MPC) with terminal ingredients for unknown linear time-invariant systems. Based on Willems' fundamental lemma, a single offline input-output trajectory is used as an implicit model, while online implementation only requires past input-output measurements. Bounded measurement noise is considered in both offline and online output data. The framework consists of an offline stage, where robust terminal ingredients are designed directly from noisy data, and an online stage, where these ingredients are incorporated into a one-step MPC scheme. Recursive feasibility of the proposed framework and practical exponential stability of the closed-loop system are established. Numerical results illustrate the performance tuning capability of the terminal set, with particularly pronounced benefits for short prediction horizons, and show that the proposed framework achieves performance comparable to data-driven MPC without terminal ingredients while requiring a reduced prediction horizon and less online computation.

0.13

The Global Asymptotic Stability Problem for Linear MPC Is Undecidable

eess.SY math.OC ·2026-09-09 ·Johan Löfberg
theory similarity 0.65
Abstract · Submitted to IEEE Transactions on Automatic Control

We prove that deciding global asymptotic stability for constrained finite-horizon linear model predictive control is undecidable. This holds at horizon one with identity state, input, and terminal weights, unique optimizers, and global feasibility. Separate reductions cover predicted-state boxes, hard input boxes, and quadratically softened input boxes. A fourth reduction fixes the state and input dimensions to three and six. Hence undecidability is not caused by long horizons, growing dimensions, failures of recursive feasibility, or nonuniqueness.

0.26

Exploration as Feedback in Model Predictive Path Integral Control

eess.SY ·2026-11-14 ·Junsei Ito, Kohei Honda, Yasuaki Wasa
hot direction similarity 0.65
Abstract · 20 pages, 3 figures. Submitted to the 9th Annual Conference on Learning for Dynamics and Control (L4DC 2027)

This paper investigates how exploration affects closed-loop stability in model predictive path integral (MPPI) control. With a warm start, MPPI optimizes a control sequence by sampling candidates around the previous solution, and their covariance, the exploration covariance, is typically tuned to balance solution quality and computational cost. Small exploration is attractive because most samples then contribute to the solution, and existing stability analyses treat reduced exploration only as a bias toward the previous solution. Whether insufficient exploration can destabilize the closed loop has therefore remained open. We show that, for linear quadratic (LQ) problems with infinitely many samples, the exploration covariance also determines the feedback gain, i.e., how strongly MPPI updates the previous solution in response to the current state. With small exploration at a fixed temperature, MPPI nearly repeats the previous solution and fails to stabilize an exponentially unstable plant. Because a single covariance governs both exploration and feedback, stability and sample efficiency are in structural conflict: stabilization requires large exploration, which leaves few samples that contribute to the solution. To resolve this conflict, we propose Stabilizing Subspace MPPI (SS-MPPI), which computes the control inputs required for stabilization and samples only the rest. For LQ problems, SS-MPPI remains stable with small exploration and is thus sample-efficient. Simulations of an inverted pendulum and a quadruped robot confirm the analysis, showing that MPPI fails under small exploration, whereas SS-MPPI remains stable even with few samples.

0.32