CS Paper Radar

Finite sample guarantees of MPPI: suboptimality, sample complexity and closed-loop guarantees

Changyi Lei, Dragan Nesic, Ye Pu

eess.SY math.OC ·submitted 2026-11-17 03:27 UTC · v1
theoryhot direction

Abstract

This paper considers model predictive path integral (MPPI) control for nonlinear finite-horizon optimal control problems with bounded inputs, allowing nonconvex and nonsmooth costs. We prove theoretical guarantees that quantify the suboptimality caused by positive temperature and finite sampling on MPPI and establish their implications for closed-loop guarantees. Specifically, we derive a suboptimality bound for infinite-sample MPPI that characterizes the effects of temperature and prior coverage, followed by a high-probability finite-sample approximation error bound that reveals the dependence on sample size, temperature, and cost variability. By incorporating these bounds into a terminal-constraint-free MPC framework, we further establish semi-global practical recurrence of the closed-loop system. Numerical examples involving a four-link planar manipulator illustrate the temperature-sampling tradeoff and the influence of prior quality on approximation accuracy and closed-loop performance.

Closest papers

Nearest neighbours by meaning across the whole index.

CLIS-MPPI: Closed-Loop Model Predictive Path Integral Control With Initial-State Sampling Under Execution Delay

cs.RO ·2026-10-15 ·Zidong Liu, Xu Chen
similarity 0.73
Abstract · 65th IEEE Conference on Decision and Control (CDC 2026)

Sampling-based motion planning such as Model Predictive Path Integral (MPPI) control has become attractive for robotics due to its ability to handle nonlinear dynamics and non-smooth objectives without gradient information, while leveraging parallel rollout computation for real-time performance. However, in real-world robotic systems, the optimized control input is often applied after a non-negligible planning delay, causing a mismatch between the state used in forward simulation and the actual state at control execution, which can significantly degrade planning accuracy and may even lead to unsafe behavior such as collisions. This paper proposes Closed-Loop MPPI with Initial-State Sampling (CLIS-MPPI), which explicitly addresses execution-time state mismatch by modeling planning delay as a distribution over plausible execution-time initial states, performing rollout optimization from sampled initial states, and applying a rollout-based local feedback correction during control execution. The proposed method is validated through real-world experiments on a 6-DoF UR5e manipulator in a narrow-passage task involving obstacle avoidance and end-effector target reaching. Across 5 real-world runs of the same task, standard MPPI collided in 2 runs, whereas CLIS-MPPI remained collision-free in all 5 runs. Averaged over all collision-free runs for each method (3 for MPPI and 5 for CLIS-MPPI), CLIS-MPPI reduced the average task completion time from 25.4s to 24.4s and the average end-effector path length from 0.456 m to 0.425 m. It also reduced the overall joint-position and joint-velocity root mean square errors (RMSEs) from 0.100 rad and 0.108 rad/s to 0.017 rad and 0.011 rad/s, respectively. These results demonstrate improved safety, planning-execution consistency, and motion smoothness.

0.11

Reachability-Guided Sequential Quadratic Programming-Guarded Model Predictive Path Integral for Safe Nonlinear Predictive Control

cs.RO eess.SY ·2026-10-03 ·Alexandre Didier, Jason J. Choi, Namhoon Cho, Claire J. Tomlin, Melanie N. Zeilinger
similarity 0.71
Abstract

Safe robot control often requires combining long-horizon performance optimization with hard state and input constraints, but existing approaches tend to address this tradeoff partially. Sampling-based model predictive control (MPC) methods such as model predictive path integral (MPPI) are effective in handling nonlinear and nonconvex environments, yet their finite-sample rollouts and unconstrained weighted-average update can return an unsafe control. Deterministic nonlinear MPC can explicitly incorporate constraints, but its real-time safety and performance depends strongly on warm starts and local convergence. Hamilton--Jacobi reachability (HJR) provides rigorous safety certificates, but offline value-function computation remains practical only for reduced-order models. We propose ReSQ-MPPI, a reachability-informed generation--refinement architecture that combines these complementary strengths. An HJR value function computed offline for a reduced-order model guides online MPPI sampling toward safe, promising trajectory candidates. The MPPI solution is then refined by a small number of sequential quadratic programming (SQP) iterations in a full-order MPC problem. A key observation is that the standard MPPI inference step is an unconstrained weighted least-squares problem; ReSQ-MPPI replaces it with a constrained MPC refinement that recovers the MPPI update when it is feasible and minimally modifies it otherwise. Simulations in cluttered navigation and autonomous racing environments demonstrate that ReSQ-MPPI improves safety and performance over standalone MPPI, MPC, and reachability-filtered sampling-based control baselines.

0.18

Exploration as Feedback in Model Predictive Path Integral Control

eess.SY ·2026-11-14 ·Junsei Ito, Kohei Honda, Yasuaki Wasa
hot direction similarity 0.69
Abstract · 20 pages, 3 figures. Submitted to the 9th Annual Conference on Learning for Dynamics and Control (L4DC 2027)

This paper investigates how exploration affects closed-loop stability in model predictive path integral (MPPI) control. With a warm start, MPPI optimizes a control sequence by sampling candidates around the previous solution, and their covariance, the exploration covariance, is typically tuned to balance solution quality and computational cost. Small exploration is attractive because most samples then contribute to the solution, and existing stability analyses treat reduced exploration only as a bias toward the previous solution. Whether insufficient exploration can destabilize the closed loop has therefore remained open. We show that, for linear quadratic (LQ) problems with infinitely many samples, the exploration covariance also determines the feedback gain, i.e., how strongly MPPI updates the previous solution in response to the current state. With small exploration at a fixed temperature, MPPI nearly repeats the previous solution and fails to stabilize an exponentially unstable plant. Because a single covariance governs both exploration and feedback, stability and sample efficiency are in structural conflict: stabilization requires large exploration, which leaves few samples that contribute to the solution. To resolve this conflict, we propose Stabilizing Subspace MPPI (SS-MPPI), which computes the control inputs required for stabilization and samples only the rest. For LQ problems, SS-MPPI remains stable with small exploration and is thus sample-efficient. Simulations of an inverted pendulum and a quadruped robot confirm the analysis, showing that MPPI fails under small exploration, whereas SS-MPPI remains stable even with few samples.

0.41

Economic Model Predictive Control with Policy-Guided Terminal Ingredients

eess.SY ·2026-09-02 ·Salim Msaad, Robert D. McAllister
similarity 0.68
Abstract

Conventional designs for model predictive control typically rely on terminal costs and constraints derived from a steady state to guarantee closed-loop stability and performance. However, this dependence on a steady-state assumption limits the applicability of this control method to systems in which such a fixed operating point is either not available or not desirable. This work introduces a novel framework, termed policy-guided MPC, to address this limitation. Our approach constructs terminal costs and constraints using a known sub-optimal control policy. Specifically, the terminal region is defined around a center determined by a rollout of the policy, and a penalty on deviation from this center is used to define the terminal cost. This method obviates the need for a steady state or reference trajectory. Closed-loop performance guarantees are established relative to the guiding policy, for both finite and infinite horizon problems. The effectiveness of the proposed framework is demonstrated through numerical simulations on an energy management example.

0.22

Hybrid Feedback Sampling for Sample-Efficient Model Predictive Control

cs.RO eess.SY ·2026-08-19 ·Chaoyi Pan, Zeji Yi, John Zhang, Zachary Manchester, Guannan Qu +1 more
similarity 0.68
Abstract · 15 pages, 6 figures

Thanks to its parallelizability and flexibility, sampling-based Model Predictive Control (MPC) has become widely popular for controlling real-world robotic systems. However, for high-dimensional and open-loop unstable dynamical systems, the required number of samples to improve the control sequence will grow exponentially with the horizon, leading to poor sample efficiency and numerical instability. This paper investigates the instability of shooting methods in sampling-based MPC and shows that the optimal sampling proposal distribution can be realized by sampling with an optimized feedback policy. We refer to this algorithm as Feedback Sampling MPC (FS-MPC). FS-MPC involves a hybrid sampling design which balances local and global search based on the system stability and the available computation budget. Our theoretical analysis shows that our hybrid sampling approach achieves faster convergence than standard MPPI and better optimality than standard feedback sampling. Empirically, in diverse contact-rich control tasks like humanoid loco-manipulation and dexterous manipulation, we show that FS-MPC successfully tackles dynamically unstable tasks where standard sample-based approaches struggle, and strictly outperforms feedback policies alone. Finally, we validate our method on humanoid robot locomotion and manipulation tasks in the real world.

0.47

Sample-Efficient Model Predictive Control via Proximal Policy Optimization

eess.SY ·2026-11-17 ·Jiarui Wang, Sina Sharifi, Mahyar Fazlyab
hot direction similarity 0.67
Abstract

Sampling-based model predictive control (MPC) enables real-time control of complex nonlinear systems but often incurs substantial computational costs due to repeated trajectory simulations. In this paper, we bridge policy optimization in reinforcement learning and sampling-based MPC to improve computational efficiency through sample reuse. Starting from a KL-regularized distributional formulation of trajectory optimization, we derive an exact performance-difference identity based on a signed exponential advantage function. This identity motivates two algorithms, PPO-MPPI and SPO-MPPI, which adapt proximal policy optimization techniques to sampling-based MPC, enabling multiple optimization updates using previously evaluated trajectories without additional forward simulations. We establish population-level monotonic improvement guarantees for both methods and prove convergence to first-order stationarity for PPO-MPPI under fixed-covariance Gaussian sampling distributions. Experiments on quadruped velocity tracking and quadrotor path tracking demonstrate that the proposed methods achieve competitive control performance at substantially lower computational cost than multi-stage sampling approaches. Our results establish a principled connection between policy optimization and sampling-based MPC and highlight the potential of trajectory reuse for sample-efficient predictive control.

0.32

On the suboptimality of stochastic MPC with varying constraint horizon

eess.SY math.OC ·2026-08-30 ·Allan Andre Do Nascimento, Andre Bertolace, Antonis Papachristodoulou, Kostas Margellos
publishedtheoryhot direction similarity 0.66
Abstract · Accepted for CDC 2026

Enforcing stochastic state constraints over the full prediction horizon in Model Predictive Control (MPC) can be computationally demanding. Here we study stochastic MPC without terminal ingredients in which chance constraints are enforced only over a shorter constraint horizon. Using stochastic relaxed dynamic programming, we derive an explicit upper bound on the average expected closed-loop cost that depends on both prediction and constraint horizons. For linear quadratic problems with affine chance constraints and bounded uniform disturbances, we provide a deterministic reformulation via coordinate transformation and constraint tightening. Simulations illustrate the trade-off between computational effort and performance.

0.38

CS-MPC: Contraction-Certified Sampling-Based MPC for Nonlinear Systems Under Uncertainty

eess.SY cs.RO ·2026-11-13 ·Yashwanth Kumar Nakka
theoryhot direction similarity 0.65
Abstract

We present contraction-certified sampling-based model predictive control (CS-MPC) for tracking and safety of nonlinear robotic systems under parametric uncertainty, disturbances, and safety constraints that are revealed online. CS-MPC uses a contraction-certified tracking feedback inside every sampled rollout, which concentrates the rollouts around the reference, and an execution layer that verifies the applied input using a quantile-tightened discrete-time control barrier function condition. We derive a verification procedure for nonlinear contraction of the feedback-closed dynamics, and we prove a finite-sample stochastic stability bound and a mission-level probabilistic safety guarantee. We validate CS-MPC in simulation on a rover, a quadrotor, and an asteroid landing. When compared with standard model predictive path integral (MPPI) control, CS-MPC attains the same tracking error with 7 to 20 times fewer rollouts for the rover, and a 2 to 4 times lower tracking error for the quadrotor, with no safety violations in 200 Monte Carlo missions.

0.28