CS Paper Radar

Laguerre-MPPI

Yusuke Tahori, Masaki Inoue, Hayate Irie, Tomohiro Taki, Takashi Hatano

eess.SY ·submitted 2026-11-18 09:25 UTC · v1
theoryhot direction

Abstract

Model Predictive Path Integral control (MPPI) is a sampling-based control method that handles nonlinear dynamics and non-convex costs without gradient information. Since MPPI samples the entire input sequence, longer prediction horizons lead to a higher-dimensional sampling space, potentially degrading control performance. This paper proposes Laguerre-MPPI, which parameterizes the control input sequence using discrete-time Laguerre basis functions and samples the basis coefficients. The resulting search dimension is independent of the prediction horizon. Hence, a longer prediction horizon does not require more samples to maintain the sampling density. For linear systems with quadratic costs, we derive a closed-loop stability condition in the infinite-sample limit. Under finite sampling, we provide a closed-form expression for the limit of the ratio of the effective sample size to the number of samples. We also show that the upper bound of this limit for Laguerre-MPPI is no lower than that for conventional MPPI. Numerical experiments demonstrate smoother inputs in obstacle avoidance and maintained performance over long horizons. Moreover, they verify the lower bound on the number of samples given by the finite-sample analysis.

Closest papers

Nearest neighbours by meaning across the whole index.

Finite sample guarantees of MPPI: suboptimality, sample complexity and closed-loop guarantees

eess.SY math.OC ·2026-11-17 ·Changyi Lei, Dragan Nesic, Ye Pu
theoryhot direction similarity 0.76
Abstract

This paper considers model predictive path integral (MPPI) control for nonlinear finite-horizon optimal control problems with bounded inputs, allowing nonconvex and nonsmooth costs. We prove theoretical guarantees that quantify the suboptimality caused by positive temperature and finite sampling on MPPI and establish their implications for closed-loop guarantees. Specifically, we derive a suboptimality bound for infinite-sample MPPI that characterizes the effects of temperature and prior coverage, followed by a high-probability finite-sample approximation error bound that reveals the dependence on sample size, temperature, and cost variability. By incorporating these bounds into a terminal-constraint-free MPC framework, we further establish semi-global practical recurrence of the closed-loop system. Numerical examples involving a four-link planar manipulator illustrate the temperature-sampling tradeoff and the influence of prior quality on approximation accuracy and closed-loop performance.

0.31

Hybrid Feedback Sampling for Sample-Efficient Model Predictive Control

cs.RO eess.SY ·2026-08-19 ·Chaoyi Pan, Zeji Yi, John Zhang, Zachary Manchester, Guannan Qu +1 more
similarity 0.75
Abstract · 15 pages, 6 figures

Thanks to its parallelizability and flexibility, sampling-based Model Predictive Control (MPC) has become widely popular for controlling real-world robotic systems. However, for high-dimensional and open-loop unstable dynamical systems, the required number of samples to improve the control sequence will grow exponentially with the horizon, leading to poor sample efficiency and numerical instability. This paper investigates the instability of shooting methods in sampling-based MPC and shows that the optimal sampling proposal distribution can be realized by sampling with an optimized feedback policy. We refer to this algorithm as Feedback Sampling MPC (FS-MPC). FS-MPC involves a hybrid sampling design which balances local and global search based on the system stability and the available computation budget. Our theoretical analysis shows that our hybrid sampling approach achieves faster convergence than standard MPPI and better optimality than standard feedback sampling. Empirically, in diverse contact-rich control tasks like humanoid loco-manipulation and dexterous manipulation, we show that FS-MPC successfully tackles dynamically unstable tasks where standard sample-based approaches struggle, and strictly outperforms feedback policies alone. Finally, we validate our method on humanoid robot locomotion and manipulation tasks in the real world.

0.49

Sample-Efficient Model Predictive Control via Proximal Policy Optimization

eess.SY ·2026-11-17 ·Jiarui Wang, Sina Sharifi, Mahyar Fazlyab
similarity 0.73
Abstract

Sampling-based model predictive control (MPC) enables real-time control of complex nonlinear systems but often incurs substantial computational costs due to repeated trajectory simulations. In this paper, we bridge policy optimization in reinforcement learning and sampling-based MPC to improve computational efficiency through sample reuse. Starting from a KL-regularized distributional formulation of trajectory optimization, we derive an exact performance-difference identity based on a signed exponential advantage function. This identity motivates two algorithms, PPO-MPPI and SPO-MPPI, which adapt proximal policy optimization techniques to sampling-based MPC, enabling multiple optimization updates using previously evaluated trajectories without additional forward simulations. We establish population-level monotonic improvement guarantees for both methods and prove convergence to first-order stationarity for PPO-MPPI under fixed-covariance Gaussian sampling distributions. Experiments on quadruped velocity tracking and quadrotor path tracking demonstrate that the proposed methods achieve competitive control performance at substantially lower computational cost than multi-stage sampling approaches. Our results establish a principled connection between policy optimization and sampling-based MPC and highlight the potential of trajectory reuse for sample-efficient predictive control.

0.23

Exploration as Feedback in Model Predictive Path Integral Control

eess.SY ·2026-11-14 ·Junsei Ito, Kohei Honda, Yasuaki Wasa
hot direction similarity 0.71
Abstract · 20 pages, 3 figures. Submitted to the 9th Annual Conference on Learning for Dynamics and Control (L4DC 2027)

This paper investigates how exploration affects closed-loop stability in model predictive path integral (MPPI) control. With a warm start, MPPI optimizes a control sequence by sampling candidates around the previous solution, and their covariance, the exploration covariance, is typically tuned to balance solution quality and computational cost. Small exploration is attractive because most samples then contribute to the solution, and existing stability analyses treat reduced exploration only as a bias toward the previous solution. Whether insufficient exploration can destabilize the closed loop has therefore remained open. We show that, for linear quadratic (LQ) problems with infinitely many samples, the exploration covariance also determines the feedback gain, i.e., how strongly MPPI updates the previous solution in response to the current state. With small exploration at a fixed temperature, MPPI nearly repeats the previous solution and fails to stabilize an exponentially unstable plant. Because a single covariance governs both exploration and feedback, stability and sample efficiency are in structural conflict: stabilization requires large exploration, which leaves few samples that contribute to the solution. To resolve this conflict, we propose Stabilizing Subspace MPPI (SS-MPPI), which computes the control inputs required for stabilization and samples only the rest. For LQ problems, SS-MPPI remains stable with small exploration and is thus sample-efficient. Simulations of an inverted pendulum and a quadruped robot confirm the analysis, showing that MPPI fails under small exploration, whereas SS-MPPI remains stable even with few samples.

0.32

CS-MPC: Contraction-Certified Sampling-Based MPC for Nonlinear Systems Under Uncertainty

eess.SY cs.RO ·2026-11-13 ·Yashwanth Kumar Nakka
theoryhot direction similarity 0.69
Abstract

We present contraction-certified sampling-based model predictive control (CS-MPC) for tracking and safety of nonlinear robotic systems under parametric uncertainty, disturbances, and safety constraints that are revealed online. CS-MPC uses a contraction-certified tracking feedback inside every sampled rollout, which concentrates the rollouts around the reference, and an execution layer that verifies the applied input using a quantile-tightened discrete-time control barrier function condition. We derive a verification procedure for nonlinear contraction of the feedback-closed dynamics, and we prove a finite-sample stochastic stability bound and a mission-level probabilistic safety guarantee. We validate CS-MPC in simulation on a rover, a quadrotor, and an asteroid landing. When compared with standard model predictive path integral (MPPI) control, CS-MPC attains the same tracking error with 7 to 20 times fewer rollouts for the rover, and a 2 to 4 times lower tracking error for the quadrotor, with no safety violations in 200 Monte Carlo missions.

0.22

CLIS-MPPI: Closed-Loop Model Predictive Path Integral Control With Initial-State Sampling Under Execution Delay

cs.RO ·2026-10-15 ·Zidong Liu, Xu Chen
similarity 0.69
Abstract · 65th IEEE Conference on Decision and Control (CDC 2026)

Sampling-based motion planning such as Model Predictive Path Integral (MPPI) control has become attractive for robotics due to its ability to handle nonlinear dynamics and non-smooth objectives without gradient information, while leveraging parallel rollout computation for real-time performance. However, in real-world robotic systems, the optimized control input is often applied after a non-negligible planning delay, causing a mismatch between the state used in forward simulation and the actual state at control execution, which can significantly degrade planning accuracy and may even lead to unsafe behavior such as collisions. This paper proposes Closed-Loop MPPI with Initial-State Sampling (CLIS-MPPI), which explicitly addresses execution-time state mismatch by modeling planning delay as a distribution over plausible execution-time initial states, performing rollout optimization from sampled initial states, and applying a rollout-based local feedback correction during control execution. The proposed method is validated through real-world experiments on a 6-DoF UR5e manipulator in a narrow-passage task involving obstacle avoidance and end-effector target reaching. Across 5 real-world runs of the same task, standard MPPI collided in 2 runs, whereas CLIS-MPPI remained collision-free in all 5 runs. Averaged over all collision-free runs for each method (3 for MPPI and 5 for CLIS-MPPI), CLIS-MPPI reduced the average task completion time from 25.4s to 24.4s and the average end-effector path length from 0.456 m to 0.425 m. It also reduced the overall joint-position and joint-velocity root mean square errors (RMSEs) from 0.100 rad and 0.108 rad/s to 0.017 rad and 0.011 rad/s, respectively. These results demonstrate improved safety, planning-execution consistency, and motion smoothness.

0.11

Reachability-Guided Sequential Quadratic Programming-Guarded Model Predictive Path Integral for Safe Nonlinear Predictive Control

cs.RO eess.SY ·2026-10-03 ·Alexandre Didier, Jason J. Choi, Namhoon Cho, Claire J. Tomlin, Melanie N. Zeilinger
similarity 0.69
Abstract

Safe robot control often requires combining long-horizon performance optimization with hard state and input constraints, but existing approaches tend to address this tradeoff partially. Sampling-based model predictive control (MPC) methods such as model predictive path integral (MPPI) are effective in handling nonlinear and nonconvex environments, yet their finite-sample rollouts and unconstrained weighted-average update can return an unsafe control. Deterministic nonlinear MPC can explicitly incorporate constraints, but its real-time safety and performance depends strongly on warm starts and local convergence. Hamilton--Jacobi reachability (HJR) provides rigorous safety certificates, but offline value-function computation remains practical only for reduced-order models. We propose ReSQ-MPPI, a reachability-informed generation--refinement architecture that combines these complementary strengths. An HJR value function computed offline for a reduced-order model guides online MPPI sampling toward safe, promising trajectory candidates. The MPPI solution is then refined by a small number of sequential quadratic programming (SQP) iterations in a full-order MPC problem. A key observation is that the standard MPPI inference step is an unconstrained weighted least-squares problem; ReSQ-MPPI replaces it with a constrained MPC refinement that recovers the MPPI update when it is feasible and minimally modifies it otherwise. Simulations in cluttered navigation and autonomous racing environments demonstrate that ReSQ-MPPI improves safety and performance over standalone MPPI, MPC, and reachability-filtered sampling-based control baselines.

0.18

An Adaptive-Sampling Control Framework for Constrained Linear Systems with Robust Safety Guarantees

eess.SY ·2026-09-19 ·Spencer Schutz, Charlott Vallon, Francesco Borrelli
similarity 0.65
Abstract

Adaptive-sampling control balances control performance with resource efficiency. However, existing methods either fail to guarantee robust constraint satisfaction during rate transitions or require computationally expensive online optimization. This paper proposes an adaptive-sampling control framework for linear systems subject to polytopic state and input constraints and bounded additive disturbances. Given a time-varying reference control update rate provided by a reasoner, our framework continuously calculates Model Predictive Control (MPC) update rates that ensure robust constraint satisfaction at all time steps. Offline, robust M-step hold control invariance is used to precompute invariant sets for a list of update rates and transition sets between them. Online, these sets are used in real time to guarantee recursive feasibility and finite-time transitions to the reference update rate. The utility of the architecture is demonstrated in a cruise control simulation.

0.18