CS Paper Radar

Explicit Dual Model Predictive Path Integral Control

Christopher Narr, Martin Buss

eess.SY ·submitted 2026-11-17 08:21 UTC · v1

Abstract

In this work, we present a fully sampling-based explicit dual control algorithm that combines a particle filter and model predictive path integral control for partially observed nonlinear systems. The key idea is to roll out multiple sampled input sequences from all particles of the particle filter to obtain a belief-averaged control cost that induces caution. The same rollouts are used to sample imagined future measurements, which are drawn from the predictive distribution of the particle belief. This results in a Monte Carlo information term that gives a sample estimate of the expected information gain of each sampled input sequence and thereby induces probing. In contrast to existing explicit dual control schemes, the proposed scheme neither relies on gradients of the dynamics or measurement models nor requires a Gaussian belief. Furthermore, all computations can be parallelized across input sequences, particles, and imagined measurements, which makes the scheme amenable to real-time implementation on suitable hardware. We demonstrate the effectiveness of the proposed method in a simulation example of a planar terrain-aided navigation task.

Closest papers

Nearest neighbours by meaning across the whole index.

Sampling-based Model Predictive Control as Sequential Monte Carlo Inference

cs.RO cs.LGeess.SY ·2026-11-07 ·Austin Garrett, Muyang Yan, Zachary Kingston
code/data similarity 0.73
Abstract · 8 pages, 5 figures. Submitted to IEEE Robotics and Automation Letters (RA-L). Code: https://github.com/CoMMALab/PFMP

Sampling-based model predictive control (MPC) is treated as a family of distinct algorithms: predictive sampling, MPPI, the cross-entropy method, and their biased, colored-noise, and annealed variants all sample control sequences and reweight them by cost. We show a single Sequential Monte Carlo (SMC) inference algorithm implements them all, specified by three independent axes: the proposal, the update rule that reduces cost-weighted particles to a nominal plan, and the effective-sample-size threshold for resampling. We evaluate SMC-based planning on MuJoCo non-linear control, open-loop navigation through obstacle fields, 7-DoF motion planning, and non-prehensile push-T, in simulation and on a Franka FR3. Resampling combats particle degeneracy at long horizons. At a 28-knot horizon in our navigation domain it cut the collision rate by 30% over non-resampling baselines. Programmable proposals improve push-T success over perturbative baselines, improving from 1% to 100% in simulation and 10% to 90% on hardware.

0.26

Particle Filtering with Generative Trajectory Models for State Estimation and Control

cs.RO cs.LG ·2026-11-09 ·Lukas Lao Beyer, Samvit Das, Sertac Karaman
similarity 0.66
Abstract · 8 pages, 4 figures, 5 tables

Generative models can support both state estimation and control in robotics. For control, a common approach is to use the model as a policy that directly samples actions conditioned on observation histories. However, models that jointly represent states, actions, and observations can also predict how the robot state and its environment evolve. We investigate whether these predictions can improve state estimation and control through a change in inference procedure, without modifying the pretrained model. To this end, we use particle filtering to maintain competing hypotheses about state histories. A single pretrained diffusion model generates these hypotheses along with their predicted observations and associated action proposals. As new measurements arrive, particles are reweighted according to how well their predicted observations match the measurements. While particle filtering conventionally uses these weights only for state estimation, we also use them to guide action selection, favoring proposals associated with hypotheses that better explain the observations. Simulation experiments in partially observed navigation and vision-based manipulation demonstrate improvements in both state estimation and task performance compared to action generation without filtering, using the same pretrained model and no additional test-time information.

0.11

Sample-Efficient Model Predictive Control via Proximal Policy Optimization

eess.SY ·2026-11-17 ·Jiarui Wang, Sina Sharifi, Mahyar Fazlyab
similarity 0.63
Abstract

Sampling-based model predictive control (MPC) enables real-time control of complex nonlinear systems but often incurs substantial computational costs due to repeated trajectory simulations. In this paper, we bridge policy optimization in reinforcement learning and sampling-based MPC to improve computational efficiency through sample reuse. Starting from a KL-regularized distributional formulation of trajectory optimization, we derive an exact performance-difference identity based on a signed exponential advantage function. This identity motivates two algorithms, PPO-MPPI and SPO-MPPI, which adapt proximal policy optimization techniques to sampling-based MPC, enabling multiple optimization updates using previously evaluated trajectories without additional forward simulations. We establish population-level monotonic improvement guarantees for both methods and prove convergence to first-order stationarity for PPO-MPPI under fixed-covariance Gaussian sampling distributions. Experiments on quadruped velocity tracking and quadrotor path tracking demonstrate that the proposed methods achieve competitive control performance at substantially lower computational cost than multi-stage sampling approaches. Our results establish a principled connection between policy optimization and sampling-based MPC and highlight the potential of trajectory reuse for sample-efficient predictive control.

0.23

Laguerre-MPPI

eess.SY ·2026-11-18 ·Yusuke Tahori, Masaki Inoue, Hayate Irie, Tomohiro Taki, Takashi Hatano
theoryhot direction similarity 0.63
Abstract

Model Predictive Path Integral control (MPPI) is a sampling-based control method that handles nonlinear dynamics and non-convex costs without gradient information. Since MPPI samples the entire input sequence, longer prediction horizons lead to a higher-dimensional sampling space, potentially degrading control performance. This paper proposes Laguerre-MPPI, which parameterizes the control input sequence using discrete-time Laguerre basis functions and samples the basis coefficients. The resulting search dimension is independent of the prediction horizon. Hence, a longer prediction horizon does not require more samples to maintain the sampling density. For linear systems with quadratic costs, we derive a closed-loop stability condition in the infinite-sample limit. Under finite sampling, we provide a closed-form expression for the limit of the ratio of the effective sample size to the number of samples. We also show that the upper bound of this limit for Laguerre-MPPI is no lower than that for conventional MPPI. Numerical experiments demonstrate smoother inputs in obstacle avoidance and maintained performance over long horizons. Moreover, they verify the lower bound on the number of samples given by the finite-sample analysis.

0.28

Online, Reachability-Aware, Sampling-Based Motion Planning

cs.RO eess.SY ·2026-09-08 ·Brendan Gould, Zhiyuan Zhang, Panagiotis Tsiotras, Samuel Coogan
similarity 0.62
Abstract · 8 pages, 1 figure

Sampling-Based Model-Predictive Control (MPC) algorithms are a flexible class of controllers used for navigation on a wide range of robotic systems. Historically, such approaches have lacked hard safety guarantees, a shortcoming which we remedy in this work by computing guaranteed reachable-set overapproximations online with a fast, interval-based pipeline. We show that our method achieves similar performance to a state-of-the-art reachability-based planner without the need for the expensive pre-computation step, and can be scaled to systems that are infeasible using existing approaches. Finally, we demonstrate that our technique reduces safety violations by over 99% in a racing simulation and successfully controls a model racecar on real hardware experiments without crashes.

0.19

Control-Gibbs Distribution: Sampling for Optimal Control and Diverse Actions

eess.SY ·2026-11-12 ·Shengling Shi
similarity 0.62
Abstract

While conventional optimal control selects an optimal input sequence, probabilistic control assigns probability mass over all possible inputs and exploits a distribution of control sequences. Control distributions help enable exploration, capture diverse solutions, and solve deterministic optimal control problems. This work reviews an important probabilistic model for control distributions, the control-Gibbs distribution, i.e., the Gibbs distribution with an optimal control objective as the energy function. We point out its fundamental role in various probabilistic control frameworks, e.g., maximum entropy control, control-as-inference framework, model predictive path integral control, and energy-based models for control. This provides a model-central perspective to unify these probabilistic control frameworks. We also review the associated extensions of dynamic programming for computing closed-loop control distributions. To sample the control-Gibbs distribution, we consider projected Langevin sampling and develop non-asymptotic guarantees. The guarantees show the dual benefits of sampling the control-Gibbs distribution: obtaining diverse control solutions and solving the deterministic optimal control problem. We provide a numerical example where diverse arm trajectories are sampled from a control-Gibbs distribution.

0.23

Belief-Informed Hybrid Control with Almost-Sure Target-Set Convergence

eess.SY cs.ROmath.OC ·2026-10-06 ·Clinton Enwerem, Saleh Kemal, John S. Baras, Calin Belta
theorycode/data similarity 0.62
Abstract · 8 pages, 5 figures, 6 tables. Project page: https://clintonenwerem.com/belief-hybrid-control/

Controlling a hybrid system to a target set under parameter uncertainty can require informative actions that temporarily drive the system state away from the specified set. We propose a belief-informed dual-control algorithm that combines belief-space receding-horizon selection with an expected-decrease constraint on a nonnegative target-set progress function. To accommodate exploratory deviations, a scalar controller state bounds the constraint's cumulative slack. Our algorithm's two-step lookahead selection uses predicted observations to update the parameter belief before evaluating the subsequent action's admissibility. Under distance-comparison bounds, correct conditional prediction, and recursive feasibility, we prove almost-sure target-set convergence at decision times and bound both the sum of expected progress-function values and the expected neighborhood-entry time. Upper confidence bounds extend these convergence guarantees to bounded model samples with summable error probabilities. In planar regulation with an unknown control direction, we verify recursive feasibility: the proposed two-step selection reduces the Euclidean state norm below 0.01 within 11 decisions for either sign, whereas a myopic one-step selection loses admissibility immediately after zero input. In a simulated bimanual assembly task, our algorithm's one-step implementation uses clearance feedback to complete the assembly under nominal friction, yielding a 96.4% lower infinity-norm relative-position error than the reference-tracking baseline at the method's completion time. At lower friction, its posterior conditioning successfully detects an empty admissible set, whereas a fixed-prior alternative admits an action that violates the conditional decrease constraint. Project page: https://clintonenwerem.com/belief-hybrid-control/.

0.37

Safety-aware Model Predictive Path Integral Control with Signal Temporal Logic

cs.RO eess.SY ·2026-08-25 ·Yiqi Zhao, Taekyung Kim, Hideki Okamoto, Bardh Hoxha, Jyotirmoy V. Deshmukh +2 more
similarity 0.62
Abstract

Safety-aware motion planning remains a challenge in robotics, especially when missions are time-critical and are under complex specifications. In this paper, we propose safety-aware-stl-mppi, a computationally efficient sampling-based receding-horizon planning framework designed to promote satisfaction of constraints expressed in Signal Temporal Logic (STL). Our approach encodes discrete-time STL formulas into candidate time-varying control barrier functions (CBF), which are integrated into a model predictive path integral (MPPI) controller. Our method inherits the benefits of low computational cost from an efficiently parallelizable sampling based planner and utilizes CBF for constraints expressed in STL. We compare against several MPPI baselines using four artificial Mars Rover planning case studies with a diverse environment and cost setups, where we show our method consistently achieving high safety and efficiency. We show a quadcopter planning experiment with NVIDIA Isaac Lab.

0.16