CS Paper Radar

An Adaptive-Sampling Control Framework for Constrained Linear Systems with Robust Safety Guarantees

Spencer Schutz, Charlott Vallon, Francesco Borrelli

eess.SY ·submitted 2026-09-19 02:32 UTC · v1

Abstract

Adaptive-sampling control balances control performance with resource efficiency. However, existing methods either fail to guarantee robust constraint satisfaction during rate transitions or require computationally expensive online optimization. This paper proposes an adaptive-sampling control framework for linear systems subject to polytopic state and input constraints and bounded additive disturbances. Given a time-varying reference control update rate provided by a reasoner, our framework continuously calculates Model Predictive Control (MPC) update rates that ensure robust constraint satisfaction at all time steps. Offline, robust M-step hold control invariance is used to precompute invariant sets for a list of update rates and transition sets between them. Online, these sets are used in real time to guarantee recursive feasibility and finite-time transitions to the reference update rate. The utility of the architecture is demonstrated in a cruise control simulation.

Closest papers

Nearest neighbours by meaning across the whole index.

Laguerre-MPPI

eess.SY ·2026-11-18 ·Yusuke Tahori, Masaki Inoue, Hayate Irie, Tomohiro Taki, Takashi Hatano
theoryhot direction similarity 0.65
Abstract

Model Predictive Path Integral control (MPPI) is a sampling-based control method that handles nonlinear dynamics and non-convex costs without gradient information. Since MPPI samples the entire input sequence, longer prediction horizons lead to a higher-dimensional sampling space, potentially degrading control performance. This paper proposes Laguerre-MPPI, which parameterizes the control input sequence using discrete-time Laguerre basis functions and samples the basis coefficients. The resulting search dimension is independent of the prediction horizon. Hence, a longer prediction horizon does not require more samples to maintain the sampling density. For linear systems with quadratic costs, we derive a closed-loop stability condition in the infinite-sample limit. Under finite sampling, we provide a closed-form expression for the limit of the ratio of the effective sample size to the number of samples. We also show that the upper bound of this limit for Laguerre-MPPI is no lower than that for conventional MPPI. Numerical experiments demonstrate smoother inputs in obstacle avoidance and maintained performance over long horizons. Moreover, they verify the lower bound on the number of samples given by the finite-sample analysis.

0.28

A Unified Framework for Robust Data-Driven Model Predictive Control with Terminal Ingredients

eess.SY ·2026-10-04 ·Zhaohua Yang, Nan Bai, Pengyu Wang, Ling Shi
similarity 0.64
Abstract · Submitted for publication

This paper proposes a unified framework for robust data-driven model predictive control (MPC) with terminal ingredients for unknown linear time-invariant systems. Based on Willems' fundamental lemma, a single offline input-output trajectory is used as an implicit model, while online implementation only requires past input-output measurements. Bounded measurement noise is considered in both offline and online output data. The framework consists of an offline stage, where robust terminal ingredients are designed directly from noisy data, and an online stage, where these ingredients are incorporated into a one-step MPC scheme. Recursive feasibility of the proposed framework and practical exponential stability of the closed-loop system are established. Numerical results illustrate the performance tuning capability of the terminal set, with particularly pronounced benefits for short prediction horizons, and show that the proposed framework achieves performance comparable to data-driven MPC without terminal ingredients while requiring a reduced prediction horizon and less online computation.

0.13

Safe Reinforcement Learning with Hard Constraints: Policy Gradient Methods with Intersample Guarantees

eess.SY math.OC ·2026-11-16 ·Vipul K. Sharma, S. Sivaranjani
similarity 0.63
Abstract

We develop a policy-gradient (PG) reinforcement learning (RL) framework with hard inter-sample control barrier function (CBF)-based safety constraints for nonlinear sampled-data systems. We first design a class of stochastic policies with support truncated to sampling-period-dependent safe control sets, that guarantee safety-by-construction at sampling instants. We then propose a model-free PG algorithm that searches over the class of safe-by-design policies and establish sufficient conditions on sampling-period such that any action sampled from safe control sets remains safe throughout the sampling interval, providing inter-sample guarantees. We further establish finite-time convergence and sample complexity guarantees for the proposed PG algorithm and characterize its global optimality under gradient dominance. Finally, we illustrate inter-sample safety guarantees on a safe quadrotor navigation environment.

0.06

Sample-Efficient Model Predictive Control via Proximal Policy Optimization

eess.SY ·2026-11-17 ·Jiarui Wang, Sina Sharifi, Mahyar Fazlyab
similarity 0.63
Abstract

Sampling-based model predictive control (MPC) enables real-time control of complex nonlinear systems but often incurs substantial computational costs due to repeated trajectory simulations. In this paper, we bridge policy optimization in reinforcement learning and sampling-based MPC to improve computational efficiency through sample reuse. Starting from a KL-regularized distributional formulation of trajectory optimization, we derive an exact performance-difference identity based on a signed exponential advantage function. This identity motivates two algorithms, PPO-MPPI and SPO-MPPI, which adapt proximal policy optimization techniques to sampling-based MPC, enabling multiple optimization updates using previously evaluated trajectories without additional forward simulations. We establish population-level monotonic improvement guarantees for both methods and prove convergence to first-order stationarity for PPO-MPPI under fixed-covariance Gaussian sampling distributions. Experiments on quadruped velocity tracking and quadrotor path tracking demonstrate that the proposed methods achieve competitive control performance at substantially lower computational cost than multi-stage sampling approaches. Our results establish a principled connection between policy optimization and sampling-based MPC and highlight the potential of trajectory reuse for sample-efficient predictive control.

0.23

Hybrid Feedback Sampling for Sample-Efficient Model Predictive Control

cs.RO eess.SY ·2026-08-19 ·Chaoyi Pan, Zeji Yi, John Zhang, Zachary Manchester, Guannan Qu +1 more
similarity 0.63
Abstract · 15 pages, 6 figures

Thanks to its parallelizability and flexibility, sampling-based Model Predictive Control (MPC) has become widely popular for controlling real-world robotic systems. However, for high-dimensional and open-loop unstable dynamical systems, the required number of samples to improve the control sequence will grow exponentially with the horizon, leading to poor sample efficiency and numerical instability. This paper investigates the instability of shooting methods in sampling-based MPC and shows that the optimal sampling proposal distribution can be realized by sampling with an optimized feedback policy. We refer to this algorithm as Feedback Sampling MPC (FS-MPC). FS-MPC involves a hybrid sampling design which balances local and global search based on the system stability and the available computation budget. Our theoretical analysis shows that our hybrid sampling approach achieves faster convergence than standard MPPI and better optimality than standard feedback sampling. Empirically, in diverse contact-rich control tasks like humanoid loco-manipulation and dexterous manipulation, we show that FS-MPC successfully tackles dynamically unstable tasks where standard sample-based approaches struggle, and strictly outperforms feedback policies alone. Finally, we validate our method on humanoid robot locomotion and manipulation tasks in the real world.

0.47

On the suboptimality of stochastic MPC with varying constraint horizon

eess.SY math.OC ·2026-08-30 ·Allan Andre Do Nascimento, Andre Bertolace, Antonis Papachristodoulou, Kostas Margellos
publishedtheoryhot direction similarity 0.62
Abstract · Accepted for CDC 2026

Enforcing stochastic state constraints over the full prediction horizon in Model Predictive Control (MPC) can be computationally demanding. Here we study stochastic MPC without terminal ingredients in which chance constraints are enforced only over a shorter constraint horizon. Using stochastic relaxed dynamic programming, we derive an explicit upper bound on the average expected closed-loop cost that depends on both prediction and constraint horizons. For linear quadratic problems with affine chance constraints and bounded uniform disturbances, we provide a deterministic reformulation via coordinate transformation and constraint tightening. Simulations illustrate the trade-off between computational effort and performance.

0.38

Asynchronous Model Predictive Control Under Model Mismatch: Stability and Performance Guarantees

eess.SY ·2026-09-08 ·Changrui Liu, Anil Alan, Shengling Shi, Bart De Schutter
similarity 0.62
Abstract · This is the first work to characterize the joint effects of model mismatch, general asynchronous feedback, and prediction horizon on stabili…

Certainty-equivalence model predictive control (CE-MPC) is widely used for its simplicity and efficiency, but theoretical guarantees under asynchronous feedback remain limited. This paper establishes stability and performance guarantees for asynchronous CE-MPC of input-constrained nonlinear systems. We first derive a nominal stability condition and competitive-ratio bound that explicitly account for inter-execution intervals without prescribing a feedback mechanism. A value-function perturbation analysis for quadratic stage costs then accommodates additive, potentially non-smooth model mismatch without constraint qualification conditions. Combining these results yields stability criteria and competitive-ratio bounds for CE-MPC under general asynchronous feedback, including event/self-triggered and multi-step MPC. The guarantees explicitly relate prediction horizon, inter-execution time, and uncertainty magnitude, quantifying performance degradation relative to an ideal infinite-horizon controller. These results clarify tradeoffs between feedback frequency, model accuracy, and horizon length, guiding asynchronous MPC design using approximate or learned models.

0.30

Adaptive Handling of Deadline Misses via Stochastic MPC

eess.SY ·2026-10-13 ·Melanie Gallant, Paolo Pazzaglia, Christoph Mark, Kevin Schmidt, Martina Maggio
similarity 0.62
Abstract

Real-time control systems may experience sporadic computational overloads that cause controller executions to overrun their expected deadlines, affecting the timely update of control inputs. Such overruns are classically handled with static decisions, e.g., by either stopping and discarding the late execution at the deadline instant, or continuing it while skipping the next activations. This paper first demonstrates that such static policies can lead to suboptimal performance when the controlled system undergoes varying operating conditions, and thus proposes a control-driven hybrid overrun strategy that optimally adapts the deadline miss handling at runtime. We model the closed loop as a Markov jump linear system, whose modes encode overrun histories, and we formulate a scenario-tree-based stochastic model predictive control problem that predicts and optimizes over possible sequences of deadline hits and misses. We evaluate our proposal on linear benchmarks including a double integrator and an aircraft pitch system.

0.28