CS Paper Radar

Control of Markov Jump Linear Systems with Uncertain Lumpable Cluster Observations

Carlos A. F. Persiani, Ram Padmanabhan, Melkior Ornik, Marco H. Terra

eess.SY math.OC ·submitted 2026-10-01 23:07 UTC · v1

Abstract

In this paper, we consider the control of Markov jump linear systems when the active system mode is not exactly known. We rather assume that this true mode is only known to belong to an observed cluster of modes, making both the dynamics and the associated transition probabilities uncertain. We construct a min-max optimal control problem in this setting, with the objective of robust regulation. Using results in regularized least mean-square optimization, we describe how the solution of this problem can be reduced to a Riccati recursion, such that the controller depends only on knowledge of which cluster the mode lies in. We subsequently establish convergence of the recursion and stability of the resulting closed-loop system. A numerical example illustrates the effectiveness of the proposed methodology.

Comment
8 pages, 2 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Necessary and Sufficient Conditions for Adaptive Stabilizability of Continuous-Time Markov Jump Linear Stochastic Systems

eess.SY math.OC ·2026-10-25 ·Ziwei Guo
similarity 0.61
Abstract · 19 pages

The purpose of this paper is to provide a mathematically rigorous solution to a well-known problem in stochastic adaptive control, i.e., to find the weakest possible structural condition for global stabilizability of continuous-time Markov jump linear stochastic systems with known candidate modes but with an unobservable Markov parameter process. Under some regularity assumptions, it is shown that the necessary and sufficient condition for global adaptive stabilizability hinges on the solvability of the same coupled Riccati equations as in the non-adaptive case. This result highlights a fundamental difference between the continuous-time case considered here and the discrete-time case studied earlier by Xue and Guo (2001), in which the coupled Riccati equations for adaptive and non-adaptive stabilizability are different.

0.23

Optimal Linear Filtering of Markov Jump Systems

eess.SY ·2026-10-25 ·Wei Liu
similarity 0.59
Abstract

This paper deals with the optimal state estimation problem for discrete-time Markov jump linear systems in the sense of linear minimum mean-square error where the noises corrupting the system are mode-dependent and need not be Gaussian. An orthogonal projection extension-based equation (OPEBE) is established, which can decompose a random vector into several parts where the random vector contains conditional expectation of another random vector. Using the OPEBE and some results obtained in this paper, an optimal linear filter for the system under consideration is proposed. The computational and storage load of the proposed filter does not increase with time. Also, the proposed filter is finite-dimensionally computable and has a recursive structure. Computer simulations are provided to verify the effectiveness and performance of the proposed optimal linear filter.

0.22

Online Adaptive Clustering in Robust Distributed Model Predictive Control

eess.SY ·2026-11-10 ·Stefan van Dijk, W. P. M. H. Heemels, Paula Chanfreut Palacio
theory similarity 0.56
Abstract · 12 pages, 5 figures, journal

This paper proposes a dynamic clustering framework for tube-based model predictive control (MPC) of coupled multi-agent systems. Agents within a cluster coordinate their dynamics explicitly, while couplings from agents outside the cluster are treated as bounded disturbances. For each admissible cluster, we construct a state-dependent mismatch measure from a robust upper bound on its predicted closed-loop cost and an optimistic, partition-independent lower bound. Combining this mismatch with a communication penalty enables online selection of the clustering topology, ranging from centralized to fully decentralized operation. The resulting switching controller is shown to preserve recursive feasibility and constraint satisfaction, and to render the closed-loop system practically asymptotically stable. Furthermore, the mismatch provides an upper bound on the finite-horizon performance difference with respect to centralized MPC. An eight-agent spring--damper example illustrates how the controller adapts cooperation while maintaining performance close to centralized MPC with reduced communication.

0.28

Minimum-Energy Control for Stochastic Linear Systems

eess.SY math.OC ·2026-10-09 ·Vaishnavi Sharma, Vaibhav Katewa
theory similarity 0.54
Abstract

The open-loop minimum-energy control (MEC) problem asks for control inputs that minimize the control energy while ensuring the terminal state reaches a desired value. In this paper, we study the open-loop MEC problem for stochastic linear time-invariant systems. We consider a variety of stochastic constraints that enforce the terminal error to be \emph{small}, and show that Stochastic MEC (SMEC) problem can be formulated as a QCQP. We obtain the optimal solution for SMEC and show that it generalizes the well-known Deterministic MEC problem by introducing novel stochastic variants of controllability and Gramian matrices. Finally, we show that there exists a fundamental lower bound on the optimal control energy which cannot be overcome by increasing the time horizon of the problem.

0.44

Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements

cs.RO eess.SY ·2026-09-02 ·Guanhua Liu, Tong Wu, Lixian Zhang, Weifeng Du, Minghao Han
similarity 0.53
Abstract

Intermittent state measurements pose fundamental challenges to model predictive control of constrained nonlinear systems because prediction uncertainty grows during feedback outages and measurement-triggered resets disrupt nominal state propagation, potentially compromising closed-loop stability and recursive feasibility. This paper develops a Koopman-based stochastic MPC framework with probabilistically truncated soft constraints. Specifically, a Lipschitz-constrained deep Koopman model provides a linear latent predictor, enabling computationally efficient online optimization. The intermittent measurement process is modeled as a two-mode discrete-time Markov chain, yielding a unified Markov jump error model for open-loop propagation and measurement-triggered resets. Under numerically verifiable sufficient conditions, the prediction error is shown to be mean-square ultimately bounded, and an explicit uniform second-moment bound is obtained. A distribution-free probabilistic error radius is then constructed for a prescribed confidence level and used to truncate dropout-dependent constraint tightening. An exact-penalty soft-constraint mechanism accommodates reset-induced jumps and prolonged dropouts. Under the stated terminal compatibility and bounded-disturbance conditions, recursive feasibility and mean-square ultimate boundedness of the closed-loop regulation error are established. Numerical simulations on a visual-servoing tracking task corroborate these theoretical results and demonstrate effective tracking under stochastic measurement unavailability.

0.21

Deep Pontryagin Learning for Continuous-Time Stochastic Control with Jumps

cs.LG eess.SYmath.OC ·2026-10-19 ·Jean-Loup Dupret, Patrick Cheridito
theory similarity 0.52
Abstract

We develop a deep Pontryagin learning framework for high-dimensional continuous-time stochastic control problems that naturally accommodates jump-diffusions. In contrast to direct policy optimization, which repeatedly differentiates the objective through the entire time-discretized dynamics, our method separates adjoint learning from policy improvement by explicitly incorporating state-sensitivity information from the Pontryagin stochastic maximum principle. For a fixed Markov control, we first compute pathwise adjoint labels by backpropagating the reward through time along simulated state trajectories, and project these labels onto the Markov state through a supervised regression step. The control is then updated by enforcing the pointwise Hamiltonian stationarity condition. We prove that the resulting projected adjoint process satisfies a discrete-time Pontryagin principle and converges, as the time step tends to zero, to the solution of the corresponding continuous-time adjoint backward stochastic differential equation. Numerical experiments illustrate the accuracy, stability, and scalability of the approach.

0.25

Reach-Avoid Certificates for Contact-based Stochastic Hybrid Systems

eess.SY cs.ROmath.PR ·2026-10-12 ·Tianyi Xia, Ryan K. Cosner
theory similarity 0.51
Abstract

This work studies certified reach-avoid control of stochastic hybrid systems in which a stochastic differential equation governs continuous flow and a controlled stochastic kernel governs guard-triggered resets. The input appears only in the reset kernel, where it determines the post-jump distribution. Certificates for such systems have so far assumed spontaneous or controller-chosen jump times, a finite horizon, or discrete-time dynamics; we certify, over the infinite horizon, that the target is reached before the unsafe set with at least a prescribed probability. First, we introduce reach-avoid contact certificates, whose flow and jump conditions are imposed only on a sublevel corridor, and prove that any such certificate with a compatible reset policy meets the specification; a pointwise safety filter extends this guarantee from verification to control by constraining arbitrary nominal controllers. Next, we prove that executions are non-Zeno and bound the expected settling time and reset count. We frame certificate search as a linear program over any twice-differentiable dictionary followed by independent verification. We illustrate our approach via comparisons where the certified region is a subset covering 93.6\% of the ground truth and where our certificate-based safety filter reaches the goal while reducing collisions from 68 to zero across 200 episodes of a dribbling ball problem.

0.26

Incremental Input-to-State Stabilization of Partially Unknown Control-Affine Systems within Prescribed Safe Sets

eess.SY ·2026-11-10 ·P Sangeerth, Poulomee Ghosh, Pushpak Jagtap
similarity 0.50
Abstract

Incremental input-to-state stability ($δ$-ISS) guarantees that the trajectories of a system converge towards one another, up to a gain on the difference of their inputs. Some existing learning-based designs that combine incremental stability with safety achieve only incremental input-to-state practical stability, whose non-vanishing offset can make the guarantee conservative. We consider control-affine systems with a known, full-row-rank input matrix and an unknown drift learned using Gaussian process regression. The prescribed safe set is a superlevel set of a smooth function satisfying a radial condition that ensures a diffeomorphism onto $\mathbb R^n$ and it need not contain any equilibrium of the uncontrolled system. Using this transformation, we design a smooth feedback law and derive sufficient conditions that, under the stated learning assumptions, guarantee with high probability both forward invariance of a compact subset of the safe set and $δ$-ISS on that subset. The incremental estimate uses the distance induced by the transformation and contains no practical offset. Simulations on a Van der Pol oscillator and a Lotka-Volterra system illustrate the proposed approach.

0.36