CS Paper Radar

Optimal Linear Filtering of Markov Jump Systems

Wei Liu

eess.SY ·submitted 2026-10-25 06:49 UTC · v1

Abstract

This paper deals with the optimal state estimation problem for discrete-time Markov jump linear systems in the sense of linear minimum mean-square error where the noises corrupting the system are mode-dependent and need not be Gaussian. An orthogonal projection extension-based equation (OPEBE) is established, which can decompose a random vector into several parts where the random vector contains conditional expectation of another random vector. Using the OPEBE and some results obtained in this paper, an optimal linear filter for the system under consideration is proposed. The computational and storage load of the proposed filter does not increase with time. Also, the proposed filter is finite-dimensionally computable and has a recursive structure. Computer simulations are provided to verify the effectiveness and performance of the proposed optimal linear filter.

Closest papers

Nearest neighbours by meaning across the whole index.

Control of Markov Jump Linear Systems with Uncertain Lumpable Cluster Observations

eess.SY math.OC ·2026-10-01 ·Carlos A. F. Persiani, Ram Padmanabhan, Melkior Ornik, Marco H. Terra
similarity 0.59
Abstract · 8 pages, 2 figures

In this paper, we consider the control of Markov jump linear systems when the active system mode is not exactly known. We rather assume that this true mode is only known to belong to an observed cluster of modes, making both the dynamics and the associated transition probabilities uncertain. We construct a min-max optimal control problem in this setting, with the objective of robust regulation. Using results in regularized least mean-square optimization, we describe how the solution of this problem can be reduced to a Riccati recursion, such that the controller depends only on knowledge of which cluster the mode lies in. We subsequently establish convergence of the recursion and stability of the resulting closed-loop system. A numerical example illustrates the effectiveness of the proposed methodology.

0.29

A simple derivation of the Kalman filter

eess.SP math.OCeess.SYmath.ST+1 ·2026-09-02 ·Marco Chiani, Giovanni Petris, Moe Z. Win
published similarity 0.52
Abstract · To be published in IEEE Signal Processing Magazine

In this lecture note, we present a concise and self-contained derivation of the discrete-time Kalman filter equations that requires only a basic understanding of least squares estimation. The treatment is designed to minimize mathematical overhead while preserving both rigor and generality.

0.33

The Zonotopic Mixture Filter

eess.SY eess.SP ·2026-08-18 ·Rodrigo A. González, Angel L. Cedeño, Vicenç Puig
similarity 0.48
Abstract · 16 pages, 8 figures

State estimation is commonly posed in either a probabilistic or an unknown-but-bounded framework. The former requires a fully specified noise distribution, typically with unbounded support, while the latter yields guaranteed enclosures that carry no probabilistic weighting. Bridging these noise descriptions, this paper proposes a zonotopic mixture noise model, in which the noise is generated by drawing a zonotope from a finite collection according to fixed probabilities and then realizing an arbitrary element of it. For this noise model, we derive the zonotopic mixture filter, which propagates a bank of zonotopic Kalman filters over mode histories, discards the histories falsified by the data, and weights the surviving ones by their relative probability. The resulting state enclosures yield guaranteed coverage probabilities and remain valid for every noise realization compatible with the bounds, and a greedy mixture reduction scheme preserves these statistical guarantees while keeping the representation tractable. Numerical examples illustrate the proposed approach and its potential benefits over related state estimation methods.

0.29

Variable Dimension IMM and GPB2 Filters for Tracking in Multiple Model Systems

eess.SP ·2026-09-25 ·Roberto Pérez-Pérez, Ángel F. García-Fernández
top venuecode/data similarity 0.47
Abstract · Matlab code of VD-IMM and VD-GPB2 is provided at https://github.com/ropperez/VD_Multiple_Models

This paper presents mathematically principled filters for multiple-model systems with states of different dimensionality, specifically the variable-dimension interacting multiple model (VD-IMM) filter and the variable-dimension generalised pseudo-Bayesian filter of order 2 (VD-GPB2). To do so, we first provide a Bayesian modelling of a variable dimensional dynamic system, and its measurements. Then, for variable dimensional linear Gaussian dynamic and measurement models, the VD-IMM filter is derived by assuming a posterior that has a Gaussian density for each mode, and then performing a Kullback-Leibler Divergence (KLD) minimisation after each prediction step to keep the Gaussian density form for each mode. Subsequently, the Bayesian update step is performed, keeping a Gaussian density for each mode. The VD-GPB2 filter considers the same model as the VD-IMM filter and also assumes that the posterior for each mode is Gaussian. In contrast, the VD-GPB2 filter propagates a Gaussian mixture for each mode in the prediction step. In the update step, the VD-GPB2 filter performs a KLD minimisation to have a Gaussian density for each mode. Simulation results show the benefits of the VD-IMM and VD-GPB2 filters compared to previous alternatives.

0.55

Data-Driven Stochastic LQR Control with Probabilistic Guarantees and Uncertainty Refinement

eess.SY ·2026-11-03 ·Amir Modares, Themistoklis Charalambous, Hamidreza Modares
similarity 0.46
Abstract

This paper presents a probabilistic framework for the direct, data-driven synthesis of the stochastic linear- quadratic output-feedback control for linear systems sub- ject to process and measurement noise. Using delayed input-output measurements, we derive a lifted parameter- ization together with an equivalent lifted linear quadratic cost, enabling controller synthesis without explicitly identi- fying the lifted dynamics. Two complementary closed-loop formulations, based on trajectory and covariance represen- tations, are then developed, whose uncertainties depend only on the realized but unknown lifted noise. We char- acterize the relative performance of the two formulations in finite-data regimes. High-probability uncertainty bounds are developed for realized noises, leading to a convex optimization solution to the problem, whose feasibility cer- tifies probabilistic mean-square stability (p-MSS) and per- formance guarantees. To reduce conservatism, Gaussian zonotopes are used to refine uncertainty sets by elimi- nating noise realizations inconsistent with measured data, and a novel intersection rule enables the consistent fusion of data-driven and physics-informed information. These components are integrated into an adaptive framework that unifies indirect (identification-based) and direct (control- oriented) data-driven linear-quadratic output-feedback con- trol. Unlike existing direct data-driven LQR methods that verify stability a posteriori, our by-construction approach achieves robust stability alongside reduced conservatism and superior performance. Simulation results show that the proposed controller approaches the ideal optimal solution while outperforming existing data-driven methods under noisy measurements.

0.19

Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements

cs.RO eess.SY ·2026-09-02 ·Guanhua Liu, Tong Wu, Lixian Zhang, Weifeng Du, Minghao Han
similarity 0.45
Abstract

Intermittent state measurements pose fundamental challenges to model predictive control of constrained nonlinear systems because prediction uncertainty grows during feedback outages and measurement-triggered resets disrupt nominal state propagation, potentially compromising closed-loop stability and recursive feasibility. This paper develops a Koopman-based stochastic MPC framework with probabilistically truncated soft constraints. Specifically, a Lipschitz-constrained deep Koopman model provides a linear latent predictor, enabling computationally efficient online optimization. The intermittent measurement process is modeled as a two-mode discrete-time Markov chain, yielding a unified Markov jump error model for open-loop propagation and measurement-triggered resets. Under numerically verifiable sufficient conditions, the prediction error is shown to be mean-square ultimately bounded, and an explicit uniform second-moment bound is obtained. A distribution-free probabilistic error radius is then constructed for a prescribed confidence level and used to truncate dropout-dependent constraint tightening. An exact-penalty soft-constraint mechanism accommodates reset-induced jumps and prolonged dropouts. Under the stated terminal compatibility and bounded-disturbance conditions, recursive feasibility and mean-square ultimate boundedness of the closed-loop regulation error are established. Numerical simulations on a visual-servoing tracking task corroborate these theoretical results and demonstrate effective tracking under stochastic measurement unavailability.

0.21

Reinforcement Learning-Based Output Feedback LQR for Continuous-Time MIMO Systems

eess.SY ·2026-08-12 ·Qihua Chen, Mingxiang Liu, Lili Wang, Zhiyun Lin, Minyue Fu
similarity 0.45
Abstract · 22 pages, 3 figures, 1 table

This article studies model-free output feedback linear quadratic regulation (LQR) for continuous-time linear systems with an $n$-dimensional state, an $m$-dimensional input, and a $p$-dimensional output, using filtered input--output data. Since the system state is unavailable, existing methods rely on dynamic filters to parameterize the hidden state using measurable input--output signals. However, the intrinsic dimension of the resulting filter-based parametrization can be smaller than the dimension of the complete filtered vector, and this deterministic redundancy can make the Bellman regressions rank deficient. We characterize this intrinsic dimension and show that the conventional filtered vector contains only $2n$ independent components for single-input multi-output (SIMO) systems and $n(m+1)$ independent components for general multi-input multi-output (MIMO) systems. Based on this characterization, a reduced filtered vector is extracted directly from data and used to develop reduced model-free output feedback policy iteration and value iteration equations, eliminating the redundant directions and decreasing the number of unknown parameters while retaining a fully input--output data-based implementation. A numerical example illustrates the rank reduction and the effectiveness of the learned controller.

0.10

Applying the Spectral Method for Modeling Linear Filters: Bessel, Papoulis, and Legendre Filters

eess.SP eess.SYmath.NA ·2026-08-20 ·Konstantin A. Rybakov
similarity 0.44
Abstract

This paper proposes a new technique for computer simulation of linear filters. It allows simulating continuous-time linear filters based on the spectral method for analyzing linear control systems. Applying the spectral method implies that the input and output signals are represented by ordered sets of expansion coefficients in a chosen basis, and the filter itself is specified by a two-dimensional nonstationary transfer function. The described technique is tested on Bessel, Papoulis, and Legendre filters of various orders. For each filter, the corresponding two-dimensional nonstationary transfer function, i.e., the matrix of the linear transformation relating expansion coefficients of the input and output signals, is obtained.

0.25