CS Paper Radar

Set-based State Estimation for Unknown Dynamical Systems from Noisy Output Data with Probabilistic Guarantees

Georgios Pantazis, Michelle S. Chong

cs.LG math.OCeess.SY ·submitted 2026-11-15 01:58 UTC · v1

Abstract

We develop a methodology for set-based state estimation from noisy input-output trajectories, without a predefined model structure for the unknown state dynamics or access to training state measurements. We derive a bound on the state set diameter that depends on the sensor map and leverage it as a surrogate to formulate a tractable linear program balancing state set tightness against output trajectory coverage. Combining this certificate with deterministic or probabilistically certified measurement noise sets and leveraging the results from scenario optimization with relaxation, we provide joint a posteriori probabilistic guarantees for state inclusion and state set diameter. Numerical simulations corroborate our developed theoretical guarantees.

Closest papers

Nearest neighbours by meaning across the whole index.

A Bayesian Framework for Safe Optimal Control of Unknown Systems from Input-Output Data

eess.SY cs.LGmath.OC ·2026-11-02 ·Robert Lefringhausen, Annalena Daniels, Michael Fink, Sandra Hirche
code/data similarity 0.63
Abstract · 15 pages, 4 figures, 2 tables. Submitted to Automatica. Code available at https://github.com/TUM-ITR/PosteriorScenarioPlanning.jl

As control engineering is applied to increasingly complex systems, learning-based control, which uses empirical data to reduce the reliance on first-principles models, has emerged as a promising paradigm. However, such approaches must cope with nonlinear and stochastic dynamics, the absence of state measurements, and scarce data, while ensuring safe operation under constraints, which requires rigorous uncertainty quantification. Whereas existing methods treat these challenges in isolation, this article proposes a Bayesian framework that jointly addresses them. A prior in state-space form is updated from input-output data using particle Markov chain Monte Carlo methods, yielding a representation of joint uncertainty over dynamics and latent states. Building on this representation, a validation procedure is developed that provides probabilistic guarantees for constraint satisfaction under arbitrary causal control laws. For control synthesis, a formulation penalizing the conditional value-at-risk of the constraint function is proposed, together with an adaptive calibration mechanism that adjusts the performance-robustness trade-off to achieve a desired robustness level. The probability of successful certification is characterized theoretically. The framework is extended to a receding-horizon setting, where posterior updates from new measurements allow the controller to progressively reduce uncertainty and improve performance. The approach is demonstrated on the optimal control of a vertical farm.

0.42

Estimation-Aware Reachability

cs.RO eess.SY ·2026-11-18 ·Himanshu Paudel, Javier Borquez
code/data similarity 0.61
Abstract

Hamilton-Jacobi Reachability computes the states from which a system can be kept safe under worst-case disturbances, but it assumes the state is known exactly, whereas real robots act on noisy estimates whose uncertainty evolves with their motion. We extend Hamilton-Jacobi Reachability to the robot's belief, estimate and uncertainty, treating unexpected measurements as a bounded adversary and enlarging the unsafe set by the current uncertainty, so that certified states are safe with a prescribed probability. The formulation is compatible with existing solvers. In simulation, the resulting safety filters nearly eliminate the collisions of certaintyequivalent HJ and are less conservative than equally safe uncertainty-padding baselines. The implementation code is available at https://github.com/HimanshuPaudel/Estimation-Aware-Reachability

0.33

Information-theoretic receding-horizon active learning of nonlinear dynamical systems

eess.SY cs.LG ·2026-09-29 ·Juncal Arbelaiz, Anushri Arora, Jonathan W. Pillow
published similarity 0.60
Abstract · 8 pages, 3 figures. Accepted to the 2026 IEEE Conference on Decision and Control (CDC)

Accurately learning nonlinear dynamics from a finite-duration experiment requires the efficient collection of informative data. We address this challenge for stochastic controlled nonlinear dynamical systems whose state is observed along a single trajectory. Our goal is to reconstruct the unknown controlled state-increment map over a prescribed compact subset of state-input space. We construct a parametric estimator of the map using fixed nonlinear features, so that the model is nonlinear in the state and input, but linear in the unknown parameters. A Gaussian prior over the parameters yields recursive Bayesian posterior updates as data stream in, enabling online quantification of predictive uncertainty in the reconstructed dynamics over the target set. We formulate an optimal adaptive-design problem over an information state, using a prediction-oriented acquisition criterion based on the mean marginal mutual information between candidate future trajectories and the reconstructed dynamics over the target set. We then approximate the resulting adaptive-design problem by a non-myopic receding-horizon formulation, evaluate its remaining expectation using a scenario-based sample average, and solve the resulting deterministic program with the cross-entropy method, leveraging parallel candidate-scenario evaluations. Numerical experiments on a noisy multistable system demonstrate that the proposed adaptive information-seeking strategy reduces predictive uncertainty and reconstruction error more efficiently than common excitation baselines under comparable experimental constraints.

0.37

Data-Driven Synthesis of Robust Positively Invariant Sets: From State Feedback to Output Feedback

eess.SY ·2026-08-24 ·Zhijie Ning
similarity 0.60
Abstract · 9 pages, 4 figures, 1 table

This paper develops a direct data-driven framework for robust positively invariant (RPI) set synthesis for unknown linear time-invariant systems under state-feedback and observer-based output-feedback scenarios. The feedback and observer gains, along with the RPI sets, are directly synthesized from noisy offline data by solving semidefinite programs (SDPs), avoiding intermediate model identification or explicit model-uncertainty set construction. In the state-feedback case, a linear-quadratic (LQ)-type feedback gain is first computed, and an ellipsoidal RPI set is then synthesized for the resulting closed-loop dynamics. In the observer-based output-feedback case, offline data are used to compute the observer gain and the corresponding RPI set for the system state through an augmented-state formulation. This design provides a unified method for invariant-set computation in both scenarios, and the direct data-driven formulation avoids the explicit construction and propagation of an intermediate model-uncertainty set. Numerical examples illustrate the effectiveness of the proposed method.

0.27

Belief-Informed Hybrid Control with Almost-Sure Target-Set Convergence

eess.SY cs.ROmath.OC ·2026-10-06 ·Clinton Enwerem, Saleh Kemal, John S. Baras, Calin Belta
theorycode/data similarity 0.59
Abstract · 8 pages, 5 figures, 6 tables. Project page: https://clintonenwerem.com/belief-hybrid-control/

Controlling a hybrid system to a target set under parameter uncertainty can require informative actions that temporarily drive the system state away from the specified set. We propose a belief-informed dual-control algorithm that combines belief-space receding-horizon selection with an expected-decrease constraint on a nonnegative target-set progress function. To accommodate exploratory deviations, a scalar controller state bounds the constraint's cumulative slack. Our algorithm's two-step lookahead selection uses predicted observations to update the parameter belief before evaluating the subsequent action's admissibility. Under distance-comparison bounds, correct conditional prediction, and recursive feasibility, we prove almost-sure target-set convergence at decision times and bound both the sum of expected progress-function values and the expected neighborhood-entry time. Upper confidence bounds extend these convergence guarantees to bounded model samples with summable error probabilities. In planar regulation with an unknown control direction, we verify recursive feasibility: the proposed two-step selection reduces the Euclidean state norm below 0.01 within 11 decisions for either sign, whereas a myopic one-step selection loses admissibility immediately after zero input. In a simulated bimanual assembly task, our algorithm's one-step implementation uses clearance feedback to complete the assembly under nominal friction, yielding a 96.4% lower infinity-norm relative-position error than the reference-tracking baseline at the method's completion time. At lower friction, its posterior conditioning successfully detects an empty admissible set, whereas a fixed-prior alternative admits an action that violates the conditional decrease constraint. Project page: https://clintonenwerem.com/belief-hybrid-control/.

0.37

Learn-To-Propagate: Distributionally Robust Motion Planning for Nonlinear Uncertain Systems

cs.RO eess.SY ·2026-11-10 ·Eduardo Figueiredo, Adrien Banse, Qi Heng Ho, Raphael Jungers, Morteza Lahijanian +1 more
theory similarity 0.59
Abstract

Motion planning for stochastic systems aims to find a sequence of control inputs that drives a system to a goal set while avoiding unsafe states with high probability. Existing approaches, however, are either restricted to linear dynamics with perfect knowledge of the underlying distributions or lack formal correctness guarantees. To address these limitations, we propose \emph{Learn-To-Propagate Distributionally-Robust Forest (L2P-DR-Forest)}, a distributionally-robust sampling-based planning algorithm for \emph{nonlinear} stochastic systems with \emph{unknown} initial state and process noise distributions. Our approach leverages recent advances in optimal transport to learn ambiguity sets that contain the true system distributions with high confidence. We develop an efficient method for propagating these sets through the system dynamics and for verifying their safety. We then integrate these techniques into a novel sampling-based planning algorithm to grow a forest of search trees in the system's state space while accounting for and mitigating the growth of ambiguity-sets radii. We prove that the algorithm is correct, i.e., every returned plan satisfies the specifications with the prescribed confidence, and, under some feasibility and distributional assumptions, is probabilistically complete. Evaluations on several robotic benchmarks demonstrate that our algorithm significantly outperforms existing methods while providing formal guarantees with high confidence.

0.21

Robust Data-Driven Output-Feedback Reference Governor with Quantified Model Uncertainty

eess.SY ·2026-11-16 ·Tam W. Nguyen
benchmark similarity 0.56
Abstract · 45 pages, 4 figures, 2 tables

This paper constructs a data-driven reference governor (DDRG) from input--output data and supplied deterministic disturbance bounds. A data-consistent model set quantifies the uncertainty remaining in each prediction direction. With exact output measurements, the DDRG propagates output-history uncertainty while retaining exact applied-reference histories and converts the resulting tubes into constraint margins. Under a common contraction condition in a selected history norm, explicit terminal feasibility inequalities certify infinite-horizon continuation under a held reference and yield a closed invariant admissible set. A scalar update selects the largest certified step toward the requested reference, with recursive feasibility and constraint satisfaction from certified initialization. A separate bounded-measurement-noise extension derives the errors-in-variables model set and the additional physical-output margin through a measured-history certificate. On the coupled benchmark, longer nested records reduce one-step prediction disagreement at the probe regressor, and propagation accounts for most of the gap between the tube and true-model envelopes at the reported constraint row and prediction step.

0.25

Tracking Dynamic Simplicial Complexes via Constrained State-Space Estimation

eess.SP ·2026-09-25 ·Varun Sarathchandran, Bishwadeep Das, Elvin Isufi, Geert Leus
similarity 0.56
Abstract · Submitted to ICAASP 2027

Simplicial complexes (SCs) extend graphs to represent higher-order interactions, but couple their simplex levels through the inclusion property. While static SC inference is an emerging research direction, tracking time-varying SCs remains largely unexplored. A central challenge in tracking SCs is to account for the inclusion property. To this end, we build a nonlinear state-space model tailored to SCs. For prediction, we introduce a closure-aware Markov generation model whose conditional mean preserves simplicial inclusion and whose covariance captures edge-triangle dependencies. For correction, we encode inclusion constraints as nonlinear pseudo-measurements, allowing the constraints to inform both the state and covariance updates. We investigate progressively richer treatments of these measurements through a standard extended Kalman filter, an iterated extended Kalman filter, and a Laplace approximation. Experiments then demonstrate the benefits of exploiting the proposed dynamics and constraint information.

0.24