CS Paper Radar

Partial Observation Amplifies Model Mismatch in MAP Estimation via Information-Curvature Margins

Junsei Ito, Yasuaki Wasa

eess.SY ·submitted 2026-08-25 13:35 UTC · v1
published

Abstract

This paper theoretically analyzes how system model mismatch displaces finite-horizon maximum a posteriori (MAP) initial-state estimates in controlled dynamical systems under partial observation. From pathwise sensitivity analysis, the initial-state nominal-oracle displacement called MAP shift is decomposed into a model-side mismatch injection and an estimator-side curvature resistance to identify a sensor-dependent information-curvature margin as the amplification bottleneck. The margin is governed by the weakest posterior-curvature direction, so that sensor configurations that maximize aggregate information can still be fragile to mismatches. We connect the margin to nominal Gauss-Newton curvature and to the Bayesian Fisher information matrix, distinguishing instance-wise mismatch robustness from design-time inferability. The margin admits a computable nominal proxy in nonlinear systems, becomes explicit in the linear time-invariant case, and is validated through two numerical examples.

Comment
7 pages, 4 figures. Accepted for presentation at the 65th IEEE Conference on Decision and Control (CDC), 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive Control as an Information Gradient Flow: Excitation, Constraints, Energy, and Stochastic Learning

eess.SY ·2026-10-04 ·Omkar Sudhir Patil
similarity 0.58
Abstract

Adaptive control is usually developed through Lyapunov stability, excitation, and parameter convergence, whereas neighboring fields describe learning using convexity, information geometry, variational principles, and stochastic thermodynamics. This paper develops a constrained common language for these viewpoints. For linearly parameterized models, the excitation Gramian is simultaneously the Hessian of accumulated prediction loss and, under Gaussian observations, Fisher information up to scaling. Persistent, finite, and partial excitation become uniform, finite-horizon, and restricted temporal curvature; memory methods retain previously acquired curvature. On a closed convex parameter set, deterministic adaptation is a projected gradient/Onsager flow, with tangent and normal cones recovering projection, while composite learning supplies data-dependent symmetric dissipation. Reflected Langevin dynamics, no-flux Fokker--Planck evolution, and constrained free-energy flow provide the stochastic counterpart. The framework distinguishes information supplied by data from confinement supplied by regularization or hard constraints and connects familiar adaptive-control structures to modern variational and information-theoretic language.

0.31

Information-theoretic receding-horizon active learning of nonlinear dynamical systems

eess.SY cs.LG ·2026-09-29 ·Juncal Arbelaiz, Anushri Arora, Jonathan W. Pillow
published similarity 0.58
Abstract · 8 pages, 3 figures. Accepted to the 2026 IEEE Conference on Decision and Control (CDC)

Accurately learning nonlinear dynamics from a finite-duration experiment requires the efficient collection of informative data. We address this challenge for stochastic controlled nonlinear dynamical systems whose state is observed along a single trajectory. Our goal is to reconstruct the unknown controlled state-increment map over a prescribed compact subset of state-input space. We construct a parametric estimator of the map using fixed nonlinear features, so that the model is nonlinear in the state and input, but linear in the unknown parameters. A Gaussian prior over the parameters yields recursive Bayesian posterior updates as data stream in, enabling online quantification of predictive uncertainty in the reconstructed dynamics over the target set. We formulate an optimal adaptive-design problem over an information state, using a prediction-oriented acquisition criterion based on the mean marginal mutual information between candidate future trajectories and the reconstructed dynamics over the target set. We then approximate the resulting adaptive-design problem by a non-myopic receding-horizon formulation, evaluate its remaining expectation using a scenario-based sample average, and solve the resulting deterministic program with the cross-entropy method, leveraging parallel candidate-scenario evaluations. Numerical experiments on a noisy multistable system demonstrate that the proposed adaptive information-seeking strategy reduces predictive uncertainty and reconstruction error more efficiently than common excitation baselines under comparable experimental constraints.

0.37

Bayesian Optimization with Fisher Information Geometry: Gradient Bounds and Trust-Region Methods

cs.LG cs.AIcs.IT ·2026-09-25 ·Saksham Kiroriwal, Julius Pfrommer, Jürgen Beyerer
top venuetheory similarity 0.57
Abstract · Accepted at NeurIPS 2026 (Camera Ready Version)

We study Bayesian optimization (BO) through the lens of information geometry. Pulling back the Fisher information metric through the surrogate posterior map yields a local sensitivity tensor on the input space, which leads to an upper bound on the gradient of reparameterizable acquisition functions (AFs). This view explains vanishing-gradient behavior in high-dimensional BO and provides a common interpretation of heuristics such as RAASP and dimension-scaled lengthscales. The upper bound can also serve as a generic recipe to understand the behavior of new acquisition functions or surrogates in high input dimensions as well. Using the bounds, we also identify necessary conditions for an input location to be an optimizer of the AF for a univariate Gaussian predictive posterior. Building on this analysis, we propose FITR, a trust-region-based BO method that replaces lengthscale-based scaling with local pullback-Fisher weights. FITR is not restricted to GP kernels with explicit lengthscales and easily generalizes to non-isotropic surrogates. FITR shows competitive performance on several benchmarks.

0.44

Confronting Uncertainty in Mechanism-AI Coupled Dynamical Systems via Optimal Transport and Information Geometry: Part I. Distribution Learning

cs.LG math.DSmath.MGmath.PR+1 ·2026-11-07 ·Pengfei Song, Yanni Xiao, Shuangshuang Yin
hot direction similarity 0.56
Abstract

Mechanism-AI coupled dynamical systems are increasingly used to study complex biological systems. However, uncertainty associated with noisy, sparse, and partially observed data limits their reliability. This paper presents a systematic mathematical formulation for treating these uncertainties from the perspective of optimal transport and information geometry. We formulate the uncertainty quantification problem as the minimization of an energy functional on a probability density space equipped with a Riemannian metric, with the loss evaluated through a differential equation, and give a unified description of the gradient flows of the energy functional under specific metrics, such as the Wasserstein and Fisher-Rao metrics. Furthermore, we present corresponding numerical methods for solving these gradient flows using abstract adjoint sensitivity analysis. The formulation connects a range of Bayesian inference methods for dynamical systems; numerical experiments compare posterior approximation and predictive uncertainty under a common computational budget. Moreover, it also provides a geometric perspective on dynamical modeling and the study of heterogeneity evolution.

0.32

A bioinspired internal model-based online estimator for planar pursuit

cs.RO eess.SY ·2026-09-21 ·Tengyue Liu, Xincheng Li, Sofia Morales Ferreira, Kevin Galloway, Udit Halder
similarity 0.55
Abstract

Bioinspired feedback controls for pursuit, tracking, and collective motion are often expressed in terms of the relative configuration between interacting agents. In practice, however, onboard sensors may not directly provide all quantities required for feedback control, necessitating estimation of unobserved quantities. This paper develops a bioinspired internal model-based estimator for reconstructing those quantities from partial sensory observations and known self-motion. State reconstruction is posed as an optimization problem that treats the relative kinematics as constraints and minimizes the disagreement between the internal model outputs and measurements from onboard sensors. Pontryagin's Maximum Principle is used to derive the necessary optimality conditions. A forward-backward algorithm is used to provide a numerical solution and a moving horizon formulation is employed for online implementation. The estimator is evaluated numerically against classical state estimators. Real-time implementation of the proposed framework on robotic hardware is demonstrated through two pursuit strategies.

0.19

Optimal input design via Frank-Wolfe

eess.SY math.OC ·2026-09-08 ·Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
published similarity 0.55
Abstract · 7 pages, 4 figures

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

0.38

Characterizing Identifiability and Generalization for Inverse Receding-Horizon Linear-Quadratic Regulator Problems

eess.SY math.OC ·2026-09-12 ·Zhiyuan Jin, Jingqi Li, David Fridovich-Keil
theoryhot direction similarity 0.54
Abstract · 6 pages, 1 figure. Submitted to IEEE Control Systems Letters (L-CSS) with the ACC presentation option

We consider the problem of objective inference in the context of receding-horizon linear-quadratic regulator (LQR). In this setting, we are given sequential state-action observations, where each observed action is the first control of a newly solved finite-horizon LQR problem. We characterize when the objective of that problem is uniquely identifiable from these observations and when additional observations provide no new information about the objective. We then analyze action prediction at unseen states and show that all objectives reproducing the observed actions yield identical actions throughout the affine hull of the observed states; outside this hull, we derive an upper bound on the prediction error. % and deriving a prediction-error bound outside this hull. Additionally, we show that, when only the linear objective terms are unknown, exact prediction holds at every state. Finally, numerical results show that, even under stochastic observation noise, re-optimizing an inferred objective enables accurate action prediction at unseen states across different planning horizons.

0.30

Certified Bayesian optimal experimental design: from Expected Information Gain to Signal-to-Noise Ratio

cs.IT ·2026-09-26 ·Mohamed Doumbouya, Arthur Vidard, Olivier Zahm
code/datahot direction similarity 0.54
Abstract

Optimal experimental design is often formulated as the maximization of the Expected Information Gain (EIG), which measures the expected reduction in uncertainty about a parameter of interest after observing the data. For nonlinear forward models and nonGaussian priors, computing the EIG typically requires costly nested Monte Carlo estimators or sophisticated density-approximation techniques. In this work, we derive new upper and lower bounds on the EIG using dimensional logarithmic Sobolev inequalities. The proposed bounds are expressed in terms of signal-to-noise ratios (SNR), preserving the simple matrix-based structure of the EIG in the linear-Gaussian setting and depending solely on covariance matrices and Fisher information matrices. We introduce two families of bounds: conservative bounds, designed to retain the entire information content, and incremental bounds, that prioritize early information acquisition for sequential experimental design. When model gradients are available, we further derive computable approximations of the Fisher-information terms that require only a small number of gradient evaluations, yielding substantial computational savings. The tightness of these bounds is controlled by the nonlinearity of the forward model, and in the linear-Gaussian setting, these bounds recover the exact value of the EIG. By eliminating the nested-sampling bottleneck, the proposed framework offers a tractable and theoretically grounded alternative to direct EIG estimation for large-scale Bayesian experimental design, while retaining the interpretability of the SNR-based bounds.

0.41