CS Paper Radar

Schur-Neural KF: Learned Schur-Consistent Corrections to the Extended Kalman Filter

Min Kim, Lianghao Cao, Soon-Jo Chung, Andrew M. Stuart

eess.SY cs.LGeess.SP ·submitted 2026-09-26 14:03 UTC · v1
publishedtheory

Abstract

We present Schur-Neural KF (SN-KF), a learning-based correction to the extended Kalman filter (EKF) that preserves the probabilistic conditioning interpretation of the EKF. The method perturbs the predictive state-measurement cross-covariance and the Cholesky factor of the measurement noise covariance so that the resulting joint predictive covariance is always positive semidefinite. The positive semidefiniteness is ensured by a Schur complement-based parametrization. We instantiate the parametrization with a recurrent neural architecture whose matrix outputs are modulated by amplitude gates. We prove that incorporating a measurement does not increase the filter's state uncertainty, and show that no measurement can induce an arbitrarily large state correction relative to its statistical surprise. We also present a perturbative analysis suggesting SN-KF's structural strength in the data-scarce regime. We provide two numerical experiments to illustrate the practical benefits of SN-KF. In a two-radar experiment, enforcing Schur-consistency provides a much broader failure-free hyperparameter region and reduces RMSE for small training subsets, consistent with our theoretical analysis in the data-scarce regime. In the unicycle experiment, SN-KF achieves the best precision, recall, false alarm rate, and gated RMSE under innovation-based sensor-fault rejection.

Comment
8 pages. Accepted to the 65th IEEE Conference on Decision and Control (CDC 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Probe Sets for Nonlinear Kalman Filtering: Multi-Center Gains and Covariance Recalibration

eess.SY eess.SP ·2026-09-13 ·Shida Jiang, Shengyu Tao, Scott Moura
code/data similarity 0.69
Abstract

Kalman filters (KFs) choose the gain as the product of the state-measurement cross-covariance and the inverse of the innovation covariance. In nonlinear systems, the predictive distribution generally changes shape, and these covariances require approximation. Conventional nonlinear KFs approximate them around a single center, the predicted state. They can produce inaccurate gains and overconfident covariance estimates when one local approximation does not represent the measurement geometry across the uncertainty region. To address this issue, we introduce probe sets, small covariance-scaled collections of states at which the filter repeats its local approximation. We then select the gain that minimizes the average covariance reported by these local approximations. The same construction is used in our previously proposed covariance recalibration step to improve covariance consistency. The construction applies to different KF variants without requiring a specific approximation rule. For quadratic measurements, we derive conditions under which probing yields lower normalized true error variance than the corresponding single-center gain when prediction uncertainty is sufficiently understated. We apply the framework to four KF variants and compare the resulting filters with multiple baselines across 300 randomized setups for each of two systems. The results show that probing preserves typical accuracy while substantially reducing covariance inconsistency and the rare large-error trajectories that dominate the root mean square of per-run errors. The code is available at https://github.com/Shida-Jiang/Probe_KF.

0.35

Neural Kalman Filtering for Unknown Dynamics: Task-Aware Learning with a Koopman Backbone

eess.SP ·2026-09-21 ·Mintaek Oh, Jeonghun Park, Nir Shlezinger, Yonina C. Eldar, Jinseok Choi
hot direction similarity 0.57
Abstract · 13 pages, 6 figures

Recent years have witnessed a growing interest in AI-aided Kalman filters. While emerging methodologies, such as KalmanNet, were shown to facilitate tracking in partially known state-space models, they are not directly applicable when the underlying dynamics is unknown. To overcome this limitation, we extend the KalmanNet philosophy to the unknown-dynamics regime by developing blind Kalman filtering frameworks that learn both the predictor and the correction gain from data, assuming that the state-evolution function and the noise statistics are both unavailable. To this end, we first introduce a task-aware neural Kalman filtering framework, Blind-KalmanNet, which carries the learning principle of the Kalman gain into the prediction step through a two-head neural architecture that jointly learns a state-dependent linear surrogate and the Kalman gain from data. Building on this formulation, we then develop our main framework, Koopman-aided Blind-KalmanNet, which incorporates Koopman operator theory to lift the unknown dynamics into a latent space where the state evolves linearly. The lifted linear predictor integrates seamlessly into the Blind-KalmanNet structure: the pre-trained deep Koopman network serves as a globally structured predictor, augmented by the task-aware residual surrogate and the learned Kalman gain inherited from Blind-KalmanNet. Extensive experiments demonstrate that the proposed frameworks achieve competitive performance against baselines, with Koopman-aided Blind-KalmanNet attaining the best accuracy across all considered settings.

0.33

Inverse Stochastic Filtering for Inverse Cognition in Counter-adversarial systems

eess.SP ·2026-09-05 ·Himali Singh
similarity 0.55
Abstract · Doctoral thesis

Recent advances in cognitive and counter-adversarial systems with the ability to infer their adversary's beliefs have garnered significant research interest in inverse filtering from a Bayesian perspective. Such counter-adversarial systems have potential applications where an autonomous system interacts with its environment, learns relevant information about it, and then adapts itself to achieve its goals optimally. An important example is the inverse cognition problem in cognitive radar-target dynamics. A cognitive radar adapts its waveform, beam pattern, and other parameters in real-time to accurately localize its target. An intelligent target can employ these inverse filtering results to evade detection and even deceive the adversarial radar. In this setting, a cognitive adversary or 'attacker' tracks its target of interest using a stochastic framework such as a Kalman filter (KF). The target or 'defender' then employs another inverse stochastic filter to infer the forward filter's estimates of the defender's state computed by the attacker. For instance, recently, inverse KF (I-KF) has been developed to predict the attacker's future steps by estimating its (forward) KF's estimates. Existing works on inverse stochastic filtering and inverse cognition consider either linear Gaussian or finite state-space models, which limits their applicability in many practical engineering problems. Hence, in this dissertation, we study inverse filtering in the general non-linear non-Gaussian system framework and develop inverse non-linear filters using different sub-optimal approaches.

0.26

Robustness of quantum spectrum estimation: weak Schur sampling under noisy inputs

cs.IT quant-phmath.RT ·2026-10-02 ·Vladyslav Visnevskyi, Laura Mančinska
similarity 0.55
Abstract · v3: slight correction to the statement of Theorem 3 in Preliminaries; expanded the proof of Proposition 45 in the Appendix for clarity; unif…

We initiate the study of weak Schur sampling (WSS) under noisy inputs. Many optimal quantum learning algorithms rely on this measurement, for instance in quantum spectrum estimation (QSE) and quantum state tomography (QST). The standard analysis of WSS, QSE and QST assumes that the $n$ input copies of the target state $ρ$ are identical, i.e. $ρ^{\otimes n}$. We study what happens when they are not, a more realistic noisy scenario that breaks the very permutation symmetry on which WSS is built. In the simplest model the input is a noisy product state: the copies are independent but not necessarily identical and each is $ε$-close in trace distance to the $d$-dimensional target state $ρ$. A naive argument via the data-processing inequality allows the per-copy errors to accumulate to $nε$ on the measurement outcome. We show that for QSE via WSS this does not happen: the expected estimation error in total variation is at most $ε+η(n,d)$, where $η(n,d)=O(d/\sqrt n)$ is the noiseless error, and the additive noise term $ε$ is optimal. The output error does not grow with $n$ even though the input error does; in this sense WSS is robust. Beyond noisy product states, for arbitrary input $ω$ we show that the error is at most $η(n,d)+\frac{1}{n}\|ω-ρ^{\otimes n}\|_{W_1}$, where $W_1$ is the quantum Wasserstein distance of De Palma et al. In particular, our results imply, for the first time, noise-robustness of Keyl and Werner's seminal algorithm for QSE, more than two decades after its introduction. Finally, we show that the noise cannot be too bad: within our model of robustness the promise on the input cannot be weakened to closeness of single-copy marginals or to a global trace-distance budget alone, as in both cases some inputs defeat every measurement and estimator.

0.21

Neural Conditional Gaussian Model: Efficient Data Assimilation with Sequential Uncertainty Quantification for Nonlinear Dynamics

cs.LG math.DS ·2026-11-19 ·Chuanqi Chen, Nan Chen
benchmark similarity 0.54
Abstract

Data assimilation (DA) in partially observed nonlinear systems requires repeated estimation of both hidden states and their uncertainty. Conventional nonlinear filtering can be computationally expensive and often relies on an explicit dynamical model. In this paper, we develop the Neural Conditional Gaussian Model (Neural CGM), a data-driven dynamical model that maps unobserved physical states into a learned latent space, where the dynamics of the latent states follow a conditional Gaussian structure. This structure allows closed-form DA updates in the latent space, while nonlinear encoder-decoder mappings retain the flexibility needed to represent complex dynamics in physical space. A key feature of Neural CGM is its treatment of uncertainty in DA. The latent posterior mean and covariance are mapped to the physical variables through a Gaussian decoder that combines local moment propagation with learned nonlinear corrections. The resulting physical-space posterior statistics depend on the sequentially updated latent distribution rather than on a separate post-processing estimate. The same statistics enter a Gaussian negative log-likelihood during training, so both the posterior mean and uncertainty affect the learned model. Because Neural CGM learns the dynamical model itself, it can also be used for state forecasting and simulation without explicit knowledge of the governing equations. Numerical experiments on benchmark nonlinear dynamical systems show accurate state estimation and forecasting while substantially reducing online assimilation cost relative to conventional nonlinear DA methods. Neural CGM is therefore suited to repeated state estimation, uncertainty quantification, and prediction from partial observations.

0.15

Analysis increments for model bias diagnosis and correction: Theoretical foundations

eess.SY physics.ao-phstat.ME ·2026-11-08 ·Eviatar Bach
similarity 0.53
Abstract · 15 pages, 5 figures

A common method for diagnosing and correcting model bias in weather and climate prediction is based on analysis increments: the difference between the analysis and the forecast at each data assimilation cycle. Their time average is used to estimate and correct the bias, and machine learning is increasingly used to map the forecast state to the increments, giving a state-dependent correction. Despite its widespread use, the method lacks theoretical foundations. We first analyse a Kalman filter whose forecast model has a constant bias. We show what the averaged increment measures, and prove that iterating the correction removes all of the bias seen through the observations; for linear dynamics, no method can identify the rest. We then extend the analysis to state-dependent biases. For linear dynamics, each increment records the model error over the filter's memory, as seen through the observations. We use this to determine what the increments measure when averaged over a long period, averaged over periods with similar slowly varying conditions, and used without averaging, as in machine-learned corrections. Numerical experiments confirm the theory for a linear model and suggest that its main conclusions carry over to the nonlinear Lorenz '96 model, including for a correction learned by a neural network.

0.34

A Robust Learning Framework for Deep-Learning-Based Radar Target Detection With Partially Mislabeled Training Data

eess.SP ·2026-10-05 ·Chuanfei Zang, Yiru Lin, Yumiao Wang, Xingyu Chen, Xiaobo Yang +1 more
similarity 0.52
Abstract

Deep-learning-based radar target detection has substantially improved detection performance, but its effectiveness depends critically on the correctness of the training labels assigned to radar echo samples. In practical applications, training data may contain partially mislabeled samples, which can cause detection models to learn biased supervisory information and thereby degrade detection performance. To address this issue, this paper proposes SL-RLF, a robust learning framework for deep-learning-based radar target detection with partially mislabeled training data. Specifically, we establish a probabilistic model to characterize the generation mechanisms of label errors in radar target detection and analyze the robustness of detection models under partial label errors within a risk minimization formulation. Theoretical analysis shows that, under appropriate assumptions, a loss function satisfying the symmetry condition enables the detection model in the learning framework to be robust against partial label errors. Guided by this result, we design a loss function satisfying the symmetry condition and construct the proposed robust learning framework, SL-RLF. Theoretically, under the corresponding label-error conditions, the optimal detection model learned by SL-RLF from partially mislabeled training data can achieve the same detection performance under the true data distribution as the optimal model learned from accurately labeled data. Experimental results demonstrate that, under different types and levels of partial label errors, the proposed SL-RLF consistently outperforms representative methods, including Co-teaching and TCE, and its robustness is generally consistent with the theoretical analysis.

0.27

Conformalized Kalman Filters for State Estimation with Trustworthy Confidence Regions

eess.SP ·2026-09-23 ·Olga Weisman, Nir Shlezinger, Bracha Laufer-Goldshtein
similarity 0.51
Abstract · Under review for publication in IEEE

Kalman-type filters are widely used for tracking dynamic systems, yet the confidence regions commonly derived from their estimated covariances can become unreliable under nonlinearities, non-Gaussian disturbances, and model mismatch. In this work, we develop a conformal prediction (CP) framework for equipping Kalman-type filters with statistically reliable confidence regions. Unlike CP applied to black-box estimators, our approach exploits the recursively estimated first- and second-order moments of the state posterior, which capture the time-varying uncertainty induced by the underlying dynamics. Based on these statistical features, we propose three complementary constructions. The first conformally calibrates Gaussian confidence regions induced by the filter moments. The second employs quantile regression to map the estimated moments into the boundaries of adaptive convex regions, which are subsequently calibrated. The third learns a Gaussian-mixture representation of the posterior and conformalizes the resulting density-based regions, enabling the characterization of multimodal and non-convex uncertainty sets. We establish finite- sample coverage guarantees for both sample-wise confidence, which controls miscoverage at individual time instances, and trajectory- wise confidence, which jointly covers the state sequence over a prescribed horizon. Numerical experiments across diverse linear and nonlinear dynamic systems demonstrate that the proposed methods attain the prescribed coverage while producing tight and informative confidence regions, and highlight the relative merits of the three constructions under different posterior characteristics.

0.24