CS Paper Radar

Minimax-Optimal Robust Identification of Continuous-Time Systems: Handling Narrow-Band Disturbances in the Frequency Domain

Jonas Gillberg, Fredrik Gustafsson

eess.SY math.ST ·submitted 2026-09-20 19:35 UTC · v1

Abstract

The high-frequency spectral roll-off of continuous-time ARMA (CARMA) models can magnify the effect of narrow-band disturbances when aliasing is weak, making standard maximum-likelihood Whittle estimation sensitive to affected ordinates. We show that a logarithmic transformation $r_k = \log ρ_k$ converts the Whittle scale problem into a Gumbel location problem, connecting robust spectral estimation to the classical minimax theory of Huber and Rieder. A piecewise centering correction---closed-form for small $b$, implicit closed-form for the practitioner range---preserves Fisher consistency for any clipping level without numerical optimisation. Clipping the Gumbel score symmetrically and transforming back yields a two-sided clipped Gumbel score (the standard Rieder--Hampel bounded-influence form) whose normalised influence curve is proved locally asymptotically minimax under shrinking gross-error contamination. The efficiency loss is quantified by a single scalar $K(b)$: at $b = 1.5$, only $16\%$ nominal asymptotic variance overhead. In the stated AR(2) Monte Carlo design, the sample-size trends are compatible with the asymptotic rate, and at $b=1.5$ the bias reductions are about $40\%$, $90\%$, and $96\%$ for $a_1$, $a_2$, and $λ$, respectively.

Comment
17 pages, 13 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Error Bounds for Statistical Estimators in BTL Model with Parametric Multivariate Utility Functions

cs.LG stat.ML ·2026-09-22 ·Yicheng Li, Huifu Xu
similarity 0.61
Abstract

We study preference elicitation under the Bradley-Terry-Luce (BTL) model where the true partworth vector is unknown and has to be estimated as a parameter with elicited preference information. The set of selected pairwise queries is non-uniform, deterministic, and arbitrary over a collection of alternatives, provided that it satisfies a joint identifiability condition. We focus on understanding when the canonical maximum likelihood estimator (MLE) is finite and admits sharp error bounds without explicit compactness constraints on the feasible set or external regularizers. To this end, we derive minimax lower bounds under the standard bounded dynamic range condition, and find that the same Fisher-information geometry in the classic Cramér-Rao lower bounds underpins the finite-sample difficulty of the estimation problem. By combining a non-asymptotic expansion of the likelihood score equation with a fixed-point localization argument, we identify a design-dependent sample size threshold above which the unconstrained canonical MLE exists and is unique with high probability. The same expansion yields a decomposition of the estimation error into a linear stochastic term, an explicit second-order bias, and a higher-order remainder. A refined analysis gives sufficient sample size conditions under which the canonical MLE attains the minimax rates up to logarithmic and constant factors. These results provide a unified non-asymptotic theory for parametric utility elicitation and reveal when the inference is determined by response data alone rather than by external regularization. Preliminary numerical results are consistent with the theoretical findings.

0.43

Fisher Information and the Minimum Mean-Square Error for Locating Closely Spaced Point Sources

cs.IT ·2026-10-23 ·Chuling Wen, Jian Lu, Qingtang Jiang, Charles K. Chui
theory similarity 0.58
Abstract

We determine the optimal average error of locating closely spaced sources from noisy superpositions of a known smooth response with unknown complex coefficients. Relative phases control how changes in one location can be offset by the other unknowns, so local Fisher information alone does not determine the attainable error. For every fixed number $K\ge2$ of sources with independent uniform phases, we prove matching Bayes risk bounds jointly in separation and noise, for all sufficiently small separations and all noise levels. Odd source counts have two risk regimes; even counts have an intermediate regime in which mean squared error is linear in the noise standard deviation. A projected least-squares estimator attains these orders without knowing the phases or the prior density. Bounded nonuniform phase laws preserve the orders under stated support conditions, whereas priors concentrated near poorly identified configurations can change the exponents. A common finite comparison yields both a global inverse bound and paths controlled by the original prior. These give sufficient conditions under which the risk has the order of the pointwise capped Cramér--Rao bound, and a lower-tail calculation explains the power and logarithmic regimes. We also give conditional guarantees when the cluster center, separation, and source count are unknown, with an additional low-noise requirement for count selection. A calibrated covariance factor model illustrates the same criterion beyond source localization.

0.26

Split Conformal Interval Length under Huber Contamination

cs.LG ·2026-10-11 ·Xiao Zhang, Bowen Zhang, Lie He
theory similarity 0.57
Abstract

Existing analyses of interval length in split conformal prediction largely focus on clean data. However, how contamination at the training and calibration stages alters interval length relative to the corresponding clean population oracle remains understudied. In this paper, we consider Huber contamination and derive a finite-sample upper bound that holds uniformly over contaminating distributions, with leading terms scaling as $L(δ_1+n_1^{-1/2}) +(n_2^{-1/2}+δ_2)/((1-δ_2)r_0)$, in addition to a clean-sample estimation term. We further establish a minimax lower bound matching the upper-bound rate up to constant factors on a regular asymmetric location submodel. For calibration contamination, we obtain an exact worst-case characterization of the population interval-length deviation. We also extend the upper-bound results to conformalized quantile regression and adaptive residual scores. Experiments on synthetic and real-world datasets provide empirical support for our theoretical findings on training and calibration contamination.

0.15

Robustness of Diffusion Models under Distribution Shift

cs.LG math.STmath.PRstat.ML ·2026-09-23 ·Wei Luo, Neil K. Chada, Shijie Zhang, Lu Yu
similarity 0.56
Abstract · 13 pages, 2 figures

Score-based diffusion models are increasingly considered in settings where the underlying data distribution may differ from the training distribution, yet existing theoretical guarantees largely focus on the no-shift setting. In this work, we study robust score estimation under Wasserstein perturbations of a reference distribution. For the Ornstein--Uhlenbeck diffusion, we show that robust estimation decomposes into two fundamental components: the statistical cost of learning the reference distribution and the intrinsic cost of distribution shift. The latter scales quadratically with the Wasserstein radius, and this dependence is minimax optimal. We construct an explicit finite-sample estimator achieving the resulting robust minimax rate without knowing the shift radius. When the reference distribution lies on an unknown low-dimensional subspace, the statistical term adapts to the intrinsic dimension while the shift cost remains unchanged. Finally, we show that the same decomposition governs positive-time reverse sampling and obtain matching minimax guarantees in KL divergence. Together, these results characterize how finite data, intrinsic dimension, and distribution shift affect the robustness of score-based diffusion models.

0.22

Compressed Single-Tone Frequency Estimation With Unknown Complex Gain: Singular Rates and Global Identifiability

eess.SP ·2026-08-31 ·Armon Rasooli
theory similarity 0.55
Abstract

Fixed linear compression can preserve local Fisher information for a sinusoid yet destroy global frequency identification, while a dark response can make local estimation nonregular. We study both failures for a single complex tone observed through a fixed complex-linear sketch with unknown nonzero complex gain and pre-sketch white Gaussian noise. Near an isolated analytic dark frequency, we separate radial signal vanishing from optimized projective contact between the two signed frequency branches. When the gain magnitude is constrained to a fixed nondegenerate interval, finite contact is equivalent to local quotient identifiability and minimax consistency. The sharp mean-square-error rate is determined by the sum of the radial and contact orders; infinite contact produces exact local aliases. Globally, we formulate a worst-frequency efficientinformation objective on whitened row spaces. We solve it exactly for every even output rank, prove uniqueness and quantitative rigidity of the symmetric-edge projector, and solve the evenaperture co-rank-one case. The rank-two optimum is aliased, and a winding obstruction gives a positive lower bound on the information price of global identification. From three outputs onward, sketches that are globally identifying with an immersive projective response are open and dense and have zero price at the level of suprema; for every even rank of at least four, the exact optimizer has this property. Thus local information preservation, singular recoverability, and global identifiability obey distinct compression laws within one estimation model.

0.26

Distributionally Robust Frequency Response Estimation Using Non-Steady-State Frequency-Domain Data

eess.SY ·2026-10-07 ·Stefan Damjanovic, John W. Simpson-Porco, Klaske van Heusden
theory similarity 0.55
Abstract

This paper develops a distributionally robust optimization (DRO) framework for identifying the frequency response function (FRF) of an unknown linear time-invariant system from repeated noisy non-steady-state input-output measurements. Building on a recent frequency-domain extension of Willems' fundamental lemma, we formulate FRF estimation as a DRO problem, wherein robustness is desired with respect to the unknown probability distribution generating the noisy data. The proposed estimator computes FRF estimates by minimizing a convex upper bound on the DRO cost and allows for frequency-dependent calibration of the Wasserstein metric; the tractable upper bound consists of an empirical fit and a regularizer that penalizes the largest weighted sensitivity to spectral perturbations. Under suitable assumptions, we prove that the FRF estimation error is upper bounded by the optimal value of the DRO problem. The method is validated via a simple numerical study, which demonstrates improved performance under severely heavy-tailed noise.

0.44

How Many Directions Must a Truncated Diffusion Sampler Retain? Matching Bounds Under Power-Law Spectra

cs.LG math.STstat.ML ·2026-10-07 ·Radmehr Karimian, Ali Mohades, Johannes Lederer
theory similarity 0.50
Abstract

Diffusion samplers can reduce computation by generating selected spectral coordinates and filling the remaining directions with noise. How many directions must they retain? We study this question for data with power-law covariance spectra. For Gaussian data compared to a smoothed target, we prove matching bounds on the required number of retained directions, provided that the ambient dimension is sufficiently large. The truncation error depends on the combined Wiener gains of the omitted directions, regardless of the accuracy of the sampler on the retained coordinates. Keeping only directions whose signal exceeds the output noise level can therefore leave a non-vanishing error: many individually weak directions remain significant in aggregate. Combining this characterization with a diffusion convergence bound yields sufficient sampling-step complexity under exact scores. The upper bounds also extend to estimated principal components and, componentwise, to Gaussian mixtures. The practical prescription is to select the retained subspace using an aggregate spectral-tail error budget, then to choose the diffusion noise level accordingly.

0.37

Estimating the generator of matrix exponential time-series

cs.IT quant-ph ·2026-11-03 ·Jonáš Fuksa, Jens Eisert, Ingo Roth
theory similarity 0.50
Abstract · 11 pages + 4 page Appendix, 3 figures. Comments welcome!

The achievable precision in estimating the spectrum of a time-series signal that is promised to be sparse in Fourier space deteriorates rapidly as the spectral peaks get closer together, as soon as we introduce noise. Here, we study the related task of generator estimation: estimating the generator of a matrix exponential time-series and its eigenvalues. We obtain rigorous non-asymptotic precision guarantees on genESPRIT, a practical algorithm solving generator estimation, and show that this task can be solved with precision independent of the spectral spacing. The guarantees are complemented by a Cramér--Rao analysis of a relaxation of the problem. In particular, in the case of unitary data with bounded additive noise with effective entrywise variance $σ^2$, we show that genESPRIT estimates the associated propagator matrix in Frobenius norm with precision scaling as $\tilde{\mathcal{O}}(σNL^{-\frac12})$ in the length of the time-series $L$ and matrix dimension $N$, matching the corresponding spectrum-independent Cramér--Rao standard deviation scaling up to logarithmic factors. We prove that the matching distance error in the spectrum estimated by genESPRIT scales as $\tilde{\mathcal{O}} (σ^2 N^3 L^{-1} + σN^{\frac32} L^{-\frac32} )$, which we compare to the lower bound on the corresponding Cramér--Rao bound with the asymptotic standard deviation scaling $\mathcal{O}(σL^{-\frac32})$. These guarantees provide the first rigorous bounds on solving the generator estimation problem. As the matrix exponential time-series can be obtained from linearly independent vector time-series by concatenation, this work opens up a new direction in spectral estimation, which circumvents the problem of crowded spectra, under the additional assumption of linear independence.

0.31