CS Paper Radar

Fisher Information and the Minimum Mean-Square Error for Locating Closely Spaced Point Sources

Chuling Wen, Jian Lu, Qingtang Jiang, Charles K. Chui

cs.IT ·submitted 2026-10-23 00:37 UTC · v1
theory

Abstract

We determine the optimal average error of locating closely spaced sources from noisy superpositions of a known smooth response with unknown complex coefficients. Relative phases control how changes in one location can be offset by the other unknowns, so local Fisher information alone does not determine the attainable error. For every fixed number $K\ge2$ of sources with independent uniform phases, we prove matching Bayes risk bounds jointly in separation and noise, for all sufficiently small separations and all noise levels. Odd source counts have two risk regimes; even counts have an intermediate regime in which mean squared error is linear in the noise standard deviation. A projected least-squares estimator attains these orders without knowing the phases or the prior density. Bounded nonuniform phase laws preserve the orders under stated support conditions, whereas priors concentrated near poorly identified configurations can change the exponents. A common finite comparison yields both a global inverse bound and paths controlled by the original prior. These give sufficient conditions under which the risk has the order of the pointwise capped Cramér--Rao bound, and a lower-tail calculation explains the power and logarithmic regimes. We also give conditional guarantees when the cluster center, separation, and source count are unknown, with an additional low-noise requirement for count selection. A calibrated covariance factor model illustrates the same criterion beyond source localization.

Closest papers

Nearest neighbours by meaning across the whole index.

Minimax-Optimal Robust Identification of Continuous-Time Systems: Handling Narrow-Band Disturbances in the Frequency Domain

eess.SY math.ST ·2026-09-20 ·Jonas Gillberg, Fredrik Gustafsson
similarity 0.58
Abstract · 17 pages, 13 figures

The high-frequency spectral roll-off of continuous-time ARMA (CARMA) models can magnify the effect of narrow-band disturbances when aliasing is weak, making standard maximum-likelihood Whittle estimation sensitive to affected ordinates. We show that a logarithmic transformation $r_k = \log ρ_k$ converts the Whittle scale problem into a Gumbel location problem, connecting robust spectral estimation to the classical minimax theory of Huber and Rieder. A piecewise centering correction---closed-form for small $b$, implicit closed-form for the practitioner range---preserves Fisher consistency for any clipping level without numerical optimisation. Clipping the Gumbel score symmetrically and transforming back yields a two-sided clipped Gumbel score (the standard Rieder--Hampel bounded-influence form) whose normalised influence curve is proved locally asymptotically minimax under shrinking gross-error contamination. The efficiency loss is quantified by a single scalar $K(b)$: at $b = 1.5$, only $16\%$ nominal asymptotic variance overhead. In the stated AR(2) Monte Carlo design, the sample-size trends are compatible with the asymptotic rate, and at $b=1.5$ the bias reductions are about $40\%$, $90\%$, and $96\%$ for $a_1$, $a_2$, and $λ$, respectively.

0.26

The Loss Floor of Denoising Score Matching: Fisher Geometry from Schrödinger Bridges

cs.LG cond-mat.stat-mech ·2026-08-24 ·Avinash Raju, Kai Zhang
similarity 0.57
Abstract · 28 pages, 4 figures

Denoising score matching trains diffusion models by regressing onto a conditional score, although generation ultimately requires the marginal score. The two objectives share the same population minimizer, but the conditional target remains random at fixed noisy state and introduces an irreducible excess in the training loss. We isolate this excess and show that, for a general corruption kernel under mild regularity assumptions, it is exactly the trace of the Fisher--Rao metric of the conditional endpoint family, integrated along the diffusion trajectory. This gives an exact conditional-variance decomposition of the denoising objective and identifies the information geometry observed in diffusion latent spaces as an intrinsic component of the training loss. We derive the result from a Schr"odinger bridge variational principle, in which the ideal objective arises as excess path-space relative entropy. For corruption diffusions, the Fisher term is proportional to the rate at which the noisy state loses mutual information about the clean data, separating the loss floor into an information flow determined by the data and a weight determined by the corruption schedule and objective. In the Gaussian case, this yields a closed form for the floor, recovers reparametrization invariance of the continuous-time objective, and relates its high-SNR divergence to the information dimension of the data. Finally, we show that raw losses obtained with different noise ranges or weightings need not rank models consistently because they contain different additive floors, and contrast the second-order geometry seen by training with the third-order conditional statistics entering numerical sampling error.

0.25

Separation Is a Riesz Energy: How Many Environments Does ICA Need?

cs.LG cs.ITstat.ML ·2026-11-04 ·Yuda Bi, Yubo Guo, Jiaxiao Cai, Xiaonai Li, Zhuolin Li +1 more
theory similarity 0.57
Abstract

How many environments and samples does it take to separate $d$ Gaussian sources whose variances change across environments? Each source has a signature, its vector of variances. The Riesz $2$-energy $E_j$ of source $j$ sums the inverse Fisher informations for rotating it towards other sources. With known whitening, we prove a worst-case squared-angle risk lower bound of order $E_j/(n+E_j)$ for orthogonal estimators at every $n$ and $d$. A quadratic pencil given the signatures attains $E_j/n$ up to a constant above a separation-dependent sample threshold, even with estimated whitening. For well-spread signatures at fixed $K$, the energy grows as $d^2$, $d\log d$ and $d$ for $K=2$, $3$ and $K\ge4$, respectively. A design with $K\asymp\log d$ and pairwise Fisher information bounded below by a constant makes $d\log d$ samples sufficient. The eigenvectors of a single fixed linear combination have an average first-order error coefficient of at least order $d^2$. Simulations up to $d=1000$ support the first-order predictions, and on task fMRI the energy helps rank split-half instability.

0.28

Global minimax risk and acquisition laws for heterogeneous information fusion

eess.SP math.ST ·2026-09-06 ·Armon Rasooli, Mohammad Sadegh Narimani
theory similarity 0.57
Abstract

We prove an all-allocation global target-risk theorem for independent Gaussian sources that share a scalar nuisance and an unknown contact coordinate. For a fixed immersed nuisance curve with finitely many multiple fibres and pairwise nonparallel branch tangents, squared target risk is comparable to a primary estimation floor plus a target-gap-weighted Gaussian discrimination profile. Independent localization, finite branch selection and target-class refitting give an estimator attaining this comparison across every nonnegative integer allocation. A full-box specialization has positive-definite primary Fisher information everywhere and globally identifies its target, yet models with identical derivatives of every order along a critical hypersurface have different polynomial risk exponents. We construct a finite certified estimator and quantify the numerical accuracy needed to preserve rare branch decisions and acquisition windows. A polynomial tangency family both demonstrates the geometric boundary and quantifies its repair: known auxiliary gain, source contact order and target vanishing order determine a risk law uniform through zero gain. For a shared spherical direction, a separately proved composite-testing result transfers through an unknown contact coordinate using only counted observations. These theorems distinguish the resources needed for local estimation, discrimination between parameter regions and nuisance alignment, and yield acquisition thresholds under explicit scalar-observation costs.

0.32

Phase Transitions in Heavy-Tailed Mean Estimation under $\ell_p$ Norms

cs.LG math.ST ·2026-11-15 ·Ishaq Aden-Ali, Yeshwanth Cherapanamjeri, Mikael Møller Høgsgaard, Kasper Green Larsen, Nikita Zhivotovskiy
top venuebenchmarktheory similarity 0.56
Abstract · Accepted at NeurIPS 2026

We study the problem of estimating the mean of a random vector in $\mathbb R^d$ under $\ell_p$ norms, assuming only the existence of a covariance matrix. In the Euclidean norm, the sample mean is already optimal in expectation, and robust estimators are usually needed only to obtain high-probability tails. Our results show that this picture changes for $\ell_p$ norms with $p>2$: robustification is already necessary even for the expected risk. We prove that the minimax risk exhibits a sharp phase transition, controlled by the interaction between the sample size $n$, the dimension $d$, and the norm parameter $p$. In the large-sample regime, the classical Gaussian rate remains achievable. In the complementary regime, heavy-tailed distributions create a genuinely non-Gaussian obstruction. Furthermore we show that the simple estimator: coordinate-wise median of means whose number of buckets chosen according to the geometry of the loss, optimally tracks this phase transition in its expected risk minimax. We also show that natural projection-based median-of-means estimators for general norms, despite achieving the optimal confidence trade-off relative to the sample-mean benchmark of Lugosi and Mendelson (Probab. Theory Relat. Fields, 2019), can be polynomially suboptimal for $\ell_p$ norms even in the constant-probability regime.

0.38

Deterministic Cramer-Rao Bounds for Coherent Direction-of-Arrival Estimation: Rank Information Versus Coherence Structure

eess.SP ·2026-08-23 ·Weichao Zheng, Zai Yang
benchmark similarity 0.56
Abstract

Direction-of-arrival (DOA) estimation is a fundamental problem in array signal processing, for which the Cramer-Rao bound (CRB) serves as a standard performance benchmark under both stochastic and deterministic source models. In multipath environments, the source matrix is of low-rank and, more specifically, exhibits a within-group proportionality structure. Although stochastic CRBs for coherent DOA estimation have been studied, theoretical results for their deterministic counterparts remain limited. This paper aims to bridge this gap. We first derive a tangent-space condition characterizing when structural constraints on the source matrix can strictly reduce the frequency CRB. We then prove that, for uniform linear arrays, imposing only the low-rankness of the source matrix leaves the frequency CRB unchanged, although it reduces the source-matrix CRB whenever the rank constraint is nontrivial, whereas fully exploiting the coherence structure yields a strictly smaller frequency CRB for almost all parameter values under mild conditions. These conclusions are further extended to analytic array manifolds and multidimensional DOA models, with componentwise results established for uniform planar arrays. The results demonstrate that performance gains in DOA estimation arise from the detailed coherence structure rather than low-rankness alone. Numerical experiments are finally provided to validate the theoretical findings.

0.16

Distributed Blind Source Separation from Compressed Mixtures

eess.SP ·2026-11-17 ·Amir Weiss
benchmarktheory similarity 0.56
Abstract

Blind source separation (BSS) is increasingly needed in sensing architectures where mixtures are acquired by multiple remote devices but the inference itself is carried out centrally. In such systems, the sensors often cannot transmit their raw observations since the communication links are rate-limited, energy-limited, or both. The fusion center therefore must recover the latent sources from compressed versions of the mixtures. This setting raises questions that classical BSS models do not address directly: whether source identifiability survives compression, how separation accuracy changes under a specified compression model, and how the separation procedure should be modified to account for the statistical model induced by the compression stage. In this work, we develop a framework for distributed BSS from compressed mixtures that addresses these issues at three levels. First, we formalize identifiability under compression and establish a data-processing viewpoint showing that compression cannot introduce distinguishability that is absent before compression. Second, for mixtures of Gaussian sources with general covariance structures, we derive an idealized Gaussian rate-distortion-based Cramér-Rao lower bound benchmark for the interference-to-source ratio. Third, we develop practical compression-aware separation schemes based on subtractively dithered quantization together with debiasing at the fusion center for both fourth-order-cumulant-based and second-order-statistics-based methods. Simulation experiments demonstrate the resulting tradeoffs between communication rate and separation performance and the gains obtained by compression-aware separation in representative distributed sensing scenarios.

0.26

Adaptive Robust Confidence Sets in High Dimensions

cs.DS math.STcs.LGstat.ME+1 ·2026-10-11 ·Ilias Diakonikolas, Chao Gao, Daniel M. Kane, Yuetian Luo
theory similarity 0.56
Abstract

We study adaptive confidence sets for mean vectors of multivariate Gaussians with identity covariance under Huber contamination when the contamination proportion is unknown. We show that an information-theoretically optimal adaptive confidence set can be constructed by simultaneously quantifying uncertainty across all one-dimensional projections. The resulting confidence set achieves the optimal diameter and reveals a substantial adaptation cost compared with the minimax estimation error. Although statistically optimal, this construction is computationally infeasible. We establish a Statistical Query (SQ) lower bound showing that achieving diameter $O(m^{-1/2})$ requires either exponentially many queries or query tolerance $d^{-Ω(m)}$. Thus, in contrast to robust mean estimation, adaptation to the unknown contamination proportion incurs both a statistical cost and a computational barrier within the SQ framework. Finally, we give a low-degree moment-matching algorithm that constructs an adaptive confidence set using $d^{O(m)}$ samples and time. Its diameter bound contains an additional $O(m^{-1/2})$ term beyond the information-theoretic rate, matching the dependence on $m$ in the SQ lower bound. Together, these results characterize the statistical limits of adaptive robust confidence sets under Huber contamination and quantify a computational barrier within the SQ framework.

0.36