CS Paper Radar

Zero-SNR Analyticity of the Scalar MMSE Is Equivalent to Gaussianity

Yixing Zhang

cs.IT cs.LG ·submitted 2026-09-14 05:07 UTC · v1
theoryunusual

Abstract

Let $Y_s=\sqrt{s}X+Z$, where $Z$ is standard Gaussian and independent of the real random variable $X$. We prove that, under the square-exponential moment condition $\mathbb{E}e^{βX^2}<\infty$ for some $β>0$, the scalar minimum mean-square error $\operatorname{mmse}_X(s)$ is analytic at zero signal-to-noise ratio if and only if $X$ is Gaussian, with constant random variables included as degenerate Gaussians. The proof converts estimation in the Gaussian channel into a backward heat flow acting on the moment-generating function $M(z)=\mathbb{E}e^{zX}$. Under the stated tail condition, every non-Gaussian input forces $M$ to have a nonzero complex zero. We show that each zero cluster produces a finite singularity in its localized Borel transform at the action $ξ=z_0^2/2$. After removing the action scale, the Borel coefficients have a nonzero $n^{-1/2}$ prefactor for a simple zero. A zero of multiplicity $m\geq 2$ splits according to the roots of a Hermite polynomial and instead contributes a prefactor $n^{-m/2}e^{r_m\sqrt{2n}}$. A finite-disc localization and relative-cycle continuation argument then show that at least one such singularity survives in the full Borel transform. Thus, for every non-Gaussian input in the stated class, the formal zero-SNR expansion is Gevrey-1 but divergent. Rational-MMSE rigidity and the analogous analyticity criterion for mutual information follow as corollaries.

Comment
33 pages, 1 figure

Closest papers

Nearest neighbours by meaning across the whole index.

Polynomial-Time MIMO Detection at the Maximum-Likelihood Threshold

cs.IT ·2026-09-16 ·Dimitris Papailiopoulos
theory similarity 0.54
Abstract · 51 pages

We prove that exact block recovery in the square Gaussian binary MIMO model can be achieved in polynomial time at the same first-order SNR threshold as exhaustive maximum-likelihood detection. Specifically, for $y=\sqrt{ρ/N}Hx^\star+w, \; x^\star\in\{\pm1\}^N,$ and independent standard Gaussian $H\in\mathbb R^{N\times N}$ and $w$, rounded linear MMSE followed by steepest single-bit descent recovers $x^\star$ with failure probability tending to zero, uniformly over every transmitted word and every $ρ\ge2\log N$, using $O(N^3)$ unit-cost exact-real arithmetic operations. The model is a special case of Gaussian random linear estimation, for which AMP state evolution and replica/MMSE formulas rigorously characterize fixed-parameter normalized performance. Those results predict the same $2\log N$ scale, but do not by themselves yield an all-coordinate guarantee in the dimension-dependent regime considered here. To the best of our knowledge, no prior work gives polynomial-time exact block recovery at the ML boundary for this setting; the closest prior square-system theorem, for the box relaxation, has first-order threshold $4\log N$. The proof places the rounded LMMSE estimate at sublinear Hamming distance from the truth, and then establishes, uniformly over every error set the local search can visit, that some wrong bit offers a quantified cost decrease while an objective barrier confines the search path. Conversely, if $0<ρ\le2\log N-\log\log N-s_N$ with $s_N\to\infty$ and $s_N=o(\log N)$, then a one-bit neighbor beats the transmitted word with probability tending to one, so even ML detection fails. Therefore, the statistical and polynomial-time exact-recovery thresholds coincide to first order in the stated arithmetic model.

0.20

Universality of approximate message passing under a fourth-moment tail condition

cs.IT math.PRmath.ST ·2026-10-20 ·Ripunjay Dwivedi, Taejoon Kim
theory similarity 0.53
Abstract · 35 pages, no figures

We prove state evolution for approximate message passing (AMP) with rectangular random matrices whose entries are independent, centered, and variance-normalized. The row and column dimensions grow with a ratio that converges to a positive finite limit. The entry laws may differ across coordinates and dimensions, and we assume uniform integrability of the fourth powers of the rescaled entries. For entries sampled independently from a fixed law, a finite fourth moment suffices, with no requirement for higher moments. The nonlinearities are continuously differentiable and globally Lipschitz, with bounded continuous first state derivatives. The signal and noise have independent and identically distributed coordinates with finite moments of all orders, and are independent of each other and of the matrix. At every fixed number of iterations, empirical averages of pseudo-Lipschitz functions of order two converge in probability to the limits specified by Gaussian state evolution. These averages include empirical second moments and products of trajectory coordinates. The proof combines an aggregate bound on third derivatives with randomized Lindeberg replacement and operator-norm truncation, without matching third moments or invoking a non-Gaussian universality theorem. We also show that independence of complementary projected components for every deterministic rank-one constraint pair characterizes Gaussian entries. This identifies the limitation of extending Gaussian conditioning identities to independent non-Gaussian matrices. Finally, a variance-profile example shows that average variance normalization alone does not ensure the homogeneous state evolution limits.

0.24

On the State Evolution of Approximate Message Passing with Discontinuous Denoisers

cs.IT ·2026-10-06 ·Kuranage Roche Rayan Ranasinghe, Takumi Takahashi, Giuseppe Thadeu Freitas de Abreu
theory similarity 0.51
Abstract · Submitted to an IEEE conference

We consider approximate message passing (AMP) with discontinuous denoisers, such as hard slicers, quantizers and hard thresholding, for which the classical state evolution (SE) analysis does not apply. It is first shown that the standard Onsager coefficient; i.e., the average pointwise derivative of the denoiser, misses a boundary term, namely, the sum over the jumps of the jump size times the density of the denoiser input at the jump. Then, for real independent and identically distributed (i.i.d.) Gaussian matrices, a positive noise variance, a fixed number of iterations and a prior with finite second moment, we transfer the Lipschitz SE theorem directly to denoisers, fixed in advance, that are continuously differentiable with bounded derivative except at finitely many jumps, by bounding the distance between the iterates of AMP and of AMP on Lipschitz ramps of the denoisers through the fraction of inputs that cross a jump. It is thereby proven that AMP follows SE, also for test functions such as symbol errors, if its Onsager coefficient contains the boundary term, evaluated either along SE or, as we propose, at the noise level estimated from the residual, with the density computed from the known prior. Simulation results with 4- and 8-level pulse amplitude modulation (PAM) demonstrate that AMP with a hard slicer, whose standard coefficient is identically zero, fails with this coefficient, while with the proposed one, it follows SE and comes close to Bayes-optimal AMP.

0.24

A Poisson Transition and Bias Law for KSG Mutual-Information Estimation

cs.IT ·2026-10-27 ·Abhiram Gorle, Tsachy Weissman
theory similarity 0.51
Abstract

We quantify the error of the strict-radius Kraskov--Stögbauer--Grassberger (KSG-1) mutual-information estimator on a Gaussian channel as the sample size \(n\) grows and the channel becomes nearly deterministic. For fixed dimension \(p\) and neighbor index \(k\), we define the resolution parameter \(u_n=ne^{-I_n}\), where \(I_n\) is the true mutual information in nats. When \(u_n\to u\in(0,\infty)\), we prove that the estimation error converges in mean square to a computable deterministic bias \(B_{p,k}(u)\). Sampling fluctuations therefore vanish, while an additive bias can persist. We derive this bias from an explicit marked-Poisson law for the neighborhood counts, characterize its small-\(u\) asymptotics, and show that it tends to zero as \(u\to\infty\). The same law describes how often neighborhoods saturate, meaning that they make the largest possible contribution to the estimate. The limiting saturation probability decreases continuously and strictly from one to zero, allowing a Gaussian-model bias correction on fixed critical intervals. Finite-sample experiments show substantial bias even when the true information lies below the estimator's logarithmic ceiling and saturated neighborhoods are rare. Saturation-based correction reduces estimation error in these experiments, though recovering the resolution parameter from the observed saturation fraction can remain difficult when saturation is rare.

0.23

Zeros of the Spectrogram of White Noise with Hermite Windows

eess.SP math.PR ·2026-10-09 ·Charaf Bellourak, Sylvain Meignen, Kévin Polisano, Mickaël Nahon
theory similarity 0.51
Abstract

We study the zeros of the spectrogram of complex white noise analyzed with Hermite windows of order n, extending the classical Gaussian-window correspondence with Gaussian Analytic Functions to the polyanalytic setting. Using the polyanalytic Bargmann transform, these zeros split into two families according to the sign of the local Jacobian, giving rise to a natural notion of charge, and we show that these zeros are almost surely simple, isolated, and form a translation and rotation-invariant point process. We derive closed-form expressions for the one-point intensity, decomposed by charge, and also for the unsigned, signed, and hybrid two-point intensities. Besides, we prove that unlike the total repulsion observed with a Gaussian window, the Hermite window of order n generates a pair correlation function that converges at the origin to a strictly positive constant depending on n. Finally, we propose a numerical method for detecting spectrogram zeros via the winding number around candidate local minima.

0.22

Generalized Splines and Gaussian Processes

cs.LG math.STmath.FAstat.ML ·2026-08-28 ·Michael Unser
similarity 0.51
Abstract

For finite-dimensional linear inverse problems where the variables are Gaussian, it is well-known that the minimum-mean-square error estimator takes the form of a regularized least-squares data fit. In this chapter, we show that this equivalence extends to a much broader infinite-dimensional setting where generalized splines take the role of linear regressors and generalized Gaussian processes on a nuclear space $S$ are the counterpart of Gaussian random vectors. The scope of this extension is of the same nature as the switch from the classic notion of function to that of a distribution, also known as a "generalized function." Our formalism involves a whitening/regularization operator $L: S\to S'$ whose continuous extension induces a native Hilbert space $H\subset S'$ that plays a central role in our characterization. The presentation is self-contained for the most part and remarkably general and powerful. It allows for the recovery of all known instances of such equivalences; in particular, the methods involving innovations and reproducing-kernel Hilbert spaces developed by Kailath and his students, and the mathematical correspondence between fractional splines and Mandelbrot's fractional Brownian motion (fractals), with the former being the optimal estimators of the latter. It also covers general Bayesian methods for the resolution of infinite-dimensional inverse problems.

0.25

On the parametric and semiparametric Fisher information matrix for non-zero mean stationary spherical invariant random processes

eess.SP math.ST ·2026-09-17 ·Jean-Pierre Delmas, Habti Abeida, Stefano Fortunati
similarity 0.50
Abstract · a main file (with 4 figures) and supplementary materials

The classical Whittle formula provides a closed-form expression for the asymptotic Fisher information matrix (FIM) rate of multidimensional, real-valued, zero-mean, purely nondeterministic stationary Gaussian processes (GPs), expressed in terms of their parameterized spectra within a maximum-likelihood framework. However, the Gaussian assumption underlying this result restricts its applicability to many real-world signals exhibiting heavy-tailed or non-Gaussian behavior. In this paper, we extend Whittle's result to multidimensional, real-valued stationary compound Gaussian processes (CGPs) with arbitrary mean, under a unified framework encompassing fully known, parameterized, and completely unknown density generators. Building upon the Slepian-Bangs formula for $n$ consecutive observations and extending it to the semiparametric setting, we leverage the asymptotic properties of block Toeplitz matrices to obtain a closed-form spectral-domain expression for the asymptotic FIM rate. The resulting expression, common to all density generator families, generalizes the standard zero-mean Gaussian formula by incorporating a distribution-dependent contribution associated with the nonzero mean, and an additional covariance term that is invariant to the choice of non-Gaussian distribution. This extension enables efficient and theoretically grounded performance analysis for heavy-tailed signal processing applications.

0.40

Central limit theorem in Rényi divergence for lattice random variables

cs.IT math.PR ·2026-08-17 ·Zhen Fu, Jiange Li
theory similarity 0.50
Abstract · Added the infinite order Rényi entropic CLT

Let $\{X_i\}_{i=1}^n$ be independent, identically distributed lattice random variables with zero mean, unit variance, and maximal span $h>0$. Let $S_n=(X_1+\cdots+X_n)/\sqrt n$. Let $Z_n$ denote the quantization of a standard Gaussian random variable on the support lattice of $S_n$. We show that the Rényi divergence $D_α(S_n\|Z_n)$ of order $1<α<\infty$ tends to 0 as $n\to\infty$ if and only if $D_α(S_{n_0}\| Z_{n_0})<\infty$ for some integer $n_0$ and a sub-Gaussian condition holds. Furthermore, we derive an Edgeworth-type asymptotic expansion of the divergence to arbitrary order. We also show that the Rényi divergence $D_\infty(S_n\|Z_n)$ of infinite order tends to 0 as $n\to\infty$ if and only if a sub-Gaussian condition, a curvature condition, and a uniform separation condition hold. These results constitute lattice counterparts of Rényi entropic central limit theorems for continuous random variables obtained by Bobkov, Chistyakov and Götze (\emph{Ann. Probab.} \textbf{47} (2019), 270--323) and Bobkov and Götze (\emph{Ann. Probab.} \textbf{53} (2025), 453--477). Uniform separation is an additional assumption beyond the sub-Gaussian and curvature conditions used in the continuous setting. The failure of uniform separation may cause an exponentially tilted version of $X_1$ to concentrate on a sublattice of max span $kh$ for some integer $k>1$, which yields the lower bound $D_\infty(S_n\|Z_n)\ge\log k$, and hence a failure of the entropic central limit theorem.

0.30