CS Paper Radar

Orbital Detection: On Maximum-Entropy Priors

Kuranage Roche Rayan Ranasinghe, Takumi Takahashi, Giuseppe Thadeu Freitas de Abreu

cs.IT ·submitted 2026-09-18 08:16 UTC · v1
theory

Abstract

Soft-input detection over a discrete constellation \(\mathcal{M}\) of cardinality \(M\) requires computing a posterior whose mean and mode are respectively given by the minimum mean square error (MMSE) and maximum a posteriori (MAP) estimates, both of which incur a computational cost of order \(\mathcal{O}(M)\) per symbol. We show that this cost is reduced to \(\mathcal{O}(L)\), where \(L \le M\) is the number of distinct amplitudes (rings), once the discrete prior is replaced by its maximum-entropy counterpart subject to the same radial marginal. This orbital prior, which is a mixture of uniform circular shells, is obtained by maximizing a mixed discrete-continuous entropy. We prove in this paper that such a distribution is the only distribution on \(\mathbb{C}\) that preserves the amplitude statistics of \(\mathcal{M}\) exactly while remaining maximally noncommittal in phase. Under the additive white Gaussian noise (AWGN) channel, the orbital prior induces a closed-form posterior that factors into a softmax over the \(L\) rings and a von Mises phase distribution whose concentration is supplied entirely by the observation, yielding closed-form orbital MMSE and MAP detectors of the discrete symbol at \(\mathcal{O}(L)\) cost. The resulting hierarchical rule selects the ring by posterior mass and the phase by conditional mode. We compare the pairwise ring boundary with that of the joint posterior-density and quantify the leading-order outward shift at high signal-to-noise ratio (SNR). Numerical results using standard constellations confirm that the orbital detectors maintain similar symbol error rate (SER) performance to optimal detectors, at a fraction of the complexity.

Comment
Submitted to an IEEE conference

Closest papers

Nearest neighbours by meaning across the whole index.

Orbital Detection

cs.IT ·2026-08-10 ·Kuranage Roche Rayan Ranasinghe, Giuseppe Thadeu Freitas de Abreu
similarity 0.76
Abstract · Submitted to an IEEE journal

We introduce orbital detection (OD), a framework for designing asymptotically optimal, low-complexity message passing (MP) receivers for digitally modulated multiple-input multiple-output (MIMO) systems, based on relaxing the discrete symbol prior into a mixed discrete-continuous density. The resulting orbital prior factors each symbol's distribution into a discrete radial component, supported on only the \(L << M\) amplitude rings of an arbitrary constellation \(\mathcal{M}\) of cardinality \(M = |\mathcal{M}|\), and a continuous, maximum-entropy phase density on each ring. This compresses the propagated posterior mean and variance losslessly into \(3L\) real scalars, and collapses the optimal \(\mathcal{O}(M)\)-complexity denoiser into a closed-form hierarchy whose per-symbol cost falls to \(\mathcal{O}(L)\) and ultimately \(\mathcal{O}(1)\): the orbital Bessel denoiser (OBD), its Bessel-free variant the orbital Gaussian denoiser (OGD), and the orbital phase denoiser (OPD), proved irreducible on the ring manifold. A Jacobi-Anger ladder recovers the exact detector with geometrically vanishing error. Five information-theoretic results follow. First, the OBD, OGD, and OPD share an identical leading-order state evolution (SE) fixed point. Second, the sole price is a change in the high-SNR error-decay law, from exponential to linear, which never hardens into an error floor. Third, for any underloaded system the induced rate loss vanishes exponentially in SNR, so every level is asymptotically capacity-achieving in the constellation-constrained sense, attaining \(\log_2 M\). Fourth, OD attains a minimum mean square error (MMSE) dimension \(d=1/2\), halfway between the \(d=0\) Bayes-optimal denoiser (BOD) and the \(d=1\) linear receiver. Fifth, a non-asymptotic optimal-transport bound in Wasserstein distance links constellation ring geometry directly to the achievable rate.

0.34

From Priors to Projections: Geometry and simplified MIMO demodulation of probabilistic shaping

cs.IT ·2026-09-11 ·Kirill Ivanov, Wei Yang, Mahmoud Taherzadeh Boroujeni, Jing Jiang
theory similarity 0.60
Abstract · Submitted to IEEE ICC

Probabilistic shaping (PS) is a well-known method to achieve improved performance upon a regular quadrature amplitude modulation (QAM) by taking the target constellation and making the distribution of underlying points non-uniform. It has been extensively studied over the years for the additive white Gaussian noise (AWGN) and Rayleigh fading channels. However, the potential of probabilistic shaping in the multiple-input and multiple-output (MIMO) setting needs further investigations. In this paper, we prove that if shaped symbols follow Maxwell-Boltzmann distribution, the optimal maximum a posteriori (MAP) detection is equivalent to the case of uniform constellation with a simple preprocessing step. Our approach has multiple benefits. It enables to utilize the same processing chain for both shaped and unshaped system, which simplifies the receiver architecture. This technique can be applied for both linear MMSE and nonlinear (near-)MAP demapper types. In addition, the complexity of adaptive methods such as sphere decoding can be reduced.

0.27

Optimal Min-Entropy Estimation with High Probability

cs.IT math.STquant-ph ·2026-11-17 ·Qisheng Wang
similarity 0.58
Abstract · 9 pages

Min-entropy plays a fundamental role in assessing the unpredictability of randomness sources. In particular, NIST SP 800-90B specifies min-entropy estimation as a key procedure for entropy sources used in cryptographic random bit generators, illustrating the practical importance of reliable min-entropy estimation. In this paper, we settle the sample complexity of min-entropy estimation with high probability in both the classical and quantum cases. Specifically, for min-entropy estimation with additive error $\varepsilon$ and probability at least $1-δ$, the sample complexity is $Θ(d\log(d/δ)/\varepsilon^2)$ for classical distributions on $d$ symbols and $Θ((d^2+d\log(1/δ))/\varepsilon^2)$ for quantum states on a $d$-dimensional Hilbert space. Our results admit short and simple proofs.

0.38

Soft GRAND under Channel Uncertainty: Minimax Posterior-Envelope Ordering and Gallager-Exponent Preservation

cs.IT ·2026-09-03 ·Behrooz Razeghi
similarity 0.57
Abstract

Soft Guessing Random Additive Noise Decoding queries corrections in an observation-dependent order. For a known channel, the matched order ranks corrections by nonincreasing conditional posterior probability. Under channel uncertainty, admissible channels may induce matched orders that assign different ranks to the same correction at the same observation. We instead use a posterior-envelope order, defined by the pointwise supremum of codebook-independent uniform-input correction posteriors. For fixed measurable posterior representatives and a measurable envelope, this order minimizes, at each observation, the worst-case logarithm of the rank--posterior product over admissible channel--correction pairs with positive posterior probability. For uniform-subset codebooks, this finite-block minimax property does not by itself determine the ensemble-average error exponent, which depends on the distribution of the realized correction rank. For i.i.d. correction--observation pairs with a finite correction alphabet whose joint distribution is dominated by the product of counting measure on that alphabet and a $σ$-finite measure on the observation space, Arimoto conditional Rényi entropy characterizes the matched rank-moment spectrum. An auxiliary posterior-envelope order preserves this spectrum on $[0,1]$ when its posterior family contains the corresponding conditional power tilts and has subexponential conditional Shtarkov complexity on observation sets whose complement probabilities decay exponentially faster than the reciprocal correction-space cardinality. Under additional differentiability and entropy nondegeneracy conditions, the auxiliary order attains the matched uniform-subset ensemble-average error exponent at every fixed normalized code rate strictly between zero and one. For uniform-input memoryless channels, this exponent equals Gallager's uniform-input random-coding exponent.

0.29

The Equality Cases of the Weak Simplex Conjecture

cs.IT ·2026-08-19 ·Mengwei Su, Kaiwen Yang, Hao Xu, Chih-Lin I
theory similarity 0.55
Abstract

Among $n+1$ equiprobable equal-energy signals in $\R^n$ under additive white Gaussian noise with maximum-likelihood decoding, which arrangement maximizes the probability of correct decoding? The question is Shannon's, recorded by Rice in 1950. Mulgund proved in 2026 that the regular-simplex value bounds the correct-decoding probability of every signal set at every signal-to-noise ratio, leaving open whether the simplex is the only maximizer. This paper determines the equality cases in a form stronger than uniqueness. A signal set other than a regular simplex falls strictly below the bound at every positive signal-to-noise ratio. Hence a code meeting the bound at one positive operating point is already a regular simplex, up to vertex relabeling and an orthogonal map. In probabilistic form, among the correlation matrices that signal sets induce, any matrix other than the identity gives a lower-orthant probability strictly above its independent counterpart at every finite threshold, leaving no room for a nontrivial equality. No code of ambient dimension below $n$ attains the bound. Under an energy budget $E$ with unrestricted blocklength the optimal codebook is uniquely the regular simplex of circumradius $\sqrt{E}$. Every optimal codeword therefore exhausts its allowance. Equality in the Simplex Mean Width Conjecture likewise occurs only at the regular simplex. The proof strengthens the first self-convolution step of Mulgund's argument with Royen's correlation theorem. The single-parameter rigidity is machine-checked in Lean 4.

0.46

Deterministic Smoothed MAP Detection for High-Dimensional MIMO Systems

cs.IT eess.SP ·2026-09-21 ·Vitor Tucci Ramos, Stephane Senecal, Sheng Yang
similarity 0.54
Abstract · 12 pages

We propose a deterministic smoothed maximum a posteriori (SMAP) framework for high-dimensional multiple-input multiple-output (MIMO) detection. The discrete constellation prior is approximated by an i.i.d. Gaussian mixture, yielding a differentiable MAP objective that retains the constellation structure while enabling continuous optimization. Unlike sampling-based approaches, SMAP formulates detection as a deterministic optimization problem and can be initialized by the output of an arbitrary detector, allowing it to operate either as a standalone detector or as a refinement stage. For hard detection, we introduce SMAP-KR, which complements the continuous solution with a local $K_R$-neighbor search evaluated according to the original maximum-likelihood metric. Annealed continuation improves robustness for higher-order constellations, while a two-neighbor approximation reduces the cost of evaluating the mixture prior. We further develop a soft-output SMAP method in which a local Gaussian approximation based on the curvature of the smoothed posterior provides symbol probabilities and bit log-likelihood ratios without posterior sampling or explicit counterhypothesis lists. Numerical results for critically loaded MU-MIMO systems show that SMAP-KR provides an increasingly favorable performance-complexity tradeoff as the system dimension grows and can also effectively refine the output of existing detectors. For coded transmission, soft SMAP provides substantial block-error-rate gains over both LMMSE- and K-best-based soft detection.

0.30

Fisher Information and Support Complexity of Gaussian Mixtures

cs.IT ·2026-10-15 ·Luca Barletta, Alex Dytso
theory similarity 0.54
Abstract · 24 pages, single-column

We study lower bounds on the Fisher information of Gaussian location mixtures and their applications to estimation problems. First, for a discrete mixing distribution, we derive a universal positive-semidefinite lower bound on the Fisher information matrix in terms of the Rényi entropy of order two. For a mixing distribution supported on $K$ points, this bound scales as $\log(K)/K^2$, improving by a logarithmic factor on the support-size dependence obtained from Stam's inequality. We then develop dimension-aware trace bounds using classical Sobolev inequalities. These bounds are expressed in terms of Sibson's $α$-mutual information and yield the scaling $K^{-2/n}$ in dimension $n$. A complementary bound involving the $α$-mutual information of order $1/2$ is obtained using the sharp Young convolution inequality. The derived inequalities are further specialized to rotationally invariant mixing distributions supported on discrete spherical shells. In this setting, an intrinsic-dimensional bound on Sibson mutual information leads to lower bounds on the Fisher information in terms of the number of occupied shells. As applications, we study least favorable priors for bounded Gaussian mean estimation. In the scalar case, we show that the least favorable prior on $[-R,R]$ has at least $Ω(R\sqrt{\log R})$ support points and that each of its probability masses is of order at most $1/R$. In the vector case, we show that the number of occupied shells grows at least linearly with $R$. Finally, Brown's identity and the I-MMSE relationship are used to translate the Fisher-information inequalities into upper bounds on the MMSE and mutual information.

0.28

Maximum Entropy Encoding of Energy-Weighted Spherical Moments

cs.GR cs.CV ·2026-08-20 ·Jiaze Sun
unusual similarity 0.54
Abstract · 23 pages, 12 figures, 5 tables

We study how angular energy signals composed of non-negative Monte Carlo path samples can be compressed and reconstructed for irradiance using finite moments. Writing each sample as an energy-weighted directional feature $x = r u$, we adopt total energy, the first directional moment, and the traceless second moment as $1+3+5$ linearly additive, rotationally covariant statistics. Under a fixed Lebesgue reference measure, the maximum-entropy closure yields $p(r,u) \propto \exp(-βr g(u))$, where $g(u) = 1 - b \cdot u + u^T Q u$, whose directional probability and angular energy density are proportional to $g^{-3}$ and $g^{-4}$, respectively. When $g_{\min} > 0$ the closure is normalizable and the reconstruction is strictly positive. We further provide analytic moment matching, variance, inverse sampling, and closed-form diffuse response for the pure-dipole four-parameter subfamily, as well as the realizability domain, partition function, azimuthal algebraic integral, and LUT-oriented reconstruction form for the dipole-second-moment coaxial five-parameter subfamily. Experiments cover 981 Poly Haven HDRI 2K scenes and three Debevec probes. Five-parameter MaxEnt achieves a 78.7% per-scene win rate against stored QZH, with mean luminance RMSE reduced by 15.8%; the advantage is more pronounced in scenes with strong directionality. Both MaxEnt variants maintain zero negative irradiance across all scenes. Full second-order SH-2 yields the lowest overall error, while five-parameter MaxEnt ranks second and outperforms SH-2 in the high-directionality bucket; the coaxial subfamily shows systematic closure error on non-coaxial multi-source scenes.

0.32