CS Paper Radar

Maximum Entropy Encoding of Energy-Weighted Spherical Moments

Jiaze Sun

cs.GR cs.CV ·submitted 2026-08-20 00:58 UTC · v1
unusual

Abstract

We study how angular energy signals composed of non-negative Monte Carlo path samples can be compressed and reconstructed for irradiance using finite moments. Writing each sample as an energy-weighted directional feature $x = r u$, we adopt total energy, the first directional moment, and the traceless second moment as $1+3+5$ linearly additive, rotationally covariant statistics. Under a fixed Lebesgue reference measure, the maximum-entropy closure yields $p(r,u) \propto \exp(-βr g(u))$, where $g(u) = 1 - b \cdot u + u^T Q u$, whose directional probability and angular energy density are proportional to $g^{-3}$ and $g^{-4}$, respectively. When $g_{\min} > 0$ the closure is normalizable and the reconstruction is strictly positive. We further provide analytic moment matching, variance, inverse sampling, and closed-form diffuse response for the pure-dipole four-parameter subfamily, as well as the realizability domain, partition function, azimuthal algebraic integral, and LUT-oriented reconstruction form for the dipole-second-moment coaxial five-parameter subfamily. Experiments cover 981 Poly Haven HDRI 2K scenes and three Debevec probes. Five-parameter MaxEnt achieves a 78.7% per-scene win rate against stored QZH, with mean luminance RMSE reduced by 15.8%; the advantage is more pronounced in scenes with strong directionality. Both MaxEnt variants maintain zero negative irradiance across all scenes. Full second-order SH-2 yields the lowest overall error, while five-parameter MaxEnt ranks second and outperforms SH-2 in the high-directionality bucket; the coaxial subfamily shows systematic closure error on non-coaxial multi-source scenes.

Comment
23 pages, 12 figures, 5 tables

Closest papers

Nearest neighbours by meaning across the whole index.

A Note on Scaling in Randomly Rotated Quantization and Its Connection to the CDEF +1 Pythagorean Relation

cs.IT cs.LG ·2026-09-08 ·Uri Erez
similarity 0.56
Abstract

Quantization schemes based on randomized rotations have recently received renewed attention, including the roles of MMSE and unbiased reconstruction scalings. In this note, we point out the connection to classical results in statistical signal processing and communication theory. Specifically, the two reconstruction scales used in the EDEN line of work admit a natural interpretation as finite-dimensional, realization-dependent counterparts of the Wiener and unbiased coefficients in the classical CDEF formulation. At finite blocklength, the CDEF +1 relation holds pointwise for each rotation realization as an exact geometric (Pythagorean) identity, but does not hold after averaging the distortions over the rotation. The classical SNR relation $\sf{SNR}_{\rm MMSE}=\sf{SNR}_{\rm MMSE,U}+1$ is recovered as $d\to\infty$: once the overall scale is handled separately, the empirical coordinate statistics of a randomly rotated vector approach their i.i.d. Gaussian counterparts, and the rotation-dependent quantities concentrate. Importantly, EDEN goes beyond this classical correspondence: for every finite $d$, its Haar-rotation formulation guarantees exact conditional unbiasedness, a stronger property than the second-order notion of unbiasedness in CDEF. We further comment on two distinct roles random rotations play in quantization: one is approximate Gaussianization of the coordinates; the other is decorrelation of reconstruction errors across quantization branches.

0.23

Orbital Detection: On Maximum-Entropy Priors

cs.IT ·2026-09-18 ·Kuranage Roche Rayan Ranasinghe, Takumi Takahashi, Giuseppe Thadeu Freitas de Abreu
theory similarity 0.54
Abstract · Submitted to an IEEE conference

Soft-input detection over a discrete constellation \(\mathcal{M}\) of cardinality \(M\) requires computing a posterior whose mean and mode are respectively given by the minimum mean square error (MMSE) and maximum a posteriori (MAP) estimates, both of which incur a computational cost of order \(\mathcal{O}(M)\) per symbol. We show that this cost is reduced to \(\mathcal{O}(L)\), where \(L \le M\) is the number of distinct amplitudes (rings), once the discrete prior is replaced by its maximum-entropy counterpart subject to the same radial marginal. This orbital prior, which is a mixture of uniform circular shells, is obtained by maximizing a mixed discrete-continuous entropy. We prove in this paper that such a distribution is the only distribution on \(\mathbb{C}\) that preserves the amplitude statistics of \(\mathcal{M}\) exactly while remaining maximally noncommittal in phase. Under the additive white Gaussian noise (AWGN) channel, the orbital prior induces a closed-form posterior that factors into a softmax over the \(L\) rings and a von Mises phase distribution whose concentration is supplied entirely by the observation, yielding closed-form orbital MMSE and MAP detectors of the discrete symbol at \(\mathcal{O}(L)\) cost. The resulting hierarchical rule selects the ring by posterior mass and the phase by conditional mode. We compare the pairwise ring boundary with that of the joint posterior-density and quantify the leading-order outward shift at high signal-to-noise ratio (SNR). Numerical results using standard constellations confirm that the orbital detectors maintain similar symbol error rate (SER) performance to optimal detectors, at a fraction of the complexity.

0.10

On Minimum Divergence for Distribution Reconstruction

cs.IT math.ST ·2026-10-15 ·Justin Bec, Thomas Le Corre, Aurélien Garivier
similarity 0.53
Abstract

We study the possibility of generalizing maximum-entropy reconstruction, which approximately recovers a probability distribution from finitely many (generalized) moments by minimizing the Kullback--Leibler (KL) divergence to a reference measure. The reconstruction lies in an exponential family and is also the best KL approximation of the unknown distribution within that family: moment matching and information projection coincide. Replacing KL by a smooth f-divergence, the reconstruction still exists in an associated family, but the best approximation property does not. Specifically, a family is called entropy-adapted if the projection of any distribution matches its moments. We show that, up to equivalence, KL is the only $C^2$ f-divergence that is entropy-adapted, whatever the choice of the generalized moments. We illustrate the consequences of this failure numerically.

0.22

Geometry-Aware Score-Repellent Monte Carlo

cs.LG stat.ML ·2026-11-06 ·Jie Hu, Lingyun Chen, Do Young Eun
top venuetheory similarity 0.52
Abstract · To appear at NeurIPS 2026

The recently proposed Score-Repellent Monte Carlo (SRMC) method improves MCMC sampling by tilting the target density $π$ in $\mathbb{R}^d$ with the factor $\exp(-α\,θ_n^\top s(x))$, where the score function $s(x) = \nabla_x \log π(x)$, and $θ_n$ is the score average from past samples. However, a single scalar repellence strength $α\ge0$ cannot handle both the steep and the flat directions in anisotropic energy landscapes at once. We introduce \emph{Geometry-Aware SRMC} (GA-SRMC), which generalizes the Euclidean alignment to $θ^\top M s(x)$ for any symmetric positive-definite matrix $M$. A stochastic-approximation central limit theorem under a trace constraint on $M$ identifies the trace-normalized inverse Fisher $M_{\rm opt}\propto S^{-1}$ as the unique minimizer of the worst-direction covariance bound, elevating the Fisher information $S=\text{Cov}_π(s,s)$ from a proposal-side preconditioner (e.g., FisherMALA, natural gradient) to the bound-optimal repulsion-side matrix, with a single online estimate $\widehat S_n$ serving both roles at no additional computational cost. The full-Fisher online metric $M_n$ converges almost surely to $M_{\rm opt}$ and satisfies a CLT, providing a theoretical guarantee for the online implementation of the GA-SRMC framework. On an $8$-target simulation spanning the condition number $κ\in[1.3,100]$ and dimension $d\in[2,785]$, GA-SRMC dominates SRMC in ESS by $\boldsymbol{4.3\times}$ on anisotropic Gaussian ($κ=100$) and $\boldsymbol{6.8\times}$ on MNIST under the MALA baseline, by $\boldsymbol{16\text{--}32\%}$ on three well-conditioned logistic-regression posteriors, and by up to $\boldsymbol{+48\%}$ under FisherMALA; gains peak on the most anisotropic targets, and posterior-mean MSE is lower than with SRMC in all $16$ full-Fisher implementations.

0.33

On the parametric and semiparametric Fisher information matrix for non-zero mean stationary spherical invariant random processes

eess.SP math.ST ·2026-09-17 ·Jean-Pierre Delmas, Habti Abeida, Stefano Fortunati
similarity 0.51
Abstract · a main file (with 4 figures) and supplementary materials

The classical Whittle formula provides a closed-form expression for the asymptotic Fisher information matrix (FIM) rate of multidimensional, real-valued, zero-mean, purely nondeterministic stationary Gaussian processes (GPs), expressed in terms of their parameterized spectra within a maximum-likelihood framework. However, the Gaussian assumption underlying this result restricts its applicability to many real-world signals exhibiting heavy-tailed or non-Gaussian behavior. In this paper, we extend Whittle's result to multidimensional, real-valued stationary compound Gaussian processes (CGPs) with arbitrary mean, under a unified framework encompassing fully known, parameterized, and completely unknown density generators. Building upon the Slepian-Bangs formula for $n$ consecutive observations and extending it to the semiparametric setting, we leverage the asymptotic properties of block Toeplitz matrices to obtain a closed-form spectral-domain expression for the asymptotic FIM rate. The resulting expression, common to all density generator families, generalizes the standard zero-mean Gaussian formula by incorporating a distribution-dependent contribution associated with the nonzero mean, and an additional covariance term that is invariant to the choice of non-Gaussian distribution. This extension enables efficient and theoretically grounded performance analysis for heavy-tailed signal processing applications.

0.41

A positive resolution of the gap-entropy conjecture

cs.LG stat.ML ·2026-09-09 ·P. M. Aronow, Nathan Kallus, Patrick Lopatto
theory similarity 0.51
Abstract

We prove the gap-entropy conjecture for fixed-confidence best-arm identification with independent unit-variance Gaussian arms, means in $[0,1]$, and a unique optimal arm. For each suboptimal arm $i$, let $Δ_i=μ_*-μ_i$ be its gap from the optimal mean, and write $H=\sum_{i\ne *}Δ_i^{-2}$. Let $p_r$ be the fraction of $H$ contributed by arms with $2^{-(r+1)}<Δ_i\le2^{-r}$, and let $\mathrm{Ent}(I)=\sum_{r:p_r>0} p_r\log(1/p_r)$. Among all algorithms that identify the optimal arm with probability at least $1-δ$ on every Gaussian instance, the optimal expected number of samples on a given instance, averaged over all permutations of the arm labels, is within absolute constant factors of $H(\log(1/δ)+\mathrm{Ent}(I))$. Moreover, there is an algorithm, independent of the instance, whose expected number of samples is bounded by a constant multiple of this quantity plus $g^{-2}\log\log(e^e/g)$, where $g=\min_{i\ne *}Δ_i$ is the gap to the closest competitor.

0.51

Maximum Entropy Probability Distributions on Spheres with Fixed Mean Busemann Function and Holomorphic-Information-Geometric Model of Cognition

cs.IT math.PR ·2026-09-17 ·Vladimir Jacimovic
similarity 0.51
Abstract · 17 pages, 29 references, no figures or tables

In the first half of the paper we revisit the question regarding MaxEnt probability distributions on spheres. We derive families of MaxEnt distributions on spheres in real and complex vector spaces with fixed expected Busemann function (energy). As a particular case, we deduce sub-families on canonical energy levels where inverse temperature equals the dimension of the sphere. In the second part we focus on the information manifold of canonical MaxEnt distributions on the sphere in the complex vector space. This manifold is isomorphic to the Bergman ball. We introduce the reproducing kernel on this manifold and use the RKHS theory to elaborate the model of cognition. In particular, we state the principle of minimal cognitive effort in RKHS and demonstrate its dual relationship with the MaxEnt principle for probability distributions on the boundary sphere.

0.27

Distributional statistics of nonequilibrium

cs.IT cond-mat.stat-mechmath.PRphysics.data-an ·2026-10-24 ·Harrison Hartle, Aanjaneya Kumar, David H. Wolpert
similarity 0.50
Abstract · 23 pages, 5 figures

We establish a reference modeling framework for random probability distributions subject to constraints. Generalizing the hyperensemble approach of Crooks, we formulate Jaynesian priors of maximal uncertainty over the unit simplex of categorical distributions. This framework is entirely general, but we primarily investigate models with constraints on physically relevant quantities, namely, average energy and Shannon entropy. A constraint on the exact value of average energy uniquely determines a Boltzmann-Gibbs equilibrium, but also defines a hyperplanar subset of the probability simplex consisting of all distributions with that value of average energy. The associated hyperensemble has a uniform probability density across all such distributions, regardless of distance to equilibrium. Such reference models make predictions of generic nonequilibrium properties such as the mean and modal microstate distributions and the expected free energy of a random distribution, which we examine analytically and via exact sampling algorithms. Moreover, introducing constraints on Shannon entropy permits parametric access to tunably nonequilibrium regimes. The approach follows conventional Jaynesian modeling logic and is compatible with standard Bayesian inference, and reduces to Boltzmann-Gibbs statistics when Shannon entropy is maximized. We examine the physical predictions of this scheme, and demonstrate its wide compatibility with other approaches to nonequilibrium modeling. We illustrate the framework in three scenarios: (i) comparison to superstatistics quasi-equilibrium modeling, (ii) generation of random nonequilibrium steady states, and (iii) Bayesian inference under a prior hyperensemble. We highlight numerous prospects for theoretical extensions and empirical application.

0.25