CS Paper Radar

Closed-Form Gaussian Mixture Representations of d-Dimensional Triangulated Domains

Ali Darijani, Benedikt Stratmann, Uwe D. Hanebeck, Ratan Bahadur Thapa, Jürgen Beyerer, Nehal Afifi

cs.IT math.NAmath.PR ·submitted 2026-10-31 13:23 UTC · v1
publishedtheory

Abstract

We derive a Gaussian Mixture (GM) representation of a full-dimensional subset of Euclidean space with finite volume from a finite simplicial triangulation in closed form. On each simplex, we replace the uniform probability density function (PDF) with a Gaussian PDF that minimizes the Kullback--Leibler (KL) divergence, arriving at the information projection onto the family of Gaussian PDFs. By exploiting affine isomorphisms between simplices, the joint convexity and bijection invariance properties of the KL divergence, identities for Dirichlet PDFs, and a partition-of-unity argument, we establish a dimension-dependent but geometry-independent sharp upper bound on the global KL divergence between the resulting GM PDF and the uniform PDF on the original domain. Numerical examples illustrate the construction and demonstrate its potential in practical applications.

Comment
Accepted to "2026 IEEE Sensor Data Fusion: Trends, Solutions, Applications (SDF)". 17 pages and 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Closed-Form Gaussian Information Projection for Embedded Simplices and Simplicial Mixtures

cs.IT ·2026-11-09 ·Ali Darijani, Emadedin Soufian, Jürgen Beyerer
similarity 0.85
Abstract · 27 Pages, 3 Figures

We study Gaussian approximation of Dirichlet--Gaussian probability density functions on embedded simplices. We derive the unique information projection onto the family of nondegenerate ambient Gaussian probability density functions, obtaining closed-form expressions for the optimal Gaussian and the minimum divergence for arbitrary positive Dirichlet parameters. The minimum divergence depends only on the intrinsic simplex dimension and Dirichlet parameters, is invariant up to an affine isomorphism, independent of the ambient dimension, and independent of the normal covariance. Furthermore, by joint convexity of Kullback--Leibler divergence, we establish explicit intrinsic dimension-dependent sharp upper bounds for finite Gaussian Mixture with shared component weights. For uniform probability density functions, these bounds reduce to dimension-dependent constants. The results provide closed-form Gaussian Mixture constructions and rigorous approximation guarantees for probability density functions associated with embedded simplicial complexes. A numerical example on a circular curve illustrates the theoretical results and their connections to geometric Gaussian Mixture representations.

0.24

Closed-Form Gaussian Information Projection for Embedded Hypercubes and Beta--Gaussian Mixtures

cs.IT ·2026-11-11 ·Ali Darijani, Emadedin Soufian, Jürgen Beyerer
theory similarity 0.71
Abstract · 11 pages

We derive closed-form Gaussian information projections of Beta--Gaussian distributions whose tangential components are supported on affine embedded hypercubes and whose normal components are Gaussian. The optimal Gaussian is uniquely characterized by moment matching, and the corresponding minimum Kullback--Leibler divergence admits an explicit expression depending only on the intrinsic Beta parameters, independently of the embedding geometry, ambient dimension, and normal Gaussian parameters. In the uniform case, this divergence reduces to a linear function of the intrinsic dimension. We further extend this construction to finite, pure embedded cubical complexes by considering mixtures of the componentwise Gaussian projections. Using the joint convexity of the Kullback--Leibler divergence, we establish an explicit upper bound on the approximation error of the resulting Gaussian Mixture. For uniform tangential distributions and volume-based mixture weights, the bound is linear in the intrinsic dimension and independent of the geometry of the complex, its embedding, and the normal Gaussian parameters.

0.21

Bregman geometry in regular exponential families: dual representations and relative smoothness

cs.LG stat.MLmath.OC ·2026-11-13 ·Mame Diarra Fall, Éric Barat, Nicolas Dobigeon
similarity 0.64
Abstract

Regular exponential-family distributions are ubiquitous in statistics due to their appealing and convenient properties. Notably, they can be expressed in terms of Bregman divergences, revealing fundamental connections between statistics, convex analysis, and information geometry. However, this geometric structure has not been systematically exploited to characterize these distributions with respect to their expectation parametrization. Building on a projective characterization, we establish a general construction of equivalent dual Bregman representations, together with normalization and uniqueness results. These representations express log-densities as ordinary Bregman divergences in dual coordinate systems, providing geometric characterizations of the parameter space. So-called $β$- and $α$-scaled dual representations emerge as particular instances of this framework. We further derive dual Bregman representations of conjugate priors and establish that they preserve conjugacy. Applications to classical distributions illustrate the geometric structures underlying seemingly different statistical models. Moreover, we show that these representations provide natural reference geometries for establishing relative smoothness of the primal Bregman representation of the distribution, with explicit bounds that are sharp in the scalar and separable settings. An illustrative application to the Poisson distribution sheds new light on several works in the literature, providing complementary geometric justifications for reference geometries while deriving existing algorithms.

0.27

Dimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures

cs.IT math.STmath.PRstat.ML ·2026-10-18 ·Jeonghwan Lee, Cong Ma
similarity 0.62
Abstract · 21 pages; Comments would be appreciated!

We establish dimension-free comparison inequalities between the Kullback-Leibler (KL) and $χ^2$-divergences and the squared Hellinger distance for Gaussian location mixtures with compactly supported mixing distributions. We show that both divergences are bounded by the squared Hellinger distance up to constants depending only on the radius of the support, independently of the ambient dimension and the number of mixture components. These results resolve an open question raised by \cite{jia2023entropic} and strengthen existing comparison inequalities. Our proof relies on a Gaussian interpolation argument that relates the derivatives of these divergences to differences between posterior means.

0.29

Fisher Information and Support Complexity of Gaussian Mixtures

cs.IT ·2026-10-15 ·Luca Barletta, Alex Dytso
theory similarity 0.59
Abstract · 24 pages, single-column

We study lower bounds on the Fisher information of Gaussian location mixtures and their applications to estimation problems. First, for a discrete mixing distribution, we derive a universal positive-semidefinite lower bound on the Fisher information matrix in terms of the Rényi entropy of order two. For a mixing distribution supported on $K$ points, this bound scales as $\log(K)/K^2$, improving by a logarithmic factor on the support-size dependence obtained from Stam's inequality. We then develop dimension-aware trace bounds using classical Sobolev inequalities. These bounds are expressed in terms of Sibson's $α$-mutual information and yield the scaling $K^{-2/n}$ in dimension $n$. A complementary bound involving the $α$-mutual information of order $1/2$ is obtained using the sharp Young convolution inequality. The derived inequalities are further specialized to rotationally invariant mixing distributions supported on discrete spherical shells. In this setting, an intrinsic-dimensional bound on Sibson mutual information leads to lower bounds on the Fisher information in terms of the number of occupied shells. As applications, we study least favorable priors for bounded Gaussian mean estimation. In the scalar case, we show that the least favorable prior on $[-R,R]$ has at least $Ω(R\sqrt{\log R})$ support points and that each of its probability masses is of order at most $1/R$. In the vector case, we show that the number of occupied shells grows at least linearly with $R$. Finally, Brown's identity and the I-MMSE relationship are used to translate the Fisher-information inequalities into upper bounds on the MMSE and mutual information.

0.28

A Complete Characterization of Tensorizable $f$-divergences

cs.IT math.PRmath.ST ·2026-08-28 ·Rodrigo Cruz, Flavio P. Calmon, Qian Yu
similarity 0.58
Abstract

Csiszar's formulation of the $f$-divergence introduced a vast family of functionals for quantifying dissimilarity between probability distributions. However, many applications in statistics and information theory rely only on a few $f$-divergences, such as the Kullback-Leibler divergence, the $χ^2$-divergence, and the squared Hellinger distance. These divergences are especially useful because they admit simple compositional formulas under product measures, a property sometimes referred to as tensorization. In this work, we refine a formalism of tensorization previously introduced in the literature. Then, we show that any possible tensorization formula has a multi-affine form characterized by a single parameter, and identify all tensorizable $f$-divergences under our adopted notion of tensorization.

0.45

Minimax Optimality of the NPMLE for Gaussian Mixtures in Hellinger Distance

cs.IT math.STcs.LG ·2026-10-21 ·Shayan Hundrieser, Tudor Manole
similarity 0.58
Abstract

We analyze the problem of estimating univariate Gaussian mixture densities using the nonparametric maximum likelihood estimator (NPMLE) based on $n$ independent and identically distributed samples. We show that the unconstrained NPMLE achieves the minimax optimal rate $\log(n)/n$ in squared Hellinger distance, when the true mixing measure is sub-Gaussian. In addition, we show that when the true mixing measure has compact support, the NMPLE constrained to a compact interval also achieves the minimax optimal rate, which is slightly faster and of order $\log(n)/(n \log \log n)$. Our proof consists of sharply characterizing the local Hellinger bracketing entropy of the class of finite Gaussian mixtures. One of our key technical innovations is to sharply bound the $L^2$ bracketing entropy of balls of bounded-degree polynomials, which may be of independent interest. As an application, we establish the regret-optimality of $g$-modeling procedures based on the NPMLE in the Gaussian Empirical Bayes problem with bounded priors.

0.30

Exact Transport-Information Correspondence for Distribution-Adaptive Discretization

cs.IT cond-mat.stat-mech ·2026-11-04 ·Koretaka Yuge
similarity 0.57
Abstract · 6 pages

Discretization of continuous probability distributions is an operation on the sample space, and the structure induced by this operation cannot generally be determined solely from information geometry. In our recent work on unavoidable canonical nonlinearity (UCN), we established a non-arbitrary connection between the transport cost associated with discretization and the information-geometric indistinguishability of continuous probability distributions. Through the transport-information correspondence, the UCN quantify the information-theoretic cost due to discretization as the expected Kullback-Leibler divergence between nearby continuous distributions associated with the discretization geometry. In the original UCN construction, discretization is implemented by transporting the probability mass within each cell to its geometric centroid. The resulting transport-information correspondence, however, is derived under specific conditions involving the cell geometry, spatial coverage, and the vanishing-cell-scale limit. In this work, we introduce an alternative local-map discretization scheme in which the probability mass within each cell is transported to its own probability-weighted centroid. This change in the representative-point selection enables an exact expression for the transport cost of each cell in terms of the covariance matrix of its conditional probability distribution and the Fisher metric of the underlying continuous family. We establish an exact correspondence between the resulting transport cost and the expectation of the associated Fisher-induced quadratic form, without requiring uniform cell geometry, complete coverage of the sample space, or an infinitesimal cell-scale limit. The proposed construction thus generalizes the transport-information correspondence to finite-scale discretization using arbitrary collections of non-overlapping bounded convex sets.

0.25