CS Paper Radar

Closed-Form Gaussian Information Projection for Embedded Simplices and Simplicial Mixtures

Ali Darijani, Emadedin Soufian, Jürgen Beyerer

cs.IT ·submitted 2026-11-09 23:26 UTC · v1

Abstract

We study Gaussian approximation of Dirichlet--Gaussian probability density functions on embedded simplices. We derive the unique information projection onto the family of nondegenerate ambient Gaussian probability density functions, obtaining closed-form expressions for the optimal Gaussian and the minimum divergence for arbitrary positive Dirichlet parameters. The minimum divergence depends only on the intrinsic simplex dimension and Dirichlet parameters, is invariant up to an affine isomorphism, independent of the ambient dimension, and independent of the normal covariance. Furthermore, by joint convexity of Kullback--Leibler divergence, we establish explicit intrinsic dimension-dependent sharp upper bounds for finite Gaussian Mixture with shared component weights. For uniform probability density functions, these bounds reduce to dimension-dependent constants. The results provide closed-form Gaussian Mixture constructions and rigorous approximation guarantees for probability density functions associated with embedded simplicial complexes. A numerical example on a circular curve illustrates the theoretical results and their connections to geometric Gaussian Mixture representations.

Comment
27 Pages, 3 Figures

Closest papers

Nearest neighbours by meaning across the whole index.

Closed-Form Gaussian Mixture Representations of d-Dimensional Triangulated Domains

cs.IT math.NAmath.PR ·2026-10-31 ·Ali Darijani, Benedikt Stratmann, Uwe D. Hanebeck, Ratan Bahadur Thapa, Jürgen Beyerer +1 more
publishedtheory similarity 0.85
Abstract · Accepted to "2026 IEEE Sensor Data Fusion: Trends, Solutions, Applications (SDF)". 17 pages and 6 figures

We derive a Gaussian Mixture (GM) representation of a full-dimensional subset of Euclidean space with finite volume from a finite simplicial triangulation in closed form. On each simplex, we replace the uniform probability density function (PDF) with a Gaussian PDF that minimizes the Kullback--Leibler (KL) divergence, arriving at the information projection onto the family of Gaussian PDFs. By exploiting affine isomorphisms between simplices, the joint convexity and bijection invariance properties of the KL divergence, identities for Dirichlet PDFs, and a partition-of-unity argument, we establish a dimension-dependent but geometry-independent sharp upper bound on the global KL divergence between the resulting GM PDF and the uniform PDF on the original domain. Numerical examples illustrate the construction and demonstrate its potential in practical applications.

0.59

Closed-Form Gaussian Information Projection for Embedded Hypercubes and Beta--Gaussian Mixtures

cs.IT ·2026-11-11 ·Ali Darijani, Emadedin Soufian, Jürgen Beyerer
theory similarity 0.80
Abstract · 11 pages

We derive closed-form Gaussian information projections of Beta--Gaussian distributions whose tangential components are supported on affine embedded hypercubes and whose normal components are Gaussian. The optimal Gaussian is uniquely characterized by moment matching, and the corresponding minimum Kullback--Leibler divergence admits an explicit expression depending only on the intrinsic Beta parameters, independently of the embedding geometry, ambient dimension, and normal Gaussian parameters. In the uniform case, this divergence reduces to a linear function of the intrinsic dimension. We further extend this construction to finite, pure embedded cubical complexes by considering mixtures of the componentwise Gaussian projections. Using the joint convexity of the Kullback--Leibler divergence, we establish an explicit upper bound on the approximation error of the resulting Gaussian Mixture. For uniform tangential distributions and volume-based mixture weights, the bound is linear in the intrinsic dimension and independent of the geometry of the complex, its embedding, and the normal Gaussian parameters.

0.21

Fisher Information and Support Complexity of Gaussian Mixtures

cs.IT ·2026-10-15 ·Luca Barletta, Alex Dytso
theory similarity 0.66
Abstract · 24 pages, single-column

We study lower bounds on the Fisher information of Gaussian location mixtures and their applications to estimation problems. First, for a discrete mixing distribution, we derive a universal positive-semidefinite lower bound on the Fisher information matrix in terms of the Rényi entropy of order two. For a mixing distribution supported on $K$ points, this bound scales as $\log(K)/K^2$, improving by a logarithmic factor on the support-size dependence obtained from Stam's inequality. We then develop dimension-aware trace bounds using classical Sobolev inequalities. These bounds are expressed in terms of Sibson's $α$-mutual information and yield the scaling $K^{-2/n}$ in dimension $n$. A complementary bound involving the $α$-mutual information of order $1/2$ is obtained using the sharp Young convolution inequality. The derived inequalities are further specialized to rotationally invariant mixing distributions supported on discrete spherical shells. In this setting, an intrinsic-dimensional bound on Sibson mutual information leads to lower bounds on the Fisher information in terms of the number of occupied shells. As applications, we study least favorable priors for bounded Gaussian mean estimation. In the scalar case, we show that the least favorable prior on $[-R,R]$ has at least $Ω(R\sqrt{\log R})$ support points and that each of its probability masses is of order at most $1/R$. In the vector case, we show that the number of occupied shells grows at least linearly with $R$. Finally, Brown's identity and the I-MMSE relationship are used to translate the Fisher-information inequalities into upper bounds on the MMSE and mutual information.

0.28

Minimax Optimality of the NPMLE for Gaussian Mixtures in Hellinger Distance

cs.IT math.STcs.LG ·2026-10-21 ·Shayan Hundrieser, Tudor Manole
similarity 0.66
Abstract

We analyze the problem of estimating univariate Gaussian mixture densities using the nonparametric maximum likelihood estimator (NPMLE) based on $n$ independent and identically distributed samples. We show that the unconstrained NPMLE achieves the minimax optimal rate $\log(n)/n$ in squared Hellinger distance, when the true mixing measure is sub-Gaussian. In addition, we show that when the true mixing measure has compact support, the NMPLE constrained to a compact interval also achieves the minimax optimal rate, which is slightly faster and of order $\log(n)/(n \log \log n)$. Our proof consists of sharply characterizing the local Hellinger bracketing entropy of the class of finite Gaussian mixtures. One of our key technical innovations is to sharply bound the $L^2$ bracketing entropy of balls of bounded-degree polynomials, which may be of independent interest. As an application, we establish the regret-optimality of $g$-modeling procedures based on the NPMLE in the Gaussian Empirical Bayes problem with bounded priors.

0.30

Dimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures

cs.IT math.STmath.PRstat.ML ·2026-10-18 ·Jeonghwan Lee, Cong Ma
similarity 0.64
Abstract · 21 pages; Comments would be appreciated!

We establish dimension-free comparison inequalities between the Kullback-Leibler (KL) and $χ^2$-divergences and the squared Hellinger distance for Gaussian location mixtures with compactly supported mixing distributions. We show that both divergences are bounded by the squared Hellinger distance up to constants depending only on the radius of the support, independently of the ambient dimension and the number of mixture components. These results resolve an open question raised by \cite{jia2023entropic} and strengthen existing comparison inequalities. Our proof relies on a Gaussian interpolation argument that relates the derivatives of these divergences to differences between posterior means.

0.29

Beyond Unimodal Bases: Pullback Geometry for Multimodal Data

cs.LG ·2026-09-30 ·Honglei Brinkmann, Lucas Ng, Georgios Batzolis, Mark Girolami, Carola-Bibiane Schönlieb +1 more
similarity 0.61
Abstract

Data-driven Riemannian geometry provides nonlinear interpolation and geometric representations of high-dimensional data. For these operations to be statistically meaningful, paths between observations should preferentially traverse high-likelihood regions. Existing scalable pullback constructions typically use a unimodal Gaussian latent distribution, assuming that the data reside close to a single manifold. For multimodal data, mapping separated modes or local structures into one Gaussian region can require substantial transport deformation and compromise the resulting geometry. We introduce a pullback geometry for data supported on mixtures of manifolds. Using a latent Gaussian mixture, we define its Riemannian metric as the matrix square of the responsibility-weighted expected component precision. The metric is smooth and positive definite and recovers the existing Gaussian construction in the single-component limit. For structured overlapping mixtures, we establish conditions under which the log-density is concave along geodesics, providing a formal connection between the proposed geometry and paths through high-likelihood regions, and derive the corresponding local curvature relations. We instantiate this geometry in a normalizing flow with adaptive mixture learning, allowing the number of active components to emerge from the data and supporting component-wise reconstruction and local effective-dimension estimation. Experiments on synthetic geometric data, a controlled multi-view image setting with a known reference trajectory, and MNIST show reduced transport distortion, competitive path support, close reference-trajectory recovery, and improved interpolation realism. These results extend scalable pullback geometry beyond datasets that reside close to a single manifold while retaining tractable and interpretable local structure.

0.28

Polylogarithmic Sparsity of Randomly Reweighted NPMLEs for Gaussian Mixtures

cs.LG stat.MEmath.ST ·2026-10-01 ·Hansheng Jiang
similarity 0.60
Abstract

The nonparametric maximum likelihood estimator (NPMLE) of a Gaussian location mixture maximizes the likelihood over the infinite-dimensional space of mixing distributions. The maximizing mixing distribution can be nonunique, and the classical bound on its number of atoms grows linearly with the sample size $n$. We show that a vanishingly small random perturbation of the likelihood yields exact polylogarithmic sparsity. The resulting randomly reweighted NPMLE maximizes a weighted likelihood whose independent weights, taken to be Gamma in our analysis, concentrate around one as $n$ grows. With high probability, it is unique, has $O\{(\log n/\log\log n)^d+\log n\}$ atoms in dimension $d$, nearly maximizes the ordinary likelihood, and estimates the mixture density at a Hellinger rate that is parametric up to logarithmic factors. This sparsity holds for the estimator itself, not for an approximation of it, and requires no support penalty. The proof rests on an effective-dimension principle for positive kernel mixtures: low-dimensional variation of the fitted values controls the support of every extreme point of the set of maximizers. Numerical illustrations verify that the reweighted NPMLE has Hellinger risk and support size comparable to those of the ordinary NPMLE.

0.47

Gaussian entanglement and quantum communication: geodesic optimization and multimode bounds

cs.IT quant-ph ·2026-10-13 ·Hemant K. Mishra, Mark M. Wilde
similarity 0.58
Abstract · 80 pages, 12 figures

Loss and noise limit the use of light to distribute entanglement, transmit quantum information, and establish secret keys. Gaussian states have a compact description in terms of means and covariance matrices, but their entanglement still requires global optimization. We develop a framework for computing Gaussian-restricted versions of the relative entropy of entanglement and Rains entanglement. An integral representation reveals a convex geometry under matrix geometric means and reduces Gaussian Rains entanglement to relative entropy minimized over Gaussian states with positive partial transpose. We obtain unique optimal reference states and additivity for independent Gaussian input states. Our convex-majorization algorithm has an explicit geometric convergence rate, uniform in the faithful regularization parameter and valid for pure input states. Controlled numerical integration and approximate convex subproblem solutions give a bit-complexity bound that is polynomial in accuracy bits for each fixed rational input covariance matrix, with explicit dependence on covariance size. These calculations bound extractable entanglement and, through the relative entropy of entanglement, extractable secret key. Teleportation simulation, energy allocation, and a convex optimization of passive-basis loss cores give bounds on quantum and private communication under an input-energy constraint, allowing arbitrary two-way classically assisted protocols. Two- and three-mode examples compare the bounds with achievable rates, including matching pure-loss benchmarks. Finally, we separate the Gaussian-restricted quantities from their unrestricted counterparts and give a photon-number truncation method with controlled error for computing the latter.

0.58