CS Paper Radar

Maximum Entropy Probability Distributions on Spheres with Fixed Mean Busemann Function and Holomorphic-Information-Geometric Model of Cognition

Vladimir Jacimovic

cs.IT math.PR ·submitted 2026-09-17 13:54 UTC · v1

Abstract

In the first half of the paper we revisit the question regarding MaxEnt probability distributions on spheres. We derive families of MaxEnt distributions on spheres in real and complex vector spaces with fixed expected Busemann function (energy). As a particular case, we deduce sub-families on canonical energy levels where inverse temperature equals the dimension of the sphere. In the second part we focus on the information manifold of canonical MaxEnt distributions on the sphere in the complex vector space. This manifold is isomorphic to the Bergman ball. We introduce the reproducing kernel on this manifold and use the RKHS theory to elaborate the model of cognition. In particular, we state the principle of minimal cognitive effort in RKHS and demonstrate its dual relationship with the MaxEnt principle for probability distributions on the boundary sphere.

Comment
17 pages, 29 references, no figures or tables

Closest papers

Nearest neighbours by meaning across the whole index.

Entropy maximization for cube projections

cs.IT math.PR ·2026-11-10 ·Zhekai Pang
theory similarity 0.57
Abstract · 29 pages

We prove that, in every dimension $n\ge150$, the one-dimensional projections of the uniform distribution on a cube have the largest differential entropy in directions with equal coordinate magnitudes. This establishes the conjecture of Eskenazis, Nayar, and Tkocz in these dimensions.

0.58

Physics of Information Geometry - Part II: Small-Step Active Inference on the Probability Simplex

cs.IT cond-mat.stat-mech ·2026-09-10 ·C. Emre Koksal, Deniz Sargun
theory similarity 0.56
Abstract

This paper is the second in a two-part investigation of the physics of information geometry. While Part I develops a physical foundation for distributional motion on the probability simplex, the present paper studies how that framework manifests in active inference. The treatment is fully self-contained and does not require familiarity with Part I. We focus in particular on active inference through small distributional steps and the geometric structure induced by such local motion. Starting from an initial distribution, an agent evolves its belief state toward a final target distribution through a sequence of constrained updates. We define a relative free energy functional with respect to the preferred distribution and extend it to a relative potential energy analogous to the Helmholtz/Gibbs free-energy decomposition. The evolution is subject to a per-step kinetic constraint expressed through the Kullback-Leibler (KL) divergence between consecutive distributions, which serves as a discrete kinetic energy on the probability simplex. Using the information-geometric Pythagorean theorem on KL balls, we show that sufficiently small local moves dominate large direct jumps, and that greedy maximization of free-energy reduction is globally optimal under the kinetic constraint. This leads to a sequential variational principle in which the optimal trajectory minimizes the associated Lagrangian of the optimization problem. Similar to classical mechanics, the Lagrangian takes on the form as the difference between the kinetic and potential terms, establishing a least-action principle for distributional motion on the simplex. The resulting optimal update admits a closed form as an exponentially tilted version of the current distribution toward the preferred distribution, parametrized by an inverse-temperature-like multiplier. We further extend the framework to incorporate state-dependent geodesic...

0.17

Light Entropic Optimal Transport on Riemannian Manifolds

cs.LG ·2026-10-02 ·Xavier Aramayo-Carrasco, Petr Mokrov, Alexander Korotin
similarity 0.55
Abstract

Entropic Optimal Transport (EOT) has become a practical framework for learning stochastic couplings between complex distributions, with applications in generative modeling and domain adaptation. However, most EOT solvers are designed for Euclidean spaces, while manifold extensions remain limited and often rely on costly iterative methods, simulated dynamics, or generic neural models that do not fully exploit the underlying geometry. We introduce ManifoldLightOT, a light approach for learning kernel-induced EOT couplings directly on common manifolds. Using the kernel form of the EOT solution, we construct geometry-specific Gibbs kernels together with compatible potential parameterizations for spheres, tori, $\mathrm{SO}(3)$, and $\mathrm{SE}(3)$. These choices yield closed-form normalization and directly sampleable conditional distributions. Our formulation naturally extends to products of manifolds, making it applicable to more complex geometries. The parameters of the potentials are optimized directly from samples using Monte Carlo estimates of the learning objective. Through synthetic and real-world experiments, we show that ManifoldLightOT often outperforms existing manifold OT methods while retaining direct sampling.

0.26

The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk Perspective

cs.LG ·2026-10-05 ·Xingrun Li, Sho Kuno, Yusuke Mukuta, Xin Yang, Tatsuya Harada
top venuetheory similarity 0.54
Abstract · Accepted at NeurIPS 2026 as a Spotlight

We study the implicit bias of Riemannian gradient flow for hyperbolic multiclass classification with fixed class prototypes in hyperbolic space $\mathbb H^n$. Our framework accommodates general permutation invariant relative margin (PERM) losses, a class that includes cross entropy and other standard multiclass losses. Our analysis is based on a decomposition: at large radius, the distance to each prototype splits into a radial term and a direction dependent term described by the Busemann function. This yields two main results. First, we prove a radial dichotomy: the sign of a drift coefficient $μ$ determines whether the radius is pushed toward the ideal boundary or back toward the interior; if the positive drift persists, then $r(t)=\tfrac12\log t+O(1)$, while persistent negative drift returns the trajectory to the large radius threshold in finite time. Second, we show that large-radius directions can approach critical points of the Busemann risk on $\partial\mathbb H^n$, even during radial return. These results provide a rigorous large-radius perspective on two phenomena we refer to as boundary saturation and near-boundary clustering in hyperbolic representation learning.

0.42

Low-Dimensional Embeddings for Gaussian Kernels on Manifolds

cs.CG cs.LG ·2026-09-14 ·Soumik Dutta, Kunal Dutta
theory similarity 0.53
Abstract · 57 pages, 3 figures

The Gaussian kernel is a widely used similarity measure underlying kernel methods such as kernel PCA and spectral clustering, but computing Gaussian kernel distances for many pairs of points can be expensive. Using Random Fourier Features (RFF), Chen and Phillips [ALT 2017] showed that for points in a $d$-dimensional Euclidean ball in ${\mathbb R}^N$, $t=Ω((d/\varepsilon^2)\log(dR/\varepsilon))$ features suffice to preserve all pairwise Gaussian kernel distances within a $(1\pm\varepsilon)$ factor with high probability. We establish a uniform relative-error embedding theorem for the more general setting of an arbitrary positive-reach submanifold $\mathcal M\subset{\mathbb R}^N$ of intrinsic dimension $d$. We show that $t=O((d/\varepsilon^2)\log(\operatorname{vol}(\mathcal M)^2N^{2d}/(\operatorname{vol}(B_1^d(0))^2\operatorname{rch}(\mathcal M)^{2d}\varepsilon^{2d+1}δ)))$, or approximately $O((d^2/\varepsilon^2)(\log N+\log(1/(\varepsilonδ))))$, RFFs suffice, with probability $1-δ$, to preserve the Gaussian kernel distance between every pair of manifold points up to relative error $\varepsilon$. Thus the bound depends only logarithmically on the ambient dimension and on manifold parameters such as volume and reach, while retaining the $1/\varepsilon^2$ Euclidean rate. We also prove a topological consequence: under the same RFF embedding, persistent homology is preserved in the sense that weighted Cech and Rips filtrations built from Gaussian kernel power distance are $(1\pm\varepsilon_\star)$-interleaved, where $\varepsilon_\star$ accounts for both distance distortion and kernel-weight approximation.

0.22

Closed-Form Gaussian Mixture Representations of d-Dimensional Triangulated Domains

cs.IT math.NAmath.PR ·2026-10-31 ·Ali Darijani, Benedikt Stratmann, Uwe D. Hanebeck, Ratan Bahadur Thapa, Jürgen Beyerer +1 more
publishedtheory similarity 0.53
Abstract · Accepted to "2026 IEEE Sensor Data Fusion: Trends, Solutions, Applications (SDF)". 17 pages and 6 figures

We derive a Gaussian Mixture (GM) representation of a full-dimensional subset of Euclidean space with finite volume from a finite simplicial triangulation in closed form. On each simplex, we replace the uniform probability density function (PDF) with a Gaussian PDF that minimizes the Kullback--Leibler (KL) divergence, arriving at the information projection onto the family of Gaussian PDFs. By exploiting affine isomorphisms between simplices, the joint convexity and bijection invariance properties of the KL divergence, identities for Dirichlet PDFs, and a partition-of-unity argument, we establish a dimension-dependent but geometry-independent sharp upper bound on the global KL divergence between the resulting GM PDF and the uniform PDF on the original domain. Numerical examples illustrate the construction and demonstrate its potential in practical applications.

0.59

Orbital Detection: On Maximum-Entropy Priors

cs.IT ·2026-09-18 ·Kuranage Roche Rayan Ranasinghe, Takumi Takahashi, Giuseppe Thadeu Freitas de Abreu
theory similarity 0.52
Abstract · Submitted to an IEEE conference

Soft-input detection over a discrete constellation \(\mathcal{M}\) of cardinality \(M\) requires computing a posterior whose mean and mode are respectively given by the minimum mean square error (MMSE) and maximum a posteriori (MAP) estimates, both of which incur a computational cost of order \(\mathcal{O}(M)\) per symbol. We show that this cost is reduced to \(\mathcal{O}(L)\), where \(L \le M\) is the number of distinct amplitudes (rings), once the discrete prior is replaced by its maximum-entropy counterpart subject to the same radial marginal. This orbital prior, which is a mixture of uniform circular shells, is obtained by maximizing a mixed discrete-continuous entropy. We prove in this paper that such a distribution is the only distribution on \(\mathbb{C}\) that preserves the amplitude statistics of \(\mathcal{M}\) exactly while remaining maximally noncommittal in phase. Under the additive white Gaussian noise (AWGN) channel, the orbital prior induces a closed-form posterior that factors into a softmax over the \(L\) rings and a von Mises phase distribution whose concentration is supplied entirely by the observation, yielding closed-form orbital MMSE and MAP detectors of the discrete symbol at \(\mathcal{O}(L)\) cost. The resulting hierarchical rule selects the ring by posterior mass and the phase by conditional mode. We compare the pairwise ring boundary with that of the joint posterior-density and quantify the leading-order outward shift at high signal-to-noise ratio (SNR). Numerical results using standard constellations confirm that the orbital detectors maintain similar symbol error rate (SER) performance to optimal detectors, at a fraction of the complexity.

0.10

Generative Rate-Distortion-Perception Theory on Riemannian Manifolds

cs.IT ·2026-10-28 ·Tong Wu, Zhiyong Chen, Meixia Tao, Dazhi He, Feng Yang +1 more
theory similarity 0.52
Abstract

Generative communication uses transmitted information to control stochastic generation at the receiver. A fundamental question is how much source-specific information must be communicated so that outputs generated at the receiver satisfy prescribed fidelity and reliability requirements while preserving the conditional source distribution. We address this question for sources on compact Riemannian manifolds by developing a generative rate-distortion-perception (GRDP) framework without common randomness. We formulate an asymptotic operational GRDP function under a geodesic distortion radius and a failure-probability constraint, and establish its single-letter characterization through an equivalent informational formulation. Furthermore, for the informational formulation with the high-reliability limit, we derive a geometric lower bound determined by the largest source probability mass of a region with bounded geodesic diameter, together with an upper bound based on probabilistic coverings of the source manifold. Small-radius analysis of the lower bound reveals the roles of intrinsic dimension and scalar curvature in the required communication rate. For uniformly distributed sources on compact homogeneous Riemannian manifolds, we prove that the bounds coincide, yielding an exact characterization of the limiting GRDP function. We further specialize this result to unit spheres, obtaining an explicit expression that relates the minimum communication rate to the geodesic distortion radius and intrinsic dimension, revealing that for the $d$-dimensional unit sphere with $d\ge2$, increasing the communication rate by $d$ bits per source symbol can reduce the distortion radius by more than half.

0.25