CS Paper Radar

Entropic Inequalities and Limit Theorems in Boolean Probability

Kewei Pan

cs.IT math.PR ·submitted 2026-10-14 13:23 UTC · v1
theory

Abstract

We study Boolean entropy and Fisher information in information inequalities and the Boolean central limit theorem. We prove a fractional Stam inequality for the Boolean Fisher information associated with arbitrary fractional partitions of subset sums, and derive an entropy power inequality for sums of Boolean independent random variables and its weighted version. We then establish a Boolean analogue of Barron's entropy convergence result along the Boolean central limit theorem: Boolean entropy converges to the entropy of the Rademacher law if and only if the initial entropy is finite. Furthermore, under a finite fourth moment, in the Boolean central limit theorem, we obtain \[ Γ(μ_n\mid\mathbf b)= \frac{m_4(μ)-1-m_3(μ)^2}{2}\frac{\log n}{n} +o\!\left(\frac{\log n}{n}\right), \] with an explicit example showing sharpness. For symmetric laws with finite fourth moment and finite Boolean Fisher information, \[ Ψ(μ_n\mid\mathbf b) =2\bigl(m_4(μ)-1\bigr)\frac{\log n}{n} +o\left(\frac{\log n}{n}\right). \] Our approach is based on the Nevanlinna representation of Cauchy transforms.

Closest papers

Nearest neighbours by meaning across the whole index.

Improved Bounds for the Entropic Central Limit Theorem in the Log-Concave Case

cs.IT math.PR ·2026-10-22 ·Tom Maitre
theory similarity 0.67
Abstract

Let $μ$ be a log-concave isotropic probability measure on $R^d$ , and let $μ^n$ denote the law of the normalized sum of $n$ independent random vectors with law $μ$. We prove that \[ H(μ^n|γ)\leq \frac{C}{n} \min\left\{1+\log(ed)^2H(μ|γ)\ ,\ d\right\}. \] Compared to the previous best known bound, our estimate replaces the polynomial dependence on the dimension by a polylogarithmic one. The proof relies on a new combination of the De Bruijn identity with Eldan's stochastic localization process.

0.11

Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences

cs.IT math.PR ·2026-09-07 ·Tong Ye, Liu-Quan Yao
benchmarktheory similarity 0.67
Abstract · 47 pages

We establish conditional central limit theorems in Fisher information under log-concavity in every fixed dimension. For conditionally centered normalized sums, after whitening by the averaged conditional covariance, the averaged conditional Fisher information converges to the dimension if and only if it is finite at one convolution level. The scalar criterion follows as the one-dimensional case; we also provide an independent scalar proof based on a second-order continuity theorem for Fisher production on Gaussian-smoothed, tail-controlled classes. For the original sums, the averaged Fisher information matrix converges in operator norm to the inverse averaged conditional covariance. Consequently, the conditional relative Fisher information with respect to the limiting Gaussian law vanishes, and the Gaussian logarithmic Sobolev inequality yields convergence in conditional relative entropy and conditional entropy. We give two operational consequences. For any fixed finite-constellation low-power input, the first-order conditional mutual-information slope converges to the Gaussian-noise benchmark. For Gaussian signaling at any fixed signal covariance, the mutual-information gap from that benchmark is bounded by the conditional relative Fisher deficit and hence vanishes asymptotically.

0.38

Hermite-Fisher bounds and stability for min-entropy power inequalities

cs.IT math.FAmath.MGmath.PR ·2026-09-18 ·Silouanos Brazitikos, Martin Rapaport, Tomasz Tkocz
similarity 0.65
Abstract

We derive explicit lower bounds for relative Fisher information by combining a variational principle with suitably orthogonalized Hermite-polynomial test functions. The resulting cumulant bounds are asymptotically sharp and yield lower bounds for Gaussian entropy deficits. We also establish quantitative versions of sharp min-entropy power inequalities in all dimensions. En route, we develop a stability result for Brzezinski's sharp bound for block sections of products of Euclidean balls, which may be of independent interest.

0.39

Near-Gaussian counterexamples to the Ball-Nayar-Tkocz entropy concavity conjecture

cs.IT math.PR ·2026-09-10 ·Congyi Luo
similarity 0.61
Abstract · 37 pages

The Ball-Nayar-Tkocz conjecture asserts that, for independent real random variables $X,Y$ with a common log-concave density, the function $t\mapsto h(\sqrt tX+\sqrt{1-t}Y)$ is concave on $[0,1]$. Gaussian distributions have this property. We construct strongly log-concave counterexamples arbitrarily close to the Gaussian and study their persistence under Gaussian smoothing. Let $X$ have mean zero and variance one, let $G$ be an independent standard Gaussian, and let $q\in[0,1]$ denote the signal variance proportion in the smoothed variable $\sqrt qX+\sqrt{1-q}G$. In the asymmetric case, for every fixed $0<q\le1$, there are counterexamples for which the entropy of the weighted sum of two independent copies of the smoothed variable has strictly positive second derivative near the endpoints. In the symmetric case, for every $4/7<q\le1$, there are counterexamples for which an unequally weighted sum has strictly greater entropy than the equally weighted sum. Both families have smooth, strictly positive densities and are strongly log-concave before and after smoothing. The density ratios $f/\varphi$ converge uniformly to one, and each derivative of fixed positive order converges uniformly to zero, where $\varphi$ is the standard Gaussian density. The symmetric counterexamples can also match any prescribed finite number of Gaussian moments exactly. The asymmetric construction uses an endpoint expansion of entropy, whereas the symmetric construction exploits the different decay rates of high-order Hermite perturbations under different weights. Thus, densities violating concavity approach the Gaussian density in the strong sense described above. The question of uniform concavity in the symmetric class for $0<q\le4/7$ remains open.

0.25

A Sharp Fisher-Information Inequality for Boolean Pairs: Proof of the Amari--Kobayashi Conjecture

cs.IT ·2026-10-29 ·Jun Chen, Shun Watanabe, Lei Yu
theory similarity 0.61
Abstract

Consider two terminals that observe correlated uniform binary vectors and separately compress their observations to one bit. We prove that, for every blocklength and every correlation parameter in $(-1,1)$, the Fisher information retained by the resulting pair of bits is maximized by matching parity functions of an appropriate degree, thereby resolving a conjecture of Amari and Kobayashi. The proof combines a Fourier-based bound on the derivative of the normalized covariance with a scalar inequality for signed polynomials subject to a global range constraint.

0.15

Sharp Rogers--Shephard Inequalities for Rényi Entropy

cs.IT math.PRmath.MG ·2026-10-11 ·Bang-Xian Han, Guoqing Zhan, Chiyu Zhou, Zhuo-Nan Zhu
theory similarity 0.60
Abstract · 29 pages; comments are welcome!

We establish sharp weighted Rogers--Shephard inequalities for Rényi differential entropy. For independent copies $X,X'$ of a log-concave random vector in $\R^n$, we prove $h_p(aX-bX')\le h_p(X)+n\log(a+b)$ for all $a,b>0$ and $1\le p\le\infty$, where orders $1$ and $\infty$ correspond to Shannon entropy and min-entropy, respectively. The Shannon case settles the entropic Rogers--Shephard conjecture of Madiman and Kontoyiannis and its higher-dimensional formulation. For $1\le p<\infty$, equality holds precisely for invertible affine images of random vectors with independent exponential coordinates. At $p=\infty$, the larger equality class is characterized by possibly extended-valued convex potentials that are positively homogeneous of degree one. For every $0<p<1$, uniform laws on sufficiently high-dimensional simplices violate the unweighted bound. Thus $p=1$ is the critical order for this bound to hold in every dimension. The proof combines weighted convex intersections with an exponential lift to a log-affine probability density. At the Shannon endpoint, this lift yields an exact deficit decomposition with a conditional mutual information term for an additive channel with asymmetric Laplace noise.

0.43

A weak Hellinger inequality for noisy Boolean channels

cs.IT math.CO ·2026-09-22 ·Polona Durcik, Marco Fraccaroli, Joris Roos
code/datahighly cited similarity 0.60
Abstract · v2: 20 pages; additional references and remarks; associated formalization available at https://github.com/roos-j/lean-weakhellinger

A weak form of the Hellinger conjecture of Anantharam, Bogdanov, Chakrabarti, Jayram, and Nair for the binary symmetric channel is proved: dictator functions maximize Hellinger $Φ$-entropy among all Boolean functions of the input and all one-bit statistics of the output of a noisy channel. The technical heart of the matter is an explicit inequality in three real parameters, which is proved using explicit polynomial approximations and computer-assisted positivity checks. The results are also formally verified in Lean 4.

0.61

On Han- and Shearer-Type Information Inequalities: Equality Conditions and Combinatorial Applications

cs.IT ·2026-10-13 ·Gunank Jakhar, Gowtham R. Kurri, Suryajith Chillara, Vinod M. Prabhakaran
similarity 0.60
Abstract · 17 pages, 2 figures

Madiman and Tetali established strong and weak fractional inequalities that subsume classical entropy subset inequalities such as Han's inequality and Shearer's lemma. In this work, we derive a decomposition of the gap in the strong fractional inequality and use it to establish the necessary and sufficient conditions for equality in the strong form of Han's inequality. As a consequence, we characterize the equality conditions for a strong Loomis-Whitnet-type projection inequality of Balister and Bollobas (2012). Finally, we apply the weak fractional inequality to an extremal graph theory problem, recovering and extending results of Sason (2022) and Boucheron et al. (2013), whose approaches rely on Han's inequality.

0.37