CS Paper Radar

Exact Common Information and Exact Channel Synthesis for Correlated Gaussian Sources

Lei Yu

cs.IT ·submitted 2026-08-26 16:54 UTC · v1

Abstract

In this paper, we resolve two conjectures posed by Yu and Tan in 2020 (in two separate papers published in the IEEE Trans. Inf. Theory). Specifically, we establish that: 1) the exact common information for a pair of $ρ$-correlated Gaussian sources is given by the conjectured expression $\frac{1}{2}\log\frac{1+ρ}{1-ρ}+\fracρ{1+ρ}$; and 2) the admissible region for the shared randomness rate and the communication rate in exact channel synthesis is exactly the conjectured one. These results yield two important consequences. First, for any $ρ>0$, the exact common information of a correlated Gaussian pair strictly exceeds Wyner's common information. Second, for $ρ>0$, the exact channel synthesis of such a pair requires strictly higher rates than the total-variation version. The proof combines an exact optimal-transport representation of the worst-case Gaussian cross-entropy, Fathi's Gaussian transport inequality, and a determinant inequality arising from the covariance structure of the conditional means.

Comment
16 pages, 2 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Exact Common Information and Exact Channel Synthesis for Correlated Discrete Sources

cs.IT ·2026-09-21 ·Lei Yu
similarity 0.76
Abstract · 12 pages

In this paper, we provide a single-letter characterization of the exact common information for a pair of correlated discrete sources, as well as a single-letter characterization of the admissible region for the shared randomness rate and the communication rate in exact channel synthesis.

0.14

Deterministic Identification over Additive Gaussian Channels

cs.IT ·2026-08-27 ·Jonathan E. W. Huffmann, Holger Boche
similarity 0.66
Abstract · gap in proof

Modern communication systems impose strict demands on data rate, reliability, and power efficiency. In this context, emerging communication paradigms such as identification via channels have become an important topic in post-Shannon information theory, offering the potential for substantially higher identification rates than in conventional channel coding.Deterministic identification is particularly interesting for specialized communication scenarios because it provides a balance between implementation complexity and the communication gains due to higher identification rates. It is therefore a promising communication scheme for future communication systems, including molecular communication systems. Additive Gaussian channels, particularly the additive white Gaussian channel, are among the most important channel models for analyzing the performance of communication systems in information and communication theory. This importance stems from both their mathematical tractability and their ubiquitous appearance in practical applications. To date the deterministic identification capacity for additive Gaussian channels remains unknown even for the simplest case of the additive white Gaussian channel. In this paper, we establish tight bounds on the deterministic identification capacity of additive Gaussian channels by introducing a new perspective on deterministic identification. To this end, we apply results from lattice theory to obtain new capacity results.

0.10

A Unified Framework for Characterizing General MIMO Channels

cs.IT ·2026-10-06 ·Zeyan Zhuang, Anzheng Tang, Xin Zhang, Dongfang Xu, Shenghui Song
similarity 0.64
Abstract

Modern MIMO systems are evolving toward higher-dimensional and more flexible architectures, such as distributed and holographic MIMO, offering substantial benefits while giving rise to increasingly complex channel correlation structures. This growing architectural diversity makes it difficult to characterize the fundamental limits of different MIMO systems on a case-by-case basis, motivating a unified analytical framework applicable across a broad range of architectures. This paper addresses this research gap by investigating a generally correlated Rayleigh channel whose vectorized form follows a general Gaussian distribution with an arbitrary covariance matrix. For that purpose, we first prove that the spectral norm of the channel matrix is bounded in the asymptotic regime where the numbers of transmit and receive antennas grow proportionally. We then derive a deterministic approximation for the ergodic mutual information, with an explicit convergence rate governed by the structure of the channel correlation. The approximation is characterized by a pair of matrix-valued self-consistent equations, for which we establish the existence and uniqueness of the solution and propose an iterative numerical algorithm. Furthermore, we develop a framework based on positive linear maps to analyze the stability of these equations, which can facilitate the spectral analysis of broader classes of random matrices. The proposed characterization unifies many existing results for structured MIMO channels as special cases while remaining applicable to a broad class of general MIMO architectures that are difficult to evaluate using existing analytical frameworks. To demonstrate its utility, we apply the developed theory to two representative systems, namely downlink distributed MIMO and uplink heterogeneous MIMO. Numerical results confirm the accuracy of the derived deterministic approximations.

0.17

A Self-Coupling Gaussian Extremal Inequality for Information-Constrained Optimal Transport with Applications to Rate-Distortion-Perception

cs.IT ·2026-10-18 ·Jiayang Zou, Jun Chen, Ayfer Özgür, Jia Wang
theory similarity 0.64
Abstract · 31 pages. Submitted to IEEE Transactions on Information Theory

How much mutual information is needed to achieve a target correlation between two copies of a prescribed distribution? We prove a sharp Gaussian extremal inequality for this self-coupling problem: among distributions with a fixed mean and covariance, the Gaussian has the greatest minimum information cost for meeting a positive semidefinite cross-covariance target. The inequality is strict for non-Gaussian distributions when the target is positive definite. The proof uses a midpoint gluing construction. Two Ornstein--Uhlenbeck half-bridges, each started from the prescribed endpoint law, meet at a common intermediate distribution and are joined by conditional gluing. Changing the Gaussian reference then turns the resulting relative-entropy bound into the desired extremal inequality. As a first application, scaling one endpoint of the self-coupling establishes Gaussian extremality for rate-distortion-perception with unlimited common randomness, under quadratic distortion and squared Wasserstein-2 perception measures. We also establish an analogous result for finite common randomness, where the problem involves two mutual information constraints associated with an auxiliary random variable. In that setting, we retain an intermediate observation on one half-bridge and balance the two information budgets simultaneously using the Poincaré-Miranda theorem.

0.36

Information Spectrum Methods for $\varepsilon$-Capacity Problems in the Theory of Mixed Multiple-Access Channels with Cost Constraint

cs.IT ·2026-09-16 ·Te Sun Han, Hideki Yagi
theory similarity 0.63
Abstract · 77 pages, 3 figures, the proof of Theorem 7 is fixed, necessary remarks are added

We study the $\varepsilon$-capacity regions of mixed multiple-access channels (MACs) with general mixture where the channel inputs are subject to a cost constraint from the information spectrum unified perspective. We first determine the $\varepsilon$-capacity results for additive MACs. We next give a single-letterized inner bound on the $\varepsilon$-capacity region for mixed memoryless MACs, and furthermore establish a single-letterized $0$-capacity region of the mixed memoryless MAC with finite alphabets in terms of the essential infimum of mutual informations for component channels. We also show that the MAC with additive Gaussian noise satisfies the strong converse property, which is stronger than the traditional strong converse theorem. We then focus on the quasi-static fading Gaussian MAC, for which we derive the $\varepsilon$-capacity region and show that it, in the case specialized to single-users, exactly coincides with the traditional $\varepsilon$-outage capacity region, thereby providing a Shannon-theoretic operational interpretation of the latter. We further verify that the $\varepsilon$-capacity regions coincide across four scenarios of CSI availability (no-CSI, CSIR, CSIT, and CSIRT). We also demonstrate that this coincidence generally fails for mixed MACs with general (not necessarily stationary or ergodic) components, and give a counter example to prove it. Finally, we extend these results to the $K$-user quasi-static fading Gaussian MAC.

0.21

Second-Order Asymptotics for the Gaussian Multiple-Access Channel at Corner Points

cs.IT ·2026-08-18 ·Vincent Y. F. Tan
theory similarity 0.63
Abstract · 28 pages, 4 figures

We establish exact second-order coding rate regions at the two corner points of the capacity region of the two-user Gaussian multiple-access channel. For any average error probability $\varepsilon\in(0,1)$, we characterize the $n^{-1/2}$-scale fluctuations of achievable rates around each corner point, proving a converse that matches the previously known achievability bound. The proof first extracts a rectangular subcode that preserves the independence of the two transmitted codewords. The Polyanskiy--Verdú good-code output distribution theorem then yields log-determinant constraints that induce a spectral decomposition of a trimmed codebook into diffuse and exceptional subspaces. An entropic Brascamp--Lieb projection inequality controls the codeword inner product on the diffuse subspace, while variance-inflated Gaussian output distributions handle the low-dimensional exceptional subspace. Combining these two treatments yields the joint Gaussian limit required for the matching second-order converse.

0.47

Universal Decoding for Gaussian MIMO-ISI: Spherical Ensembles and Symmetric Neighborhoods

cs.IT ·2026-11-06 ·Nir Elkayam, Meir Feder
theory similarity 0.63
Abstract · 24 pages, 1 figure

We construct a universal decoder for cyclic Gaussian multiple-input multiple-output channels with intersymbol interference and unknown channel taps and spatial noise covariance. Codewords are drawn independently and uniformly from a sphere of fixed total energy. Under stated bounds on frequency variation, the decoder attains the ensemble-average error exponent of informed maximum-likelihood decoding for fixed channels and channels with growing memory. We approximate the frequency response by a constant matrix within each frequency block. For this auxiliary channel, every matched log-likelihood is affine in a common sufficient statistic. At fixed received output, we compute the statistic density of an independent competitor. The decoder selects the candidate with the smallest statistic density, equivalently minimizing a weighted sum of residual log-determinants. The density and its support volume give an upper bound on the universal competitor probability. Affinity ensures that at least half of a suitable symmetric neighborhood of the transmitted statistic has matched likelihood no smaller than that of the transmitted word. Integrating a density lower bound over this half gives the matched competitor bound. These bounds establish equality of error exponents, which a Gaussian channel comparison transfers to the original channel. The same decoder attains the matched exponent for independent frequency blocks with prescribed energies satisfying the stated conditions. For energies proportional to block length, an additional gain condition ensures that this exponent is at least that of the total-energy spherical ensemble.

0.23

Channel dichotomies

cs.IT quant-ph ·2026-10-30 ·Aadil Oufkir, Mario Berta
similarity 0.62
Abstract · 34 pages, 4 figures

We study channel interconversion under non-signalling superchannels, where the asymptotic conversion rate is given by the ratio of the channel capacities. Our main result determines the second-order expansion of the optimal target length. Namely, when each channel has a single capacity-achieving dispersion, the coefficient is given by the inverse sesquinormal distribution, with parameters determined by the capacities and dispersions. The result extends state-dichotomy theory to channels: one superchannel approximates the target uniformly over inputs and maps every reference channel whose output is independent of its input to another such channel. As in state dichotomies, there are finite-error resonances where the second-order term vanishes, leaving an $O(\log n)$ remainder. Crucially, our new characterization cannot be obtained by concatenating channel coding and simulation protocols [Cao {\it et al.}~IEEE Trans.~Inf.~Theory (2024)]. Instead, the proof combines comparisons of binary hypothesis testing experiments with uniform Gaussian estimates and a construction that uses symmetry within type classes to satisfy the non-signalling constraints. Shared randomness assistance already suffices at first order, but we show that its second-order behaviour can differ strictly from the non-signalling case.

0.17