CS Paper Radar

Feedback Capacity of Stationary Gaussian Channels: An Optimal Schalkwijk-Kailath Scheme

David Fay, Oron Sabag

cs.IT ·submitted 2026-09-10 18:01 UTC · v1
theory

Abstract

We consider channels with additive colored Gaussian noise and noiseless feedback. Kim's seminal work derived a stationary variational characterization of feedback capacity and further asserted that the capacity-achieving stationary input need not contain a feedback-independent Gaussian component. These results led to the construction of a simple coding scheme, based on the Schalkwijk--Kailath (SK) refinement principle, which was shown to be capacity-achieving. A recent note identified a gap in the proof of the feedback-independent component-removal assertion, thereby leaving the optimality of the SK scheme and subsequent results that rely on it incomplete. In this paper, we prove the component-removal assertion for channels with stationary Gaussian noise that has a rational power spectral density. Our proof uses a perturbation analysis of a convex optimization formulation of feedback capacity and, indeed, shows that every optimizer assigns zero power to the feedback-independent component. Using this stronger property, we construct from any optimizer an explicit SK coding scheme that achieves every rate below feedback capacity with doubly-exponentially decaying maximal error probability.

Closest papers

Nearest neighbours by meaning across the whole index.

A Hardy-Space Proof of the Filter-Only Gaussian Feedback-Capacity Formula

cs.IT ·2026-09-14 ·Jun Su, Yang Xu, Guangyue Han
theory similarity 0.68
Abstract

The feedback capacity of power-constrained channels with additive stationary Gaussian noise was formulated by Kim in [Kim, 2010] as an infinite-dimensional optimization over the spectrum of an independent stationary Gaussian component and a strictly causal feedback filter. Kim further asserted that the independent stationary component can be omitted. However, Derpich and Østergaard [Derpich and Østergaard, 2022] identified a gap in the original proof, leaving the original derivation of the filter-only capacity formula incomplete. In this paper, we establish the filter-only formula at the level of capacity suprema for noise spectra satisfying the Paley-Wiener condition. In particular, we show that polynomial feedback filters suffice in the capacity supremum, without a positive lower bound on the noise spectrum or a rationality assumption. Under a positive essential lower bound, a complementary approximation preserves the output spectrum and rate exactly, while its input power converges to that of the original pair. An interleaved AR(1) example connects these results with the SK(2) coding scheme. The argument does not assert attainment by a single filter.

0.34

KKTCode: Asymptotically Optimal Linear Codes for Noisy Feedback AWGN Channels

cs.IT ·2026-09-26 ·Hongjae Nam, Jonggyu Jang, Vishrant Tripathi, David J. Love
theory similarity 0.65
Abstract

The design of optimal causal linear feedback schemes for additive white Gaussian noise (AWGN) channels with noisy output feedback has remained an open problem for over 60 years. Prior work has focused on restricted policy classes, especially passive (uncoded) noisy output feedback, where only the transmitter performs feedback coding. However, passive noisy output feedback fundamentally lacks the degrees of freedom required to attain the information-theoretic performance limit in general. In this paper, we consider the active (coded) noisy output feedback setting, where both the transmitter and the receiver perform feedback coding. We then develop a constructive KKT-optimal active linear feedback design that asymptotically attains the Elias-Butman SNR converse bound, thereby establishing MSE/SNR optimality over the entire class of causal linear schemes. Furthermore, we prove that the optimal passive feedback solution is recovered as a special case of the active design. This passive solution admits a Geometric Toeplitz (GT) structure with a Chance-Love (CL)-style one-shot polynomial characterization, and can be computed with O(log T) complexity. Thus, our results provide an affirmative answer to the long-standing optimality question for noisy output feedback under causal linear feedback coding, and our numerical results support the theoretical findings.

0.18

On the Fundamental Limits of Bistatic ISAC Over Vector Channels

cs.IT ·2026-10-26 ·Dongsheng Peng, Lei Yu, Ping Chen, Jun Chen
theory similarity 0.59
Abstract

This paper studies the fundamental limits of bistatic integrated sensing and communications (ISAC) systems over vector channels. We first consider a class of parallel channels in which, on each component channel, the channel from the transmitter (Tx) to the communication receiver (Rx) is degraded with respect to the channel from the Tx to the sensing Rx, or vice versa, where the direction of degradation may vary across component channels. For this class of channels, we establish matching achievability and converse results, which yield a single-letter characterization of the capacity-distortion function $C(D)$. For parallel Gaussian channels with additive Gaussian states, the evaluation of the capacity-distortion-power function $C(D,P)$ under the squared error distortion measure reduces to a joint power and distortion allocation problem across the component channels. We then extend the analysis to general vector channels and derive single-letter lower and upper bounds on $C(D)$. In particular, for vector Gaussian channels with additive Gaussian states, we prove the optimality of Gaussian superposition coding without requiring a global degradation order between the communication and sensing channels, by combining the channel enhancement technique with a matrix extremal inequality based on Fisher information. This leads to an exact characterization of $C(D,P)$.

0.26

Nonlinear Posterior-Mean Feedback Codes for AWGN Channels

cs.IT ·2026-10-04 ·Yingyao Zhou, Natasha Devroye, Milos Zefran, Gyorgy Turan
similarity 0.59
Abstract

Feedback can improve the reliability of communication over additive white Gaussian noise (AWGN) channels. Classical feedback codes are interpretable, or easy to understand, but often rely on linear estimation, while deep-learned feedback codes can achieve strong performance but require many learned parameters and are often black boxes that are difficult to interpret. In this work, we propose a new posterior-mean feedback coding framework for AWGN channels with feedback. The proposed scheme uses posterior-mean refinement to construct nonlinear feedback codes under both noiseless passive feedback and noisy active feedback, with maximum a posteriori (MAP) decoding at the receiver. This scheme is analytically described, but a few learned parameters related to power allocation, and hence we consider this an ``interpretable,'' or human-understandable code. We further develop a projection-based design to improve robustness under noisy feedback and support larger message sizes. Numerical results show that the proposed schemes achieve strong finite-blocklength performance and outperform several analytical and learned feedback coding baselines, while using only a small number of learned design parameters.

0.21

Variable-Length Feedback Coding With Universal Decoding and Bandit Channel Selection

cs.IT cs.LG ·2026-10-27 ·Recep Can Yavas
theory similarity 0.59
Abstract · 34 pages, submitted to Transactions on Information Theory

We study variable-length feedback (VLF) coding over $K$ additive white Gaussian noise (AWGN) channels whose noise variances are unknown to both terminals but lie in a known interval. The receiver selects one channel at each time, conveys the selection over noiseless feedback, and must learn the channel qualities while decoding, to avoid overusing suboptimal channels. This setting, which we call the VLF-Bandit problem, combines VLF coding, universal decoding, and bandit channel selection. We develop two joint coding and channel-selection schemes. The VLSF-Bandit scheme is a single-phase variable-length stop-feedback (VLSF) scheme based on a Gaussian random codebook, a score formed from a ratio of likelihood mixtures, and the asymptotically optimal $\text{kl-UCB}^{++}$ bandit algorithm applied to the received power. The VLF-Bandit scheme sends the message in packets by Schalkwijk--Kailath transmission, uses its normalized outputs as noise samples to learn the variances, and lets its exploration packets carry message bits. We prove second-order achievability bounds for both schemes, which are first-order optimal. In the logarithm of the achievable codebook size, the magnitude of the $\log N$ coefficient, with $N$ the average decoding time, is a baseline of one plus a channel-exploration term for VLSF-Bandit. For VLF-Bandit, this magnitude is smaller, with a universal-decoding term replacing the baseline and a smaller channel-exploration term. The VLF-Bandit bound improves on the universal VLF bound of Yavas and Tan (2025) for $K=1$ and on the bound of an explore-then-commit strategy whenever $K\geq2$.

0.20

Deterministic Identification over Additive Gaussian Channels

cs.IT ·2026-08-27 ·Jonathan E. W. Huffmann, Holger Boche
similarity 0.58
Abstract · gap in proof

Modern communication systems impose strict demands on data rate, reliability, and power efficiency. In this context, emerging communication paradigms such as identification via channels have become an important topic in post-Shannon information theory, offering the potential for substantially higher identification rates than in conventional channel coding.Deterministic identification is particularly interesting for specialized communication scenarios because it provides a balance between implementation complexity and the communication gains due to higher identification rates. It is therefore a promising communication scheme for future communication systems, including molecular communication systems. Additive Gaussian channels, particularly the additive white Gaussian channel, are among the most important channel models for analyzing the performance of communication systems in information and communication theory. This importance stems from both their mathematical tractability and their ubiquitous appearance in practical applications. To date the deterministic identification capacity for additive Gaussian channels remains unknown even for the simplest case of the additive white Gaussian channel. In this paper, we establish tight bounds on the deterministic identification capacity of additive Gaussian channels by introducing a new perspective on deterministic identification. To this end, we apply results from lattice theory to obtain new capacity results.

0.10

Information Spectrum Methods for $\varepsilon$-Capacity Problems in the Theory of Mixed Multiple-Access Channels with Cost Constraint

cs.IT ·2026-09-16 ·Te Sun Han, Hideki Yagi
theory similarity 0.58
Abstract · 77 pages, 3 figures, the proof of Theorem 7 is fixed, necessary remarks are added

We study the $\varepsilon$-capacity regions of mixed multiple-access channels (MACs) with general mixture where the channel inputs are subject to a cost constraint from the information spectrum unified perspective. We first determine the $\varepsilon$-capacity results for additive MACs. We next give a single-letterized inner bound on the $\varepsilon$-capacity region for mixed memoryless MACs, and furthermore establish a single-letterized $0$-capacity region of the mixed memoryless MAC with finite alphabets in terms of the essential infimum of mutual informations for component channels. We also show that the MAC with additive Gaussian noise satisfies the strong converse property, which is stronger than the traditional strong converse theorem. We then focus on the quasi-static fading Gaussian MAC, for which we derive the $\varepsilon$-capacity region and show that it, in the case specialized to single-users, exactly coincides with the traditional $\varepsilon$-outage capacity region, thereby providing a Shannon-theoretic operational interpretation of the latter. We further verify that the $\varepsilon$-capacity regions coincide across four scenarios of CSI availability (no-CSI, CSIR, CSIT, and CSIRT). We also demonstrate that this coincidence generally fails for mixed MACs with general (not necessarily stationary or ergodic) components, and give a counter example to prove it. Finally, we extend these results to the $K$-user quasi-static fading Gaussian MAC.

0.21

Linear Coding of LTI Sources Over Vector Gaussian Channels: A Majorization Approach

cs.IT eess.SYmath.OC ·2026-08-30 ·Shihao Jin, Junhui Li, Shinji Hara, Wei Chen
similarity 0.57
Abstract · 16 pages, 7 figures

We study the design of linear time-invariant (LTI) encoder-decoder pairs for transmitting the state of a discrete-time LTI vector source over power-constrained parallel Gaussian channels with feedback. Two types of power constraints are considered. Under individual subchannel power constraints, a necessary and sufficient condition for designing an encoder-decoder pair that achieves bounded estimation error covariance (EEC) is established via two coupled majorization inequalities involving the subchannel signal-to-noise ratios and the antistable poles of the source. Under total channel power constraint, we derive the minimum total power required for a feasible encoder-decoder design by exploiting partial-order progamming under majorization order. An analytical optimal power allocation is obtained for the case of equal noise variances, which admits a water-filling interpretation; for general noise case, a sequential water-filling algorithm is developed. Our results reveal that the difficulty of transmitting a discrete-time LTI source via LTI coding is governed not only by its topological entropy, but also by the evenness of the log-magnitudes of its antistable poles. The design methods for feasible encoder-decoder pairs are also provided.

0.31