CS Paper Radar

Neural Polar Codes for Source Coding

Bashar Huleihel, Ziv Aharoni, Haim H. Permuter

cs.IT ·submitted 2026-10-09 13:10 UTC · v1

Abstract

This paper presents a data-driven approach to lossless and lossy source compression using polar codes. Classical polar source coding achieves fundamental limits with low complexity for binary memoryless sources. However, for unknown q-ary sources with memory, successive-cancellation (SC) decoding requires an explicit source model and can be computationally prohibitive. We present analytical SC recursions and show that exact implementations scale quadratically with alphabet size and cubically with state-space size. To overcome these limitations, we develop neural polar decoders trained directly from data to approximate conditional distributions of synthetic polar coordinates without requiring an explicit source model. These learned distributions enable estimation of entropy rates, mutual information, and rate-distortion functions, and support explicit polar compression schemes. For lossless compression, we identify high-entropy polarized coordinates and reconstruct the remaining coordinates using the learned SC recursion. For lossy compression, we combine neural polar decoders with a neural test channel to estimate and optimize the mutual information-distortion tradeoff and construct an explicit lossy polar code. We also extend the framework to Wyner-Ziv compression with decoder side information by learning conditional polarized distributions and a reconstruction mapping. Experiments on memoryless sources, sources with memory, and real genomic data show that the learned decoders closely match analytical SC decoders when available and remain applicable when conventional methods are computationally infeasible or the source model is unavailable.

Closest papers

Nearest neighbours by meaning across the whole index.

Design of Polar Codes with Puncturing and Extending

eess.SP ·2026-09-22 ·Seokju Han, Inayat Ali, Bonghoe Kim, Jeongseok Ha
similarity 0.69
Abstract · 13 pages, 9 figures

This work proposes a novel polar code design scheme using puncturing and extending aiming to improve the successive cancellation list decoding (SCLD) performance. The proposed code design is conducted with Reed-Muller (RM) codes called \emph{base} codes. For a base code, puncturing is first performed to gain a degree of freedom, called \emph{transmission holes}. To this end, we develop a puncturing scheme minimizing the loss in the minimum distance of the base code. Then, we propose a novel extending scheme to produce additional bits which are transmitted through the transmission holes without rate loss. The extending scheme repeats some coded bits and/or intermediate bits induced during the encoding of base code. The repeated bits are decided in such a way to maximize the SCLD performance by utilizing reinforcement learning (RL). Moreover, we introduce a novel idea to reduce the learning space of RL, which greatly expedites the design of extended bits. While the proposed design scheme assumes RM codes as base codes, we show that it can be applied to various types of polar code. Simulation results show that the polar codes designed with the proposed scheme have notably improved SCLD performance compared to existing polar code designs.

0.25

Efficient capacity-achieving entanglement generation with application to pure-loss Bosonic channels

cs.IT quant-ph ·2026-10-02 ·Avijit Mandal, Christophe Piveteau, Henry D. Pfister, Joseph M. Renes
similarity 0.63
Abstract

While the ultimate limits on the rate of quantum communication over noisy channels are well-established, very few efficient coding schemes achieving these limits are known. This contrasts sharply with transmitting classical data over classical channels, where polar codes and low-density parity-check codes both efficiently achieve the classical capacity of any noisy channel. In this work we construct an efficient entanglement generation scheme which achieves the coherent information for a broad class of channels. For degradable channels in the class, which includes truncated versions of the pure loss Bosonic channel, the resulting scheme achieves the quantum capacity. The construction makes use of polar codes for two kinds of classical-input, quantum-output (CQ) channels: those with commuting outputs and those whose outputs are heralded mixtures of pure states. The former case is amenable to decoding by classical polar decoding algorithms, the latter by the belief propagation with quantum messages (BPQM) algorithm. To our knowledge, this construction is the first explicit and efficiently decodable protocol that achieves the energy-constrained quantum capacity of the pure-loss Bosonic channel.

0.21

Efficient Perturbation-Based SC Decoding for Long Polar Codes

cs.IT ·2026-10-20 ·Zhongjun Yang, Zhichen Liu, Li Chen, Xianbin Wang, Huazi Zhang
similarity 0.61
Abstract · Submitted to IEEE Transactions on Information Theory

Soft information perturbations can significantly improve the successive cancellation (SC) decoding performance of polar codes. This is an effective method for realizing low-latency yet high performance for long polar codes, since each perturbation-based SC (PSC) decoding can be performed in parallel. However, little theoretical insight has been revealed so far regarding its work rationale. This paper provides the theoretical analysis of the soft information perturbation. It reveals that PSC decoding improves the SC decoding performance through correcting the erroneous bit estimations, especially the first erroneous bit (FEB). It further validates that perturbing the soft information does not degrade the error-correction capability of SC decoding. Such revelations lead to the design of optimal perturbations that maximizes the FEB correction probability, resulting in an enhanced PSC decoding performance. Based on this, a novel hybrid PSC (HPSC) decoding is proposed. By introducing the random and biased perturbations, the HPSC decoding can better divert from the initial erroneous estimation and converge to the intended one. Our simulation results demonstrate that with the optimal perturbation, the HPSC decoding can achieve a similar performance as the cyclic redundancy check (CRC) aided SC list (CA-SCL) decoding, while avoiding path sorting and expansion.

0.21

Construction and Design of MPAC Codes

cs.IT ·2026-08-22 ·Fangbo Yi, Zuoxin Cai, Zhongjun Yang, Li Chen, Huazi Zhang +2 more
similarity 0.61
Abstract · This paper has submitted to IEEE Transactions on Information Theory

This paper proposes modified polarization-adjusted convolutional (MPAC) codes and their hybrid decoding that achieves an improved performance-complexity tradeoff. For MPAC codes, only a subset of the information bits undergo the convolutional transform. The output is then combined with the remaining information bits for the inner polar transform. Correspondingly, the convolutionally transformed bits are recovered by Fano decoding, while the remaining information bits are recovered by the successive cancellation (SC) decoding, constituting the hybrid Fano-successive cancellation (HFSC) decoding. The MPAC codes are further designed by the coset-wise analysis that characterizes the number of minimum weight codewords (MWCs). It is discovered that a partially convolutional transform can improve the codeword through utilizing the row combinations of the frozen set efficiently. This property enables the MPAC codes to outperform their prototype polarization-adjusted convolutional (PAC) codes and cyclic redundancy check (CRC)-polar codes. Furthermore, MPAC codes can be optimized by reducing the number of MWCs. Our numerical results demonstrate that, with a similar decoding complexity budget, the MPAC codes offer competent decoding performance when compared with PAC codes using Fano decoding and CRC-polar codes using SC list (SCL) decoding.

0.26

Semantic SCL Decoding for Polar Codes

cs.IT ·2026-10-26 ·Andy Huang, Chentao Yue, Branka Vucetic, Yonghui Li
similarity 0.60
Abstract · 6 pages, 6 figures, submitted to IEEE ICC for possible publication

Semantic error control coding (SECC) has emerged as a promising paradigm for improving communication reliability by exploiting the inherent structure and semantic dependencies of transmitted information. This paper proposes a semantic successive cancellation list (SCL) decoder for polar codes carrying natural-language text. A fine-tuned byte-level language model provides next-byte priors, which are converted into conditional bit costs and incorporated directly into the SCL path metric before each pruning step. This allows the decoder to jointly exploit channel reliability and source structure while retaining the conventional polar coding framework. The language model can also be invoked only for bytes whose channel decisions are unreliable, trading decoding performance for latency. Simulations for length-512 polar codes show substantial block error rate (BLER) improvements over conventional CRC-aided SCL (CA-SCL) decoding. At rate R=0.75 and list size L=16, the proposed decoder achieves more than 1 dB of gain in BLER compared to CA-SCL with the same L. Moreover, with L=8, it outperforms conventional CA-SCL with L=256 in terms of BLER, while requiring about one quarter of the decoding time of the latter in the evaluated software implementation.

0.18

Parallel Successive Cancellation Perturbation-Enhanced Decoding of Polar Codes via Offline Variance Design

cs.IT ·2026-09-28 ·Changwei Tu, Xuanyu Li, Kai Niu
theory similarity 0.58
Abstract

Successive cancellation perturbation-enhanced (SCP) decoding improves the performance of finite-length polar codes by performing multiple SC decoding attempts with receiver-side perturbations. However, many existing perturbation schemes generate or update subsequent perturbations according to the outcomes of previous decoding attempts, resulting in additional decoding latency. In this paper, we propose an offline variance design (OVD) method for parallel SCP (PSCP) decoding of short- and medium-length polar codes. First, we formulate the exact recovery objective conditioned on ordinary SC failure and classify failed frames by the position of the first genie-aided intrinsic error and the number of subsequent intrinsic errors. We also derive a consistent Gaussian representation of the perturbed channel that preserves min-sum SC hard decisions. Second, we construct a class-based approximation of the recovery objective using Gaussian approximation and backward recursions, accounting for both error correction and new errors introduced by perturbations. We prove that both the exact and analytical objectives are nondecreasing and exhibit diminishing marginal gains as independent branches are added. Third, we develop a greedy algorithm to select variances from a finite candidate set for a given code, signal-to-noise ratio (SNR), and number of perturbation branches. All variances are determined offline, allowing the original SC branch and all perturbation branches to start simultaneously. Simulations for rate-$1/2$ polar codes of lengths $64$, $128$, $256$, and $512$ show that OVD-PSCP achieves lower block error rates (BLERs) than conventional SCP with the same number of perturbation branches. The gains are larger for shorter codes and increase as the number of perturbation branches grows.

0.28

From Source Reconstruction to Predictive State Preservation: An Information-Theoretic Framework for AI-Native Communication

cs.IT ·2026-09-01 ·Yi Wang, Linglong Dai
similarity 0.58
Abstract

AI-native communication increasingly aims to support prediction rather than reproduce every detail of the source. This shift raises a basic question left implicit by conventional source coding: what should be preserved when the terminal goal is prediction? We take the source-induced predictive state as the fidelity object. It is the distribution of the specified future conditioned on the source observation and shared context. We show that this state is sufficient and minimal for exact predictive preservation. The terminal prediction loss then defines communication distortion as lost predictive performance rather than source reconstruction error. Under logarithmic loss, this distortion equals the conditional mutual information lost through communication. Using the receiver-side predictive state as a Bayes reference, we separate AI-receiver error into predictive value lost in communication, receiver-available value unusable by the model family, and family capability not realized by the deployed model. The same predictive state also suffices for matched compression. For finite-alphabet memoryless sources, access to the raw source gives no rate-distortion advantage over coding the state directly. Applying the same target-conditioned construction to sequential prediction reveals a dynamic boundary. A state induced by a fixed horizon is minimal for that horizon but may not support recursive updating as the target window shifts. Taking the entire future as the target yields a minimal full-future state that updates recursively and admits a Markov representation. Together, these results shift AI communication from source reconstruction to predictive-state preservation.

0.41

An SCL-Aware Design of PAC Codes

cs.IT ·2026-10-29 ·Tyler Kann, Shrinivas Kudekar, Matthieu R. Bloch
similarity 0.57
Abstract

We develop design methodologies for the rate profile of polarization-adjusted convolutional (PAC) codes tailored to successive cancellation list (SCL) decoding. The crux of our approach is two-fold: first is the creation of a modified density evolution Gaussian approximation (DEGA), called conditional DEGA (CDEGA), to analyze the decoding process in the presence of errors; second is the creation of a dangerous-path occupancy metric to find the conditional occupancy of bit-errors in a finite list. Our approach not only illuminates the role of rate-one precoding, but also provides insight into why certain information sets are particularly well suited to PAC codes. We demonstrate the usefulness of CDEGA and dangerous-path metrics with algorithms that create new information sets, as well as precoders that are extremely sparse yet competitive. In particular, we design codes of length $N \leq 512$ with various rates and list sizes, all of which offer at least half a dB gain over traditional PAC codes at an FER of $10^{-3}$ and improve upon state-of-the-art results.

0.30