CS Paper Radar

Learning to Decode Linear Codes with Generalized Belief Propagation Network

Samira Malek

cs.AI ·submitted 2026-11-04 18:29 UTC · v1

Abstract

Error correcting codes are a fundamental component of communication systems, enabling reliable data transmission over noisy channels. Recently, neural decoders have demonstrated notable performance gains over classical iterative algorithms. In this paper, we propose a Generalized Belief Propagation Network (GBPNet) that preserves message-passing symmetry while enhancing the decoder's learning capability. The architecture uses cascaded variable-node updates and learned element-wise message scaling while retaining the Tanner graph structure. We also introduce two training strategies, progressive training and high-SNR training, that improve decoding accuracy. Experimental results on several linear codes show that GBPNet achieves lower bit error rates than conventional belief propagation and the evaluated state-of-the-art neural decoders.

Closest papers

Nearest neighbours by meaning across the whole index.

Joint End-to-End Training of Weighted BP Decoder Ensembles

cs.IT cs.LGeess.SP ·2026-10-24 ·Felix Krieg, Paul Bezner, Stephan ten Brink
similarity 0.61
Abstract · 6 pages, 7 figures, submitted to an IEEE conference for possible publication

Ensemble decoding improves decoding reliability by combining component decoders with complementary failure events. Existing approaches typically obtain this diversity from code-specific structure, such as code automorphisms, multiple parity-check representations, or targeted modifications of the message-passing graph. In this work, we instead learn the diversity of an ensemble of weighted belief propagation decoders by jointly optimizing trainable Tanner-graph edge weights. A central design question is how the training objective should distribute gradient among the ensemble members to promote complementary decoding behavior. To this end, we compare four ensemble objectives under direct gradient-based optimization and identify best-member training as the most effective approach. For a (64,32) progressive edge-growth (PEG) low-density parity-check (LDPC) code, the resulting ensemble outperforms the considered trained and untrained belief-propagation-based ensemble baselines. With 10 members, it provides a gain of approximately 0.66 dB over a single belief propagation decoder at a target frame error rate (FER) of $10^{-4}$. Similar behavior is observed for a (128,64) CCSDS LDPC code, indicating that the learned complementarity is not specific to PEG. Although the ensemble performance improves substantially, all trained members show a higher standalone FER. The gain therefore results from learned specialization and complementary failure events rather than uniformly improved component decoders.

0.26

Logical Neural Belief Propagation for Linear-Complexity Decoding of Surface Codes

cs.IT quant-ph ·2026-08-27 ·Hee-Youl Kwak, Seong-Joon Park, Dae-Young Yun, Eliya Nachmani, Jae-Won Kim
similarity 0.58
Abstract · 15 pages, 8 figures

Quantum error correction (QEC) requires accurate and efficient decoders, yet belief propagation (BP), despite its linear decoding complexity, often provides insufficient logical accuracy on surface codes. We propose Logical Neural Belief Propagation (L-NBP), a BP-based neural decoder that redirects the decoding objective from physical-level to logical-level decoding. L-NBP uses a neural BP (NBP) module to produce posterior beliefs, which a logical classifier transforms into a continuous-valued soft syndrome for logical-operator prediction. Trained end-to-end by backpropagation, the NBP module learns soft syndromes that are favorable for logical classification. On surface codes, L-NBP matches or outperforms BP with ordered-statistics decoding (BP-OSD) and minimum-weight perfect matching (MWPM) while retaining the linear complexity of BP, and achieves a threshold of $17.5\%$ under depolarizing noise. Under circuit-level noise, L-NBP matches the accuracy of BP-OSD on the distance-$9$ surface code while requiring only $0.2\%$ of its complexity.

0.42

Error-correcting codes without parity-check bits

cs.IT ·2026-11-15 ·Boris Ryabko, Ivan Baksheev, Vyacheslav Zhuravlev
similarity 0.58
Abstract

We are developing a new approach to the problem of error correction in communication channels, in which the input sequence is transformed in such a way that the interdependence of symbols increases significantly. Then, after the sequence is transmitted over the channel, this property is used for error correction, so that the residual error rate is significantly reduced. A natural example of its application is the transmission of binary sequences whose entropy (per symbol) is less than one, since in this case the length of the transmitted sequence remains constant during encoding and decoding. An algorithm has been developed to implement the maximum likelihood method, in which the encoding and decoding times are linear. This algorithm was used to experimentally investigate its effectiveness on popular channel models, and it was found that there are certain sets of parameters for which the proposed method is quite effective.

0.16

Iterative Semantic Decoding for Short Block Codes

cs.IT ·2026-09-03 ·Jiafu Hao, Chentao Yue, Mingcheng Nie, Branka Vucetic, Yonghui Li
similarity 0.57
Abstract · 5 pages, 4 figures

This paper proposes an iteratively enhanced semantic receiver for natural-language text transmission over noisy wireless channels using multiple short block codes. At the transmitter, each sentence is permuted by a character-level interleaver, partitioned into segments, and independently encoded by short block codes. At the receiver, we develop an iterative decoder consisting of a channel decoder and a language model, where a de-interleaver between them disperses the burst decoding errors within each segment across the sentence. In each iteration, the language model denoises the channel decoding output, and the denoised characters verified to be consistent with the channel observations are fed back to the channel decoder as semantic information for the next iteration. Simulation results on the Stanford Natural Language Inference (SNLI) corpus over the additive white Gaussian noise (AWGN) channel show that the proposed receiver achieves approximately 1.5 dB block error rate (BLER) gain over conventional short-block coding, while maintaining BLEU and ROUGE scores above 99% at SNRs beyond 1.0 dB.

0.42

Nonlinear Posterior-Mean Feedback Codes for AWGN Channels

cs.IT ·2026-10-04 ·Yingyao Zhou, Natasha Devroye, Milos Zefran, Gyorgy Turan
similarity 0.56
Abstract

Feedback can improve the reliability of communication over additive white Gaussian noise (AWGN) channels. Classical feedback codes are interpretable, or easy to understand, but often rely on linear estimation, while deep-learned feedback codes can achieve strong performance but require many learned parameters and are often black boxes that are difficult to interpret. In this work, we propose a new posterior-mean feedback coding framework for AWGN channels with feedback. The proposed scheme uses posterior-mean refinement to construct nonlinear feedback codes under both noiseless passive feedback and noisy active feedback, with maximum a posteriori (MAP) decoding at the receiver. This scheme is analytically described, but a few learned parameters related to power allocation, and hence we consider this an ``interpretable,'' or human-understandable code. We further develop a projection-based design to improve robustness under noisy feedback and support larger message sizes. Numerical results show that the proposed schemes achieve strong finite-blocklength performance and outperform several analytical and learned feedback coding baselines, while using only a small number of learned design parameters.

0.21

Low-Latency LDPC Decoding Based on Consensus and Return Residual Belief Propagation

cs.IT ·2026-10-09 ·Allan E. Feitosa, Rodrigo C. de Lamare
similarity 0.56
Abstract · 16 figures, 21 pages

We propose two new decoding algorithms for low-density parity-check (LDPC) codes. The Consensus and Return residual belief propagation (C&R-RBP) algorithm reduces the number of iterations required to achieve a target decoding error rate over an AWGN channel by exploiting the availability of updated information, thereby mitigating the performance degradation caused by the greedy behavior of RBP-based algorithms and reducing error propagation. The Consensus and Delayed Return RBP algorithm (C&DR-RBP) achieves better performance in the early decoding iterations than C&R-RBP, making it particularly suitable for low-latency applications. Both proposed methods maintain the same computational complexity as the original RBP algorithm in terms of residual calculations. We also provide a formal analysis showing that the Consensus mechanism increases the probability of correct bit decisions under initial decoding conditions and in the presence of severe bit transmission errors, providing insight into the performance gains observed in the simulations. Numerical results based on the rapidly growing 5G New Radio (NR) standard, considering different code lengths, code rates, and channel models, demonstrate that both methods outperform competing RBP-based algorithms with similar overall computational complexity in terms of frame error rate (FER) and bit error rate (BER).

0.24

Recurrent Bipartite Graph Neural Networks for QC-MDPC Error Decoding in McEliece Cryptosystems

cs.CR cs.LG ·2026-10-28 ·Parth Rajeshkumar Tandel, Elisabeth Fink
similarity 0.56
Abstract · 19 pages

As the advent of large-scale quantum computing threatens classical encryption, Quasi-Cyclic Moderate Density Parity-Check (QC-MDPC) codes have emerged as a foundational element of Post-Quantum Cryptography (PQC). However, decoding these relatively dense codes using classical Belief Propagation algorithms often leads to failures caused by short graph cycles that stall the decoder. In cryptographic applications, these failures are severe security vulnerabilities that leak secret key information. To address this, this paper proposes a Recurrent Bipartite Graph Neural Network (R-BGNN) as proof of concept. By integrating Gated Recurrent Units (GRUs) into the message-passing framework and employing a multi-topology curriculum training strategy, the R-BGNN actively learns to break limit-cycle oscillations. Evaluated across 20 unseen matrix topologies, the proposed architecture significantly outperforms classical Bit-Flipping and Min-Sum baselines, reducing the Decoding Failure Rate (DFR) by 63.7\% at moderate noise levels ($t=10$) while converging in fewer iterations.

0.38

Certified Adaptive List Decoding for Error-Correcting Codes

cs.IT cs.LG ·2026-10-20 ·Jaeho Hwang, Byung-Sun Won, Uiwon Hwang
similarity 0.56
Abstract

Maximum-likelihood (ML) decoding of linear block codes is NP-hard, so neural decoders are evaluated by how closely they approach it. We observe that proving a candidate optimal can be far easier than finding it, and build a decoder that does both. We cast decoding as a search over an absorbing-state discrete diffusion model, whose sequential commitment of coordinates turns generation into a tree, and run a probability beam search over it. A dual bound from a linear-programming relaxation and a distance-based test, both derived from the code, then certify per frame that the current candidate is the global ML solution; because both are theorems, certified frames incur no accuracy-computation trade-off. Across $15$ codes and five operating points we certify up to $99.9\%$ of frames, the two tests dividing the space as their derivations predict, one strong for sparse parity-check matrices and the other for codes with a large minimum distance. Certification also behaves as a per-frame reliability signal, with $96.7$-$100\%$ of all frame errors falling on uncertified frames. Against an exact ML reference at $5$ dB the decoder is within one standard deviation on three of the four codes where the reference is uncensored, and against four neural baselines it attains the best bit-error rate in $71$ of $75$ cells.

0.31