CS Paper Radar

Joint End-to-End Training of Weighted BP Decoder Ensembles

Felix Krieg, Paul Bezner, Stephan ten Brink

cs.IT cs.LGeess.SP ·submitted 2026-10-24 09:26 UTC · v1

Abstract

Ensemble decoding improves decoding reliability by combining component decoders with complementary failure events. Existing approaches typically obtain this diversity from code-specific structure, such as code automorphisms, multiple parity-check representations, or targeted modifications of the message-passing graph. In this work, we instead learn the diversity of an ensemble of weighted belief propagation decoders by jointly optimizing trainable Tanner-graph edge weights. A central design question is how the training objective should distribute gradient among the ensemble members to promote complementary decoding behavior. To this end, we compare four ensemble objectives under direct gradient-based optimization and identify best-member training as the most effective approach. For a (64,32) progressive edge-growth (PEG) low-density parity-check (LDPC) code, the resulting ensemble outperforms the considered trained and untrained belief-propagation-based ensemble baselines. With 10 members, it provides a gain of approximately 0.66 dB over a single belief propagation decoder at a target frame error rate (FER) of $10^{-4}$. Similar behavior is observed for a (128,64) CCSDS LDPC code, indicating that the learned complementarity is not specific to PEG. Although the ensemble performance improves substantially, all trained members show a higher standalone FER. The gain therefore results from learned specialization and complementary failure events rather than uniformly improved component decoders.

Comment
6 pages, 7 figures, submitted to an IEEE conference for possible publication

Closest papers

Nearest neighbours by meaning across the whole index.

Row-Boosted Ensemble Belief Propagation for Short LDPC Codes

cs.IT eess.SP ·2026-08-10 ·Paul Bezner, Felix Krieg, Stephan ten Brink
similarity 0.76
Abstract · 6 pages, 9 figures, submitted to an IEEE conference for possible publication

Belief-propagation (BP) decoding of short and moderate-length low-density parity-check (LDPC) codes is limited by finite-length graph effects: a single decoder trajectory can become trapped or oscillatory even when an alternative trajectory would decode the received word. Existing ensemble-BP decoders create the required diversity through multiple parity-check matrices, automorphisms, modified schedules, subcodes, or altered update rules. We introduce row-boosted ensemble (RBE) decoding as a minimal decoder-side diversity mechanism: all ensemble members share the same parity-check matrix and the same BP kernel, and differ only in a small set of parity-check rows whose outgoing messages are boosted. On the 5G~NR BG1 \((144,96)\) code, RBE with \(32\) members lowers the frame-error rate of BP with \(20\) iterations (BP-20) from \(1.6\times10^{-2}\) to \(1.6\times10^{-3}\) at \(E_\mathrm{b}/N_0=4.0\,\mathrm{dB}\), outperforming saturated-min-sum and affine subcode ensembles of equal size. Increasing the ensemble size yields additional gains, indicating that RBE provides a scalable performance-complexity tradeoff. The gains transfer across 5G~NR block lengths and rates, to non-5G short LDPC codes, and across flooding and layered schedules.

0.43

When to Stop? Dynamic Early Termination of Sequential Ensembles

cs.IT eess.SP ·2026-08-11 ·Paul Bezner, Felix Krieg, Stephan ten Brink
similarity 0.67
Abstract · 6 pages, 6 figures, submitted to an IEEE conference for possible publication

Ordered-statistics decoding (OSD) post-processing substantially improves the performance of belief propagation (BP) ensembles, but it also removes their natural syndrome-based stopping criterion. The high computational complexity of ensemble decoding and OSD can be reduced by sequential activation of ensemble members paired with an early termination. Instead of a syndrome-based termination we therefore apply dynamic ensemble termination (DET) to sequential ensembles: members are evaluated one at a time and decoding stops when the estimated risk that an unseen member would correct the current decision falls below an offline-fitted threshold. With hardware-oriented design in mind, we instantiate the framework with layered normalized min-sum component decoders, a row-boosted ensemble, conditional low-order OSD on the dual code, and a conventional low-cost decoder gate. A decision tree estimates the residual risk from statistics of the current candidate list. Member-dependent thresholds then target a prescribed frame error rate (FER) loss. We validate this framework on mutliple IEEE 802.11 low-density parity-check (LDPC) codes with blocklengths \(648,1296\), and \(1944\) at rates \(1/2\) and \(5/6\). At each code's design point, where the full \(64\)-member list reaches an FER of \(10^{-3}\), the DET decoder processes \(1.04\) to \(1.15\) members on average. On the \((648,540)\) code, it reduces BP work by \(39\times\) and OSD activations by \(18\times\) against the full list while retaining an signal-to-noise ratio (SNR) gain of about \(0.4\,\mathrm{dB}\).

0.09

SECS: A Soft Ensemble-Combining Stage for Low-Latency Decoding

cs.IT eess.SP ·2026-08-10 ·Felix Krieg, Paul Bezner, Stephan ten Brink
similarity 0.66
Abstract · 6 pages, 8 figures, submitted to an IEEE conference for possible publication

Ensemble decoding is a promising technique for ultra-reliable low-latency communication, as it trades hardware parallelism for decoding latency by running M diverse belief propagation (BP) decoders in parallel. Conventional ensembles select their output from the candidates. Hence, decoding fails whenever no member finds the correct codeword. In this work, we show that shallow, diverse BP members are poor correctors, but excellent sorters. Based on this observation, we propose a soft ensemble-combining stage (SECS) that combines extrinsic messages after only a few iterations, yielding a reliability ordering whose most reliable positions are nearly error-free. A subsequent re-encoding stage (like ordered-statistics decoding (OSD)) converts this ordering into a near-maximum likelihood (ML) candidate codeword, at a fraction of the BP latency of a fully converged ensemble. We demonstrate the proposed scheme on three short codes: a (63,30) Bose-Ray-Chaudhuri-Hocquenghem code, an overcomplete PG(2,8) code, and a search-designed (105,53) cyclic code. In all cases, the SECS with OSD post-processing closes most of the gap to ML decoding, while significantly reducing the number of required BP iterations.

0.09

On the Adversarial Vulnerability of Neural Receivers with Unrolled LDPC Decoders

cs.IT cs.CRcs.LGeess.SY ·2026-10-21 ·Aakash Saini, Jafar Aco Mohammadi, Wolfgang Gerstacker
similarity 0.62
Abstract

Neural receivers for 5G New Radio (NR) match classical model-based receivers in link-level performance, but their robustness to adversarial perturbations at the receiver input remains underexplored. We show that standard gradient-based attacks applied end-to-end through an unrolled low-density parity-check (LDPC) decoder fail to significantly outperform a matched-power Gaussian perturbation. We identify the failure as gradient masking caused by tanh saturation in the boxplus operation of the belief-propagation (BP) check-node update, with a per-iteration gradient norm decay of more than four orders of magnitude across ten unrolled BP iterations. Based on this finding, we propose two structurally independent loss functions that restore attack efficacy. L_BP routes the gradient through the unsaturated early iterations via per-iteration supervision, while L_LLR is a margin loss on pre-decoder log-likelihood ratios (LLRs) whose gradient bypasses the LDPC decoder entirely. Both loss functions increase the block-error rate (BLER) by one to four orders of magnitude at matched perturbation power, with the results reproduced on both the Sionna NeuralReceiver and DeepRx. At low PSR, L_LLR-optimized perturbations achieve up to three orders of magnitude higher BLER on unseen channel realizations than LBP-optimized perturbations.

0.30

Learning to Decode Linear Codes with Generalized Belief Propagation Network

cs.AI ·2026-11-04 ·Samira Malek
similarity 0.61
Abstract

Error correcting codes are a fundamental component of communication systems, enabling reliable data transmission over noisy channels. Recently, neural decoders have demonstrated notable performance gains over classical iterative algorithms. In this paper, we propose a Generalized Belief Propagation Network (GBPNet) that preserves message-passing symmetry while enhancing the decoder's learning capability. The architecture uses cascaded variable-node updates and learned element-wise message scaling while retaining the Tanner graph structure. We also introduce two training strategies, progressive training and high-SNR training, that improve decoding accuracy. Experimental results on several linear codes show that GBPNet achieves lower bit error rates than conventional belief propagation and the evaluated state-of-the-art neural decoders.

0.25

Early Selection of Polar Ensemble Decoding with Successive Cancellation Style Component Decoder

cs.IT ·2026-10-25 ·Pin-Jing Li, Yu-Chih Huang
similarity 0.60
Abstract

Parallel ensembles of successive cancellation (SC)-style decoders improve error-rate performance by decoding multiple representations of the received vector. Conventional ensembles, however, keep every member active until completion. To reduce computational cost while retaining the diversity gain of ensemble decoding, we propose early ensemble selection (EES), which ranks members using intermediate decoding states and retains a prescribed numbers of members at each predefined selection stage. Within the EES framework, we propose two selection rules, namely path-metric-based selection (PM-EES) and neural-network-based selection (NN-EES). We analytically characterize the computational cost of EES through stage-dependent decoder log-likelihood ratio (LLR) update counts and provide an information-theoretically motivated criterion for choosing selection stages. Simulations on the \((128,64)\) extended BCH code and the \(\operatorname{RM}(4,8)\) code show that suitable selection schedules approach full-ensemble error-rate performance with fewer decoder LLR updates.

0.31

Achievability of CSS codes performance limits over Pauli channels under separate ML decoding with bounded graphical complexity

cs.IT quant-ph ·2026-11-02 ·Gulnihal Mercanoglu, Achilleas Anastasopoulos, S. Sandeep Pradhan
similarity 0.59
Abstract · 45 pages, 9 figures

Capacity-approaching quantum error correction faces a fundamental tension: the required parity-check matrices need to become increasingly dense, while practical decoding and syndrome extraction favor sparse, bounded-degree structures. Reconciling these competing requirements remains an important open problem in quantum code design. We construct Calderbank-Shor-Steane (CSS) code ensembles that approach the CSS rate over memoryless Pauli channels under maximum-likelihood decoding while retaining sparse, bounded-degree graphical representations. The construction separates parity-check density from graphical complexity: although capacity-approaching components may require dense parity-check matrices, they are represented by sparse concatenated factor graphs. We first study a construction combining low-density parity-check (LDPC) and low-density generator-matrix (LDGM) component codes and numerically analyze the average weight distributions of the resulting codes. Motivated by these results, we introduce a second construction based on concatenated LDPC and LDGM codes and generalized irregular repeat-accumulate (GIRA) codes. We derive bounds on the average weight distribution of the resulting sum ensemble and use the Miller-Burshtein framework to prove simultaneous reliability of the two CSS decoding components. Consequently, the proposed ensemble achieves rates arbitrarily close to the CSS hashing bound under separate bit- and phase-error correction, while maintaining bounded graphical complexity, thus providing a foundation for future iterative decoders and indirect syndrome-extraction architectures.

0.20

On the Multi-Weight Shift-Sum Iterative Decoding of Short BCH Codes

cs.IT eess.SP ·2026-10-12 ·Yinglei Yang, Di Zhang, Aimin Li, Yifei Shen, Alexey Frolov +1 more
publishedtheoryhot direction similarity 0.59
Abstract

This paper investigates a shift-sum decoding algorithm that employs dual codewords. Existing dual codeword shift-sum decoding schemes mainly rely on minimum-weight dual codewords. However, the number of such codewords is often limited, which restricts the amount of reliability information available to the decoder. To address this issue, we extend the component counting mechanism from minimum-weight dual codewords to dual codewords whose Hamming weights lie within a prescribed upper bound. We further introduce a normalized component counting rule to suppress the overcounting bias caused by the much larger populations of higher-weight classes. Based on this framework, we develop a hard-decision iterative error reduction decoder and a soft information-aided iterative error reduction decoder. Numerical results show that the proposed method consistently outperforms existing minimum-weight shift-sum baselines especially for short codes where additional dual codeword information is particularly valuable.

0.51