CS Paper Radar

Geometric Inductive Biases for Semi-Supervised Equalization: The Constellation-Aware Transformer

Avi Caciularu

cs.LG cs.ITeess.SP ·submitted 2026-09-27 15:58 UTC · v1
top venueposition

Abstract

Decoding signals over unknown channels with minimal pilot overhead is a critical challenge in next-generation communications. Existing deep learning approaches typically rely on generic encoders that struggle to model long-range temporal dependencies or efficiently capture the channel's physical properties from scarce data. We argue that standard architectures suffer from agnostic estimation gaps, as they must implicitly learn the constellation geometry that is already known. We introduce the Constellation-Aware Transformer (CAT), a novel architecture that explicitly injects geometric inductive biases into the equalization process. CAT is composed of a stack of custom TransFIRmer blocks, which use an "early interaction" paradigm to co-process received signals and ideal constellation symbols. Each block features a split Feed-Forward Network that applies a Finite Impulse Response (FIR)-inspired filter for deconvolution and a parallel MLP for geometric refinement. We show that this design is structurally aligned with the optimal linear (MIMO Wiener) receiver: its attention can implement a matched-filter bank, and its bidirectional FIR branch provides the non-causal filtering that block MMSE equalization requires. In the semi-supervised setting, CAT needs fewer pilots than VAE and standard Transformer baselines: on two of our three ISI channels, it reaches a lower SER with 64 pilots than they do with 128.

Comment
accepted to NeurIPS 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Telling Neural Network What We Know: Weight Configuration for RNN and Its Application to NextG Real-Time Neural Receiver

eess.SP ·2026-10-22 ·Ummay Sumaya Khan, Lizhong Zheng, Lingjia Liu
similarity 0.60
Abstract

AI-enabled receivers offer a promising approach to adaptive physical-layer processing, but conventional neural receivers often require extensive offline training and computationally expensive backpropagation, limiting their suitability for low-latency cellular systems. Moreover, classical MIMO-OFDM receivers rely on accurate channel estimation, leading to substantial pilot overhead. This paper introduces skip-RNN, a lightweight skip-augmented recurrent neural receiver that performs online time-domain receive processing using fixed recurrent and skip branches with an adaptive linear readout. We show that the skip-RNN can be interpreted as a structured deconvolution filter whose recurrent and skip branches realize IIR and FIR basis functions, respectively. We develop a domain-knowledge informed weight-configuration framework for the skip-RNN by exploiting its structural correspondence with the target stable and causal inverse filter of mixed-phase channels. The dominant IIR structure extracted from estimated channel statistics is used to configure the recurrent dynamics, while the non-minimum-phase component is addressed through the skip branch and a statistical FIR readout prior incorporated into prior-centered regularized online readout adaptation. We further derive an approximation-error bound that characterizes the resulting configured neural-receiver representation. Simulations over standardized 3GPP channels demonstrate the effectiveness of the configured neural receiver under extremely low pilot overhead.

0.36

Learning Joint Synchronization, Channel Estimation, and Decoding: Comparison with a Finite-Blocklength Achievability Bound

eess.SP ·2026-10-30 ·Bingcheng Chen, Giuseppe Durisi, Christian Häger
similarity 0.59
Abstract · 6 pages

Learned schemes that jointly perform tasks such as synchronization and decoding have achieved promising results for short-packet communication. However, it remains unclear how close their performance is to information-theoretic bounds. To investigate this question, we extend the turbo autoencoder (TurboAE) proposed in Dörner et al. (2023) to a single-input single-output waveform channel with an unknown delay and memoryless block fading, for which an achievability bound from finite-blocklength information theory is available. Our extension incorporates a pilot-free, model-guided neural synchronizer and enables joint synchronization, channel estimation, and decoding. At a blocklength of $64$ complex symbols and a rate of one bit per channel use, the proposed TurboAE achieves a lower bit error rate (BER) than all evaluated pilot-assisted 5G baselines, with gains of $1.9$ dB at a BER of $10^{-3}$ over a baseline involving a low-density parity-check (LDPC) code and $1.7$ dB over a baseline involving a polar code and successive cancellation list decoding (list size $8$). In terms of block error rate (BLER), the TurboAE outperforms the LDPC-coded baseline, but lags behind the polar-coded baseline by about $0.8$ dB at a BLER of $10^{-3}$. Moreover, all evaluated schemes remain at least $2.1$ dB away from a pilot-assisted achievability bound, indicating substantial room for improved designs.

0.29

A Gram-Attention Learning Framework for Spatially Non-Stationary Channel Estimation

eess.SP ·2026-09-22 ·Jiannan Wang, Xianghao Yu, Chenshu Wu
similarity 0.58
Abstract · 13 pages, 10 figures

As next-generation wireless systems migrate to high-frequency bands, extremely large-scale multiple-input multiple-output (XL-MIMO) is indispensable for combating severe path loss. However, the received path energy along the extremely large array aperture (ELAA) may exhibit spatial non-stationarity, rendering the conventional discrete Fourier transform (DFT) codebook inadequate for channel estimation (CE) due to its full-array angular representation. To address this mismatch, we propose a novel joint angle-subarray (JAS) codebook, where each codeword corresponds to an angular direction and a specific subarray. Spatially non-stationary CE is thus transformed into structured sparse support detection in the JAS domain. However, reliable support recovery remains challenging for conventional model-based methods. We therefore develop a signal processing and deep learning co-design framework, where data-driven JAS parallel support detection is followed by least-squares (LS)-based channel reconstruction. The matched filter response of each JAS grid is embedded into a high-dimensional feature vector. We then propose a Gram-attention module that incorporates the Gram matrix as a physical prior to guide feature purification, enabling the network to suppress leakage-related components while preserving support-relevant information of each grid. The purified features are passed to decoupled heads to infer the hierarchical sparse supports in the JAS domain. Finally, LS is performed over the low-dimensional dictionary constructed from the detected supports to retrieve path gains. Simulation results demonstrate that the proposed framework achieves the highest support detection F1-score and the lowest CE normalized mean square error (NMSE) among all baselines, while ablation studies verify the benefits of integrating the Gram-domain physical prior with data-driven representation learning.

0.19

ANNA: Attention-Free Neural Neighborhood Aggregation for Channel Estimation on Regenerative NTN Payloads

eess.SP ·2026-11-15 ·Miguel Camelo Botero, Nina Slamnik-Kriještorac, Johann Marquez-Barja
benchmarkhot direction similarity 0.58
Abstract

Accurate deep learning (DL)-based channel estimation (CE) for non-terrestrial network (NTN) uplinks must meet the processing, power, and latency constraints of regenerative payloads. We propose Attention-free Neural Neighborhood Aggregation (ANNA), a lightweight architecture combining per-resource block (RB) pilot projection, convolutional neighborhood aggregation, and shared reconstruction, with dense-grid expansion only at the output. Evaluation against learned and classical estimators uses paired waveform-generated datasets with receiver frequency correction enabled and disabled. With correction enabled, 16-bit floating point (FP16) deployment on a 10 W Jetson Orin NX achieves 0.372 ms 99th-percentile (P99) latency and 2.15 dB lower mean normalized mean-squared error (NMSE) than the fastest learned baseline at 29.6% higher latency. Relative to the most accurate learned baseline, ANNA is 4.08 times as fast and consumes 80.5% less module energy per sample, with a 1.14 dB accuracy penalty. It meets the adopted 0.5 ms P99 target in all 100 benchmark runs, demonstrating a favorable accuracy-latency-energy trade-off for embedded uplink CE.

0.25

Generative Deep Learning for CSI Feedback in Massive MIMO via Channel Distribution Prediction

eess.SP cs.IT ·2026-10-12 ·Liujia Yao, Changsheng You, Chao Zhou, Yi Gong, Chengwen Xing
similarity 0.58
Abstract

Existing deep-learning-based channel state information (CSI) feedback methods reduce feedback overhead by compressing high-dimensional CSI into low-dimensional representations and/or exploiting historical CSI to predict future CSI. However, these methods may become unreliable when user equipment (UE) suddenly changes its motion. To address this issue, we propose a prediction-aided coding (PAC) framework for generative CSI feedback, which adaptively encodes CSI based on predicted channel/CSI distributions and the observed CSI in real time. Each CSI frame is represented by multiple CSI tokens obtained without using historical CSI, making token generation robust to abrupt UE motion. In the first stage, the conditional distribution, instead of a deterministic value, of the next-frame CSI tokens is predicted based on historical tokens. In the second stage, once the next frame arrives, the predicted distribution is used for variable-length entropy coding of its CSI tokens. To further reduce feedback overhead and inference latency, we propose efficient designs for both stages. For the first stage, a customized causal Transformer with a new positional embedding strategy accurately predicts next-frame token probabilities. For the second stage, a parallel causal decoding strategy reduces the inference latency caused by sequential token decoding. Extensive experiments show that, compared with existing history-aware baselines, PAC reduces feedback overhead by approximately 72% to 84% while achieving higher reconstruction accuracy. Additionally, PAC maintains CSI reconstruction accuracy under random-walk trajectories, whereas existing history-aware baselines suffer sharp degradation in reconstruction accuracy.

0.20

Digital Twin Enhanced Channel Twin for AI-Native CSI Inference: Generalizability and Scalability

eess.SP ·2026-09-22 ·Majumder Haider, Imtiaz Ahmed, Zoheb Hassan, Danda B. Rawat, Huaiyu Dai
similarity 0.57
Abstract

Accurate channel state information (CSI) is critical for advanced multi-antenna wireless networks. While high-fidelity and site-specific ray-tracing (RT) equipped wireless digital twins can overcome overhead for CSI acquisition. However, computing deterministic, calibrated RT based CSI from a wireless digital twin for every orthogonal frequency-division multiplexing (OFDM) symbol violates the strict microsecond latency budgets of the 5G NR numerology. To overcome this computational bottleneck, this paper investigates three approaches within a calibrated 3D digital twin framework, namely (i) the generalization of the channel twin, (ii) the performance enhancement using a neural receiver, and (iii) a data-driven interpolation framework for scalability. We compute high-precision CSI for a sparse subset of temporal anchors and employ an attention-based Transformer to predict the remaining symbols. Unlike polynomial splines or sequential long short-term memory (LSTM) networks, the Transformer exploits a global receptive field to capture the non-linear multipath dynamics while enabling parallelizable, real-time inference. To achieve spatial scalability, we introduce channel twin generalization. By fine-tuning the 3D RT models alongside the Transformer, the framework leverages the CSI dataset of one location to infer the channel behavior of an unseen environment. Transfer learning further adapts the model to a new environment using only a small fraction of locally collected data. Simulation results demonstrate that the proposed architecture substantially outperforms the baseline interpolators, achieves robust spatial transferability, and lowers the bit error rate through the unified neural receiver. These results establish a scalable, environment-agnostic foundation of distributed channel twins for high-quality, low-overhead CSI acquisition in next-generation cellular networks.

0.25

PACT: A Decoder-Confidence-Guided Two-Round Receiver for Joint Channel and Phase-Noise Estimation in Sub-THz OFDM

cs.LG eess.SP ·2026-11-13 ·Ruilin Wang, Xiaodai Dong
benchmark similarity 0.57
Abstract

Frequency-selective fading and oscillator phase noise (PN) jointly impair coded sub-THz OFDM reception. We propose a decoder-confidence-guided two-round receiver combining a {pilot-aware complex transformer} (PACT) estimator, banded linear minimum mean-square error equalization, and neural normalized min-sum decoding. PACT jointly estimates the frequency-domain channel and effective time-domain PN through interacting complex-valued branches. Decoder-derived pseudo-pilots and continuous constellation-aware confidence guide second-round refinement through PACT inputs and attention, with parameters shared across rounds. At $E_b/N_0=30$~dB, the PACT receiver achieves approximately $70\%$ and $57\%$ lower code-block error rates than the best-performing learning-based baseline in the two benchmark settings, respectively. Frozen-weight tests further demonstrate applicability across channel/PN models, carrier frequencies, and FFT/bandwidth configurations.

0.25

Over-the-Air Semantic Alignment via Dual Stacked Intelligent Metasurfaces

eess.SP cs.LGstat.ML ·2026-11-14 ·Mario Edoardo Pandolfo, Kyriakos Stylianopoulos, George C. Alexandropoulos, Paolo Di Lorenzo
hot direction similarity 0.57
Abstract

Semantic communications enable task-oriented information exchange, but suffer from latent-space mismatch when transmitter and receiver employ heterogeneous machine learning models. Existing semantic alignment methods rely on digital processing, introducing computational and latency overhead. This paper proposes a dual stacked intelligent metasurfaces (dual-SIM) architecture that performs semantic alignment entirely in the wave domain. By jointly exploiting programmable metasurfaces at both ends of a link and the wireless channel, the proposed architecture realizes an end-to-end linear transformation between heterogeneous latent spaces. We show phase-only multilayer SIM can approximate both supervised linear aligners and zero-shot Parseval-frame equalizers. We investigate single-SIM, disjoint asymmetric and symmetric dual-SIM, and jointly optimized dual-SIM configurations, considering channel equalization and constructive channel exploitation. For joint design, we develop an alternating projected gradient algorithm with convergence guarantees to first-order stationary points. We further introduce a deep-unrolled network that unrolls gradient-based iterations to reduce computational cost of SIM reconfiguration under channel variations. Numerical results with heterogeneous vision transformer encoders show accurate semantic alignment from moderate to high signal-to-noise ratios. The joint and symmetric disjoint dual-SIM designs achieve the highest accuracy over compact channels, the joint design leads at shallow stack depths, and the advantage over single-SIM designs diminishes at equal depth.

0.29