CS Paper Radar

Attention-Aided MMSE with Ridge Denoising: How to Train under Noisy Channel Samples

TaeJun Ha, Hyeji Kim, Jeonghun Park

eess.SP ·submitted 2026-08-16 22:04 UTC · v1
published

Abstract

Deep neural channel estimators are typically trained with clean channel state information (CSI), which is unavailable in practical orthogonal frequency-division multiplexing (OFDM) systems. In pilot-based OFDM, naive noisy-target training is structurally biased because the pilot input and noisy full-grid target share the same noise realization, driving the estimator toward identity copying. To address this for Attention-aided MMSE (A-MMSE), we propose a ridge-regularized objective that penalizes the generated filter directly. In a stylized fixed-filter model, this penalty induces scalar shrinkage and recovers the scalar MMSE gain at an explicit penalty value. We further construct surrogate training targets by estimating the channel covariance via eigenvalue clipping of the noisy empirical second-moment matrix, without requiring clean CSI labels. On COST 2100 channels, the proposed Ridge-A-MMSE consistently outperforms the Noise2Noise (N2N) baselines considered in this paper, and the combination of ridge regularization and covariance shrinkage approaches the same network trained with clean CSI labels at high signal-to-noise ratios (SNRs).

Closest papers

Nearest neighbours by meaning across the whole index.

Learnable Pilot Design for OFDM-based Deep Joint Source-Channel Coding

eess.SP ·2026-10-19 ·Joohyun Shin, Jiwan Seo, Joonhyuk Kang
published similarity 0.59
Abstract · Accepted for publication in the 2026 IEEE 103rd Vehicular Technology Conference (VTC2026-Spring)

Recent advances in deep joint source-channel coding (DeepJSCC) have shown strong robustness to channel variations in wireless image transmission. However, its integration with orthogonal frequency-division multiplexing (OFDM) typically relies on fixed pilot patterns that are not optimized for receiver- side channel processing. This work introduces Pilot-Efficient DeepJSCC-OFDM (PE-JSCC), which learns pilot placement under a strictly fixed number of pilot symbols via a Gumbel- Top-k-based selector. The learned pilot placement improves end- to-end performance over the conventional Block-JSCC, Comb- JSCC, and Scatter-JSCC baselines. To support high mobility, the receiver incorporates a lightweight axial-attention-based inter- carrier interference (ICI) canceler and a CNN-based channel estimator. Simulation results show that PE-JSCC consistently outperforms fixed pilot patterns across diverse SNRs and remains robust over a wide mobility range.

0.36

Consistency Learning and Distillation for One-Step MIMO-OFDM Channel Estimation

cs.LG eess.SP ·2026-11-04 ·Fredrik Nguyen, Qiwen Wang
similarity 0.58
Abstract · 6 pages, 3 figures, 4 tables

Iterative neural channel estimators can improve recovery under pilot contamination, but repeated network evaluations increase inference cost. This paper develops observation-anchored consistency and Consistency Mid-Training (CMT) estimators for one-step channel estimation in multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) systems. Both estimators refine pilot-derived least-squares channel estimates in the delay-beam domain. Consistency learning couples endpoint predictions along noisy-to-clean paths. CMT then refines a compact consistency-trained student to predict a flow-matching teacher's endpoint from intermediate trajectory states. Across the evaluated SNR range, the compact CMT student reduces uncoded symbol error rate (SER) by 9.6-20.2% relative to the one-step flow-matching baseline (0.44-0.98 dB in logarithmic SER reduction), while using 74.5% fewer parameters and 73.0% fewer network multiply-accumulates.

0.31

Pilot-Projected Nonlinear Self-Interference Estimation with Simultaneous Uplink Training

cs.IT ·2026-10-16 ·Seyed Mohammad Azimi-Abarghouyi, Thomas Eriksson
similarity 0.58
Abstract

This paper considers nonlinear digital self-interference (SI) cancellation and uplink-channel estimation for single-antenna in-band full-duplex radios when a desired uplink pilot is present during SI training. In this setting, a rich nonlinear SI dictionary can absorb part of the structured pilot response, while its large and correlated set of basis functions can make reliable SI estimation difficult, particularly with limited training. During SI-coefficient estimation, we treat the unknown uplink channel as a nuisance parameter and eliminate it to obtain an equivalent reduced SI estimation problem on the orthogonal complement of the pilot convolution subspace. Since the projected nonlinear dictionary can remain ill conditioned, we develop two complementary full-dictionary estimators: a pilot-projected ridge estimator with Bayesian-information-criterion tuning (PP-RidgeBIC), which uses global ridge shrinkage, and a pilot-projected group-sparse Bayesian estimator (PP-GSBE), which learns branch-dependent Bayesian shrinkage from the data. These estimators offer two complementary operating points: PP-RidgeBIC favors computational efficiency, whereas PP-GSBE provides greater adaptivity to heterogeneous nonlinear SI components. Simulations show substantial gains in SI cancellation and uplink reception over non-projected and hard-selection alternatives; notably, PP-GSBE suppresses the residual SI below the noise floor with moderate training and consistently provides the strongest performance under nonlinear model mismatch.

0.24

Statistical Benefits of Fine-Tuning from Pretrained Initialization in Diagonal Linear Networks

cs.LG stat.ML ·2026-09-28 ·Alexandre Declèves, Etienne Boursier, Nicolas Flammarion
similarity 0.58
Abstract

Adapting pretrained models to downstream tasks with limited data has become a central paradigm in modern deep learning. Yet, despite its widespread practical success, how fine-tuning leverages information from pretraining remains poorly understood theoretically. We study fine-tuning from pretrained weights through the lens of sparse linear regression and two-layer diagonal linear networks. In our setting, pretraining provides information through the support (and signs) of the initialization predictor, which may contain coordinates relevant to the downstream task. We show how pretrained information reshapes the implicit bias and training dynamics, and can thereby reduce the sample complexity of recovering the target parameters and support. In particular, for a clean initialization with correctly inherited signs, we show that the required sample size is comparable to that of a weighted Lasso estimator that explicitly exploits the pretrained support through a suitably chosen regularizer. Our results thus show how information encoded in pretrained weights can be implicitly exploited by gradient-based fine-tuning, reducing the amount of data needed to recover a downstream task.

0.26

Minimax-optimal Scaling Laws in Ridge Regression via Transfer Learning

cs.LG stat.ML ·2026-10-16 ·Yalda Shabanzadeh, Diyuan Wu, Marco Mondelli
hot direction similarity 0.57
Abstract

Pretrained models are often reused across downstream tasks, motivating the question of whether this transfer learning procedure can provide a substantial performance improvement, namely, in terms of the scaling law. We address this question in the prototypical setting of high-dimensional regression, where (i) a pretrained \emph{source} model is trained via ridge regression, and (ii) a fine-tuned \emph{target} model is regularized via the $L_2$ distance from the source estimator. First, we establish a deterministic equivalent for the risk of this two-step procedure under both model and covariance shift. Next, by specializing the deterministic equivalent to a shared regression function and commuting power-law covariance spectra, we identify a regime where the resulting scaling law achieves the minimax-optimal exponent. Notably, in this regime, the optimal source regularization depends on source data only, indicating its universality across all targets. Furthermore, we show that the same optimal rate is achieved by performing the fine-tuning step via one-pass stochastic gradient descent. We support our theoretical analysis via experiments on both synthetic settings and language models.

0.19

Pilot Decontamination via Data-aided Channel Tracking in Cell-free Massive MIMO

eess.SP ·2026-10-21 ·Varad Deshpande, Ribhu Chopra, Kumar Appaiah
similarity 0.57
Abstract

As cell-free massive MIMO emerges as a promising technology for future wireless networks, robust channel estimation becomes increasingly important. Channel estimation relies on pilot transmissions, and with increasing number of users, pilot reuse inevitably introduces contamination that degrades channel estimation and symbol detection. This limitation is compounded by rapidly evolving channels, which render the estimates obsolete over time. To address both the problems, viz. pilot contamination and channel aging without additional pilot overhead, we propose a Kalman filter-based data-aided channel tracking strategy. By leveraging the symbol estimates as virtual pilots, the proposed approach successively refines the channel estimates over time. Unlike the conventional Kalman filter model, here, the observation model depends on symbol estimates, introducing symbol uncertainty that gets coupled with channel uncertainty. This requires a careful calculation of the innovation covariance matrices. Additionally, we discuss a stochastic-gradient-descent based tracking approach with low computational complexity. Extensive simulations are used to demonstrate that successive refinement progressively decontaminates the channel estimate, achieving lower channel estimation error and improved spectral efficiency.

0.29

SWAN-Rx: Efficient and Bandwidth-Scalable Neural Reception for MIMO-OFDM

eess.SP cs.ITcs.LG ·2026-11-15 ·Zhoubin Kou, Cong Shen
similarity 0.57
Abstract · This work has been submitted to IEEE for possible publication

We present a Scalable Windowed Axial-attention Neural Receiver (SWAN-Rx) for multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) systems. The receiver improves reception accuracy and reduces forward-pass computation while supporting frozen-weight reuse across bandwidth allocations and channel conditions. It combines a common resource-element representation of received observations and pilot context with alternating time-axis and local frequency-axis attention. Shared parameters and relative positional information permit soft detection across allocation lengths without inference-time parameter updates. At fixed subcarrier spacing, model configuration, and symbol count, bounded frequency neighborhoods give linear growth of forward-pass computation with bandwidth. Evaluations compatible with the 5G New Radio physical layer reuse weights trained on four physical resource blocks (PRBs) at up to 273 PRBs and on unseen channels. At the training bandwidth, SWAN-Rx achieves lower pre- and post-decoding bit error rates than the implemented three-step neural receiver (NRX) and DeepRx-MIMO baselines, with 16.9% and 39.7% fewer parameters and 56.3% and 35.7% fewer forward-pass operations, respectively. The same weights achieve lower pre-decoding error rates than these baselines throughout the evaluated bandwidth-extrapolation and 16-PRB channel-transfer tests, with an estimated 0.4-0.9 dB signal-to-noise ratio reduction relative to NRX at a pre-decoding error rate of $10^{-2}$ in the 16-PRB tests.

0.30

Fixed pilot sequences can overstate the gains of learned MIMO-OFDM receivers under power amplifier distortion

eess.SP ·2026-10-24 ·Mohammad Tasin, Al Imran
code/data similarity 0.56
Abstract

Neural-network receivers are proposed to undo the distortion of a power amplifier driven close to saturation, where it is most efficient. They estimate the channel from pilots, known symbols sent in every frame. The pilots pass through the same amplifier as the data, so the channel estimate carries a small error that depends on the pilot sequence. If one sequence is always sent, as by default in the Sionna simulator, the error never changes, and a network can learn it instead of undoing the amplifier. We tested this in simulated two- and four-antenna orthogonal frequency-division multiplexing links; results are for binary pilots at the highest signal-to-noise ratio tested. A network with separate weights for each subcarrier lowered the bit error rate by 14 to 22% with its training pilot but raised it by 2 to 18% with every other pilot tested, and longer training widened this gap. A convolutional neural receiver following an open-source tutorial gained 37 percentage points more on its training pilot than on unseen pilots after short training, and 9 points more after nine times longer training, much of which also appeared with a linear amplifier. The gap shrank with amplifier back-off but persisted where the in-band distortion meets the 5G limit. On a channel with short delay spread, smoothing the channel estimate across subcarriers without training lowered the error rate on all 107 pilot sequences tested, by 30% on average. Learned receivers should therefore be tested on unseen pilots and against such simple baselines.

0.29