CS Paper Radar

Amortized Neural SVD for XL-MIMO: Structure-Guided Factor Prediction for Beamforming and Multi-Stream Utility

Yue Zhang, Yiyan Zhang, Ruijin Sun, Honggang Jia, Chen Gong

eess.SP ·submitted 2026-08-27 07:19 UTC · v1
published

Abstract

Singular value decomposition (SVD) is a core operation in multiple-input multiple-output (MIMO) beamforming, but the cubic complexity of standard SVD routines can lead to a major latency bottleneck as array dimensions scale to extremely large sizes. This paper presents a fully learned neural operator that avoids explicit SVD computation by directly mapping channel matrices to truncated low-rank factors for precoder and combiner design. In contrast to iterative numerical solvers and algorithm-unrolled networks, the proposed structure-aware model, termed SVDNet, produces these factors in a single forward pass at inference, shifting the per-instance decomposition cost to offline training. The model also includes lightweight constraints to enforce basic algebraic properties required by beamforming, such as semi-unitarity of the singular vectors and nonnegative singular values, without invoking matrix factorization kernels. Experiments on extremely large-scale MIMO channels with matrix dimensions up to 512*512 show that the proposed approach achieves spectral efficiency close to exact SVD-based beamforming in single-stream transmission and consistently improves multi-stream sum-rate over representative learned baselines, indicating good scalability for low-latency wireless processing.

Comment
Accepted for presentation at the 2026 IEEE 103rd Vehicular Technology Conference (VTC2026-Spring)

Closest papers

Nearest neighbours by meaning across the whole index.

Low-Rank Prior-Guided Rank-One Sensing for Efficient CSI Feedback

eess.SP ·2026-09-23 ·Shunpu Tang, Qianqian Yang, Seung-Woo Ko, Jihong Park
similarity 0.62
Abstract

Downlink channel state information (CSI) feedback is essential for frequency-division duplex massive MIMO, yet the feedback overhead grows rapidly with the numbers of antennas and subcarriers. To reduce this overhead, most deep learning approaches compress CSI by treating it as a generic image, leaving its low-rank multipath structure unexploited. In contrast, model-driven alternatives explicitly embed this structure in iterative recovery, but at the cost of high computational complexity and latency. To overcome these limitations, we propose a low-rank prior-guided (LRP) framework that performs learnable rank-one sensing at the user equipment to compress CSI into low-dimensional codewords, and reconstructs CSI by direct rank-one synthesis at the base station. Both compression and reconstruction are jointly optimized, and fully exploit the low-rank structure of CSI. We further develop DCRNetV2, which preserves LRP as its backbone and uses gated dilated-convolutional residual paths to compensate for finite-rank errors. Experimental results show that LRP outperforms iterative model-based methods with lower complexity, and DCRNetV2 achieves a better accuracy-complexity tradeoff than existing learning-based methods.

0.15

Ray-Tracing-Parameter-Based Lightweight Hybrid Precoding via Cascade XGBoost for Wideband Massive MIMO-OFDM Systems

eess.SP cs.IT ·2026-11-01 ·Po-Heng Chou, Wei-Chen Lin, Wan-Jen Huang, Walid Saad, Ronald Y. Chang
similarity 0.61
Abstract · 6 pages, 4 figures, 3 tables. Submitted to the IEEE International Conference on Communications (ICC) 2027

Hybrid precoding reduces the radio-frequency (RF) hardware burden in wideband massive MIMO-OFDM systems, but conventional optimization and deep neural network (DNN)-based approaches can incur high online complexity. This paper proposes XGB-SVD, a lightweight hybrid precoding framework that maps compact ray-tracing path parameters directly to analog beamforming codeword indices using cascade eXtreme Gradient Boosting (XGBoost). The cascade captures sequential beam-selection dependencies and transmit--receive propagation correlation, while the digital precoder and combiner are obtained from the reduced-dimensional equivalent channel using singular value decomposition (SVD). Evaluations over five DeepMIMO scenarios spanning sub-6-GHz and millimeter-wave bands show that XGB-SVD consistently outperforms the considered DNN baselines and approaches simultaneous orthogonal matching pursuit (SOMP) in several environments. Cross-scenario results further indicate improved transfer from propagation-diverse training environments, while XGB-SVD provides lower online computational and training costs than the DNN baselines.

0.37

Fronthaul-Efficient Cell-Free Massive MIMO via Stream-Adaptive Resolution Control

cs.IT eess.SP ·2026-08-12 ·Özlem Tuğfe Demir, Sinan Gezici
published similarity 0.60
Abstract · 5 pages, 2 figures, to be presented at IEEE SPAWC 2026

We consider the uplink of a fronthaul-constrained cell-free massive MIMO system with a single multi-antenna user equipment (UE) transmitting multiple spatial streams to distributed access points (APs). Due to heterogeneous channel conditions and limited fronthaul capacity, uniform-resolution quantization across APs and streams is highly inefficient. To address this, we propose a stream- and AP-adaptive resolution control framework that jointly optimizes the transmit power and per-AP per-stream quantization resolutions. By leveraging a distributed implementation of singular-value decomposition (SVD)-based processing, the data streams are decoupled at the APs, enabling flexible fronthaul compression across both spatial streams and APs. The resulting non-convex optimization problem is tackled using a weighted minimum mean-squared error (WMMSE)-based block coordinate descent algorithm with semi-closed-form updates.

0.21

Structured Channel Network Pruning with Bi-Sparse Matrix Factorization

cs.CV ·2026-10-31 ·Jingjing Liu, Ziyang Wang, Xianchao Xiu, Wanquan Liu
code/data similarity 0.60
Abstract

Structured channel pruning for convolutional neural networks (CNNs) plays an important role in pattern recognition and deep learning. Nevertheless, existing methods usually calculate channel importance scores based on the magnitudes of individual filters, making it difficult to distinguish shared redundancy from individual channel contributions. To tackle this limitation, we propose a novel structured channel pruning method termed bi-sparse matrix factorization (BSMF). Specifically, BSMF characterizes the convolutional weight matrix as output-channel coefficients over a shared basis with row-wise $\ell_{2,p}$-norm and column-wise $\ell_{2,q}$-norm regularization terms, respectively. Note that $p,q\in[0,1)$, which, to our best knowledge, has not been explored in the literature. To solve the resulting non-convex optimization problem, we develop an efficient update scheme built upon the alternating direction method of multipliers (ADMM), in which all subproblems admit closed-form solutions. After that, a compact CNN is obtained by reconstructing the convolutional filters from the learned factors and discarding the redundant channels. Extensive experiments on the CIFAR-10 and ImageNet-1K datasets demonstrate that our proposed BSMF achieves significant network compression while maintaining high reconstruction accuracy. The source code is publicly available at https://github.com/xianchaoxiu/BSMF

0.36

Learning Functional Subspaces for Neural Network Compression

cs.LG cs.CL ·2026-09-30 ·Massimo Bini, Anders Christensen, Stephan Alaniz, Judah Goldfeder, Ole Winther +3 more
similarity 0.60
Abstract

Modern transformers pair impressive capabilities with substantial memory and compute demands. Low-rank weight factorization reduces both while keeping the matrices dense, and thus efficient on standard hardware. Existing methods, however, choose the subspace to remove from each weight matrix with local closed-form criteria: activation energy, layer-wise reconstruction error, or a quadratic approximation of the loss. These criteria ignore how errors propagate through the network, so at high compression the errors compound with depth and performance collapses. We introduce Learnable Subspace Projections (LSP), which instead learns the subspaces to discard end-to-end. Each linear layer, or tied group of layers that read the same activations, is assigned an orthogonal projector. All projectors are optimized jointly against a global objective--the KL divergence to the dense model's output distribution or the model's original training loss--while the pretrained weights remain frozen. Projectors are initialized from a whitened SVD truncation, and ranks are allocated by the output KL each projector induces per parameter saved. After training, the projectors merge into standard low-rank factors, with each tied group sharing one factor. In attention, this also lets the model cache one narrow latent in place of full keys and values. Across LLMs (OPT-125M/1.3B, Qwen3-4B, Llama-2-7B) and ViT-B/16, LSP outperforms baselines, and its advantage widens as compression increases. At -70% compression, LSP brings Llama-2-7B to 10.9 WikiText-2 perplexity and 42.2% mean zero-shot accuracy, versus 13.3 and 36.0% for the strongest baseline. The factorized model decodes up to 1.6x faster than the dense model at small batch sizes, and aching the shared latent shrinks the combined memory of weights and KV cache by 13.5x at a 128k-token context, versus at most 6.5x for untied baseline factorizations.

0.20

Model-Driven Deep Learning with Rank-One Sensing for Efficient CSI Feedback

eess.SP ·2026-10-08 ·Shunpu Tang, Qianqian Yang, Seung-Woo Ko, Jihong Park, Kaibin Huang
code/data similarity 0.60
Abstract

Downlink channel state information (CSI) feedback is essential for beamforming optimization in frequency-division duplex (FDD) massive multiple-input multiple-output (MIMO) systems. However, the feedback overhead increases with the number of antennas and subcarriers, posing a major challenge to practical deployment. Although recent deep learning (DL)-based methods reduce this overhead by compressing CSI at the user equipment (UE) and reconstructing it at the base station (BS), most of them treat CSI as a generic image and rely on convolutional or Transformer architectures. As a result, the low-rank multipath prior is insufficiently exploited, while non-negligible computation is introduced at both the UE and the BS. To address this issue, we propose a low-rank prior (LRP)-guided CSI feedback framework that performs structured sensing and reconstruction directly over rank-one channel components. Specifically, the LRP encoder conducts learnable rank-one sensing to obtain path-aware measurements at the UE, while the LRP decoder reconstructs CSI through rank-one synthesis at the BS, avoiding the iterative recovery required by classical solvers. To compensate for finite-rank approximation residuals, we extend our previous DCRNet into DCRNetV2 by incorporating the proposed LRP backbone and gated dilated-convolutional residual branches. Experiments on multiple datasets and scenarios show that the proposed methods achieve a better accuracy-complexity tradeoff than existing model-based and DL-based baselines. In particular, standalone LRP achieves more than $10$~dB NMSE improvement over model-based baselines with much lower complexity, while DCRNetV2 achieves comparable accuracy to state-of-the-art Transformer-based methods with only about one-fifth of the complexity. The source code is available at https://github.com/tangshunpu/DCRNetV2.

0.22

Comparative Evaluation of Deep-Learning based DoA Estimators for Real-Time ISAC Beamforming

cs.LG ·2026-10-14 ·Anjali K. S., Manoj Kumar Panda, Chandramani Singh
similarity 0.60
Abstract

Integrated Sensing and Communication (ISAC) systems rely on accurate Direction-of-Arrival (DoA) estimation for effective beamforming and spectral-efficiency enhancement. While numerous classical and deep-learning-based DoA estimation methods have been reported in the literature, their suitability for real-time ISAC operation remains insufficiently understood because practical deployment requires consideration of both estimation accuracy and computational latency. This paper presents a unified evaluation framework for systematically comparing classical and learning-based DoA estimators within an ISAC beamforming pipeline. Representative classical and learning-based DoA estimators, together with an ensemble architecture, are integrated with Singular Value Decomposition (SVD)-based beamforming and evaluated under identical operating conditions. The impact of DoA estimation accuracy, inference latency, beamforming-weight generation time, and resulting effective spectral efficiency is investigated. Results show that different estimators occupy distinct operating points in the accuracy-latency-performance design space. Although learning-based approaches substantially reduce estimation time compared with MUSIC, the overall processing latency increasingly becomes dominated by the computational cost of SVD-based beamforming. Among the evaluated methods, the Regression Convolutional Neural Network (RCNN) exhibits a favorable balance between estimation accuracy, computational efficiency, and beamforming performance, making it a promising candidate for real-time ISAC deployment. The findings further suggest that future low-latency ISAC systems may benefit from beamforming strategies that reduce or avoid computationally intensive SVD-based beamforming-weight generation.

0.20

Learned Score-Based Turbo Message Passing for Channel Recovery From Spatially Compressed Measurements

cs.IT ·2026-10-13 ·Yiming Wei, Xiaojun Yuan
similarity 0.58
Abstract

Hybrid beamforming (HBF) reduces the hardware cost of massive MIMO base stations, but its channel acquisition requires recovering the full spatial-domain channel from highly compressed beam-domain observations. This paper proposes a learned score-based turbo message passing (L-STMP) framework for uplink HBF channel recovery under extreme spatial compression. By deeply unfolding the turbo message-passing loop and introducing trainable calibration parameters and learnable score priors in each layer, L-STMP liberates STMP from the idealized compression-matrix requirements of right-rotational invariance, and reduces inference complexity to only several unfolded layers. In addition, to preserve dominant channel components that random discrete Fourier transform (DFT) selection may miss, we introduce precoding matrix indicator (PMI)-assisted beam selection as a low-overhead directional prior. Simulation results demonstrate that L-STMP consistently outperforms existing baselines and obtains substantial reconstruction gains under PMI-assisted compression in channel reconstruction.

0.10