CS Paper Radar

WiFo-D: Wireless Foundation Model Based on Discrete Representations

Xinyu Pan, Boxun Liu, Chen Chen, Xiang Cheng

eess.SP ·submitted 2026-11-19 02:17 UTC · v1

Abstract

Wireless foundation models have shown strong generalization capabilities across heterogeneous wireless tasks and configurations. However, most existing models rely on continuous representations, limiting ultra-low-overhead channel state information (CSI) feedback, few-shot generalization, and robustness to noise. To address these limitations, this paper proposes a wireless foundation model based on discrete representations (WiFo-D), which learns multi-granularity discrete CSI representations. It comprises a CSI encoder, multi-codebook vector quantization, and a modulation-based decoder, with the learned token maps and quantized features supporting multi-rate CSI feedback, CSI reconstruction, and diverse CSI-related downstream tasks. Extensive experiments demonstrate strong CSI feedback performance at an ultra-low latent compression ratio of 1/32 with 3 bits per token, reducing normalized mean square error (NMSE) by more than 4.7 dB compared with the strongest baseline. Furthermore, for frequency-domain prediction with limited training samples, WiFo-D improves generalization and noise robustness over continuous-representation-based methods. The results also demonstrate its superiority across downstream tasks, including beam prediction, wireless localization, and line-of-sight/non-line-of-sight identification.

Closest papers

Nearest neighbours by meaning across the whole index.

WiFo-R: Wireless Foundation Model with Recurrent Channel Representation

eess.SP ·2026-11-08 ·Liu Xuanyu, Cao Keyi, Cheng Xiang
similarity 0.78
Abstract

Wireless foundation models learn transferable channel state information (CSI) representations across heterogeneous wireless systems. However, conventional grid-aligned representations couple feature sequence length to CSI dimensions, restricting the allocation of representation capacity to different propagation conditions and task requirements while increasing inference overhead. This paper proposes WiFo-R, a wireless foundation model that learns progressive channel representations with selectable capacity. A channel-query cross-attention encoder aggregates spatial, temporal, and spectral CSI information, while parameter-shared recurrent updates refine existing channel features and introduce additional latent tokens. Multi-mask, multi-depth self-supervised pretraining equips intermediate states with strong reconstruction capabilities, followed by task-aligned post-training for channel estimation and CSI feedback. WiFo-R supports temporal and frequency-domain channel prediction, channel estimation, and variable-rate CSI feedback, and transfers to localization and LoS/NLoS classification. Experiments across in-distribution and out-of-distribution channel configurations demonstrate accurate reconstruction, progressive performance improvements, and strong transferability. A single feedback encoder--decoder supports six payload lengths at fixed quantization precision, while cross-attention and selectable recurrent depth improve the accuracy--complexity trade-off for large-scale CSI observations.

0.23

Wireless Foundation Models: State-of-the-Art and Open Challenges

eess.SP cs.AI ·2026-09-04 ·Alonso M. Pacheco Huachaca, Juan J. Rodriguez Rodriguez, Ahmed Aboulfotouh, Nelson L. S. da Fonseca, Carlos A. Astudillo +1 more
survey similarity 0.71
Abstract

Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapting them to downstream tasks. However, the rapidly growing literature remains fragmented across modalities, pretraining objectives, architectures, adaptation strategies, and evaluation protocols, making it difficult to assess progress toward broadly transferable models. This survey provides a systematic analysis of WFMs for physical-layer applications. We first introduce the main WFM design components, including pretraining, backbone architectures, and downstream adaptation. We then organize the literature into five physical-layer task families: signal recognition and demodulation, channel representation learning, RF sensing and localization, beam management, and spectrum sensing and monitoring, while separately examining multi-task PHY models. Across these categories, we analyze how existing models are pretrained, adapted, and evaluated, with particular attention to downstream task diversity and the distinction between in-distribution, partial-shift, and out-of-distribution transfer. Our analysis shows that current WFMs provide increasing evidence of reusable wireless representations, but this evidence varies considerably across task families and evaluation settings. Differences in datasets, modalities, architectures, pretraining objectives, adaptation protocols, and distribution shifts make it difficult to determine which design choices drive transfer and generalization. We conclude by identifying open directions for improving data availability, evaluation rigor, generalization, efficient adaptation, and real-world deployment, providing a unified framework for understanding the current WFM landscape and the requirements for developing more reusable foundation models for future physical-layer wireless systems.

0.20

Scaling of Wireless Foundation Models via Representation Diversity and Multi-Branch Architectures

eess.SP cs.AI ·2026-10-03 ·Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid
similarity 0.67
Abstract

Wireless foundation models learn representations from unlabeled radio signals for reuse across downstream tasks. Scaling model capacity is a common strategy for learning richer representations and improving downstream performance. However, its gains are less consistent in wireless self-supervised learning when pretraining data are limited. We investigate objective diversity as an alternative scaling axis: different self-supervised objectives emphasize different signal properties, and combining their representations can preserve more information to enable diverse tasks. We develop a fusion framework that combines frozen representations from independent encoders trained through reconstructive, predictive, and contrastive learning. This provides a reference for the benefits of diversity, but requires the maintenance of multiple encoders. To retain these benefits within the parameter budget of a standard single-objective encoder, we introduce a jointly trained multi-branch architecture with a shared trunk and objective-specific branches. We pretrain on a heterogeneous corpus of spectrogram and channel state information data and evaluate six downstream tasks that span communication, sensing, and positioning. At an equal output embedding dimension, fusion outperforms the evaluated single-objective encoders on all six tasks while using roughly one-third of their parameters. The multi-branch architecture retains much of the fusion benefit within a single-encoder parameter budget. Representation analyses indicate complementary contributions across objectives, with much of the added benefit retained in components orthogonal to the reconstruction representation subspace. These findings support objective diversity as an effective strategy for scaling wireless foundation models.

0.11

Channel2World: A Wireless Foundation Model for RF Environment Representation

eess.SP ·2026-08-18 ·Hyung-Joo Moon, Joonkyu Jang, Kwang Soon Kim, Seong-Lyun Kim, Robert W. Heath +1 more
similarity 0.66
Abstract · 13 pages, 10 figures

Wireless channels are commonly treated as link-specific observations, although their multipath structure is governed by the surrounding radio-frequency (RF) environment. In this paper, we propose Channel2World, a wireless foundation model that learns a reusable environment-level representation from multiple-input multiple-output (MIMO) channel-position observations. The model aggregates channels collected within the same base-station-centered environment into a wireless world embedding using a Transformer-based encoder. The encoder is pretrained through context-query prediction, where context channels condition user equipment (UE) position and relative path-gain prediction for disjoint query channels. After pretraining, the encoder is frozen and used as a task-agnostic environment-conditioning module for downstream wireless models, enabling adaptation to unseen environments without site-specific fine-tuning. To learn an environment-level latent space that generalizes across deployments, we pretrain Channel2World using ray-tracing data from 26,000 environments, with approximately 5,000 channel measurements per environment. Evaluations on UE localization, beam-domain channel state information (CSI) reconstruction, and RF-observable geometry reconstruction show that the learned embeddings provide effective conditioning in unseen environments. For localization and CSI reconstruction tasks, embedding-based conditioning outperforms or remains competitive with site-specific fine-tuning, although fine-tuning requires task-specific labeled data and additional gradient-based adaptation. The embeddings also support the reconstruction of dominant reflector structures, indicating their utility as reusable environmental priors across tasks.

0.43

Wireless Physical-Layer Foundation Models: Architectures, Learning Paradigms, Applications, and Deployment

eess.SP ·2026-08-20 ·Mohammad Cheraghinia, Davide Buffelli, Liu Li, Mohammad Alhellani, Jaron Fontaine +4 more
hot direction similarity 0.66
Abstract

Foundation models, i.e., large neural networks pretrained on broad unlabeled data and adapted to many downstream tasks, have reshaped natural language processing and computer vision and are now being explored for the wireless physical layer. Wireless Physical-Layer Foundation Models (WPFMs) aim to learn transferable representations of signals such as channel state information (CSI), in-phase and quadrature (IQ) samples, and spectrograms so that a single pretrained backbone can support tasks ranging from channel estimation and prediction to localization and sensing while using limited task-specific data. This paper provides a dedicated review of WPFMs from learning design to practical deployment. We first establish the theoretical background, covering the neural architectures used for wireless signals, the self-supervised pretraining paradigms of masked modeling, contrastive learning, and generative pretraining, and the fine-tuning strategies that adapt pretrained models to downstream tasks. We then introduce a taxonomy that organizes existing models along five dimensions: architecture family, input modality and tokenization, pretraining objective, model scale and deployment target, and generalization capability. Building on this basis, we review applications across telecommunications, localization, and sensing, and, for each domain, analyze deployment feasibility by mapping model size to the memory, compute, and latency budgets of representative wireless hardware. Finally, we discuss model compression and efficient deployment, summarize the cross-cutting challenges, and outline open research directions. Our goal is to provide a reference that connects pretraining, architecture, and fine-tuning with the practical constraints of wireless systems.

0.47

Prior-Aided Masked Vector Quantization CSI Feedback for FDD Massive MIMO Systems

cs.IT ·2026-09-15 ·Yi Song, Tianyu Yang, Kangda Zhi, Shuangyang Li, Giuseppe Caire
similarity 0.65
Abstract

Downlink channel state information (CSI) feedback is a key bottleneck in frequency-division duplex (FDD) massive MIMO systems, as the user equipment (UE) must convey its estimated channel to the base station (BS) over a limited uplink (UL) budget. To improve CSI reconstruction accuracy under tight feedback constraints, we propose prior-aided masked vector quantization (PM-VQ), a learning-based separate source--channel coding (SSCC) feedback scheme conditioned on the average angle--delay power map---a compact representation of the channel second-order statistics available at both the UE and the BS. In PM-VQ, a prior-aided encoder maps the CSI to latent tokens, and a spatially-adaptive masking module (SAMM) scores and selects the most informative tokens within the feedback budget. The selected tokens are vector-quantized and fed back together with their positions, while an adaptive de-masking module (ADM) completes the latent representation at the BS before prior-conditioned decoding. To support variable-rate compression, a single model is trained over a range of selected-token counts, enabling operation across multiple feedback dimensions without retraining. We evaluate PM-VQ against three representative baselines on a Sionna-generated 3GPP TR~38.901 UMa dataset, focusing on the most challenging diffuse regime where channel energy is spread across many angle--delay coefficients. Simulation results show that PM-VQ achieves the lowest NMSE across all tested SNR levels and feedback dimensions in this regime. Moreover, the angle--delay power-map prior remains beneficial even when estimated from only a few channel realizations.

0.29

RFShape: An IQ-Pretrained Wireless Foundation Model for Heterogeneous IQ & CIR Representations

eess.SP ·2026-11-02 ·Mohammad Cheraghinia, Sebbe Van Der Smissen, Jaron Fontaine, Delia Rico, Eli De Poorter +1 more
similarity 0.64
Abstract · 17 pages, 12 figures, 8 tables

In wireless systems, foundation models have been proposed as alternative artificial intelligence models to replace task-specific models with a shared pretrained model that can be reused across many downstream applications (source separation, interference detection, localization, etc.). These wireless foundation models promise to reuse learned representations across diverse tasks, but choosing a foundation model also means choosing its input representation. For example, a model pretrained on spectrograms expects spectrograms, while one pretrained on in-phase/quadrature (IQ) samples expects IQ, limiting which pretrained model can be used for a given downstream problem. To remedy this, we present RFShape, a 7.4 M-parameter foundation model that breaks this coupling by adapting how a signal is presented to a shared pretrained encoder. RFShape is pretrained solely on synthetic IQ waveforms, without real captures, labels, or channel impulse responses (CIRs), and uses deterministic representation operators to support heterogeneous downstream inputs. Across ten tasks and nine datasets unseen during pretraining, the same encoder supports classification, ranging-error regression, and two-dimensional positioning. Representation selection alone increases 23-class radar recognition from 23.0% to 69.5% and short-range technology recognition from 70.8% to 97.1%. RFShape also outperforms CIR-pretrained ultra-wideband baselines by up to 12.7 percentage points for (N)LOS classification despite never observing CIRs during pretraining. These results show that foundation-model reuse need not be limited by the representation or modality seen during pretraining, and adapting how a signal is presented can extend a single pretrained encoder across heterogeneous wireless tasks.

0.30

JEPA-Inspired Latent Field Prediction for Sparse-Pilot MIMO-OFDM Channel Reconstruction

eess.SP cs.AI ·2026-10-27 ·Yuzhi Yang, Brahim Mefgouda, Hang Zou, Lina Bariah, Anis Bara +3 more
similarity 0.64
Abstract

Accurate acquisition of full channel state information (CSI) is essential for multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) wireless systems, while dense pilot-based estimation incurs substantial overhead. Directly minimizing the prediction error over raw CSI coefficients is fragile in realistic propagation environments, since small-scale fading, mobility, local scattering, and small spatial perturbations can induce large phase-sensitive variations. Nevertheless, wireless channels contain strong spatial, temporal, and frequency-domain correlations that can be more predictably represented in a latent propagation-field domain. Motivated by this observation, we propose a joint-embedding predictive architecture (JEPA)-inspired field world model, defined as a latent predictive model of the wireless propagation field, for sparse-pilot channel reconstruction. The model maps CSI observations into latent time-frequency tokens, predicts masked or future latent field states from historical multi-band context, and fuses the predicted latent prior with sparse noisy current pilots to reconstruct the full MIMO-OFDM channel. Ray-tracing experiments show that the proposed method improves normalized mean square error (NMSE) over pilot-only and direct reconstruction baselines, supporting latent field prediction as an effective prior for sparse-pilot channel acquisition.

0.10