CS Paper Radar

Wireless Foundation Models: State-of-the-Art and Open Challenges

Alonso M. Pacheco Huachaca, Juan J. Rodriguez Rodriguez, Ahmed Aboulfotouh, Nelson L. S. da Fonseca, Carlos A. Astudillo, Hatem Abou-Zeid

eess.SP cs.AI ·submitted 2026-09-04 04:26 UTC · v1
survey

Abstract

Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapting them to downstream tasks. However, the rapidly growing literature remains fragmented across modalities, pretraining objectives, architectures, adaptation strategies, and evaluation protocols, making it difficult to assess progress toward broadly transferable models. This survey provides a systematic analysis of WFMs for physical-layer applications. We first introduce the main WFM design components, including pretraining, backbone architectures, and downstream adaptation. We then organize the literature into five physical-layer task families: signal recognition and demodulation, channel representation learning, RF sensing and localization, beam management, and spectrum sensing and monitoring, while separately examining multi-task PHY models. Across these categories, we analyze how existing models are pretrained, adapted, and evaluated, with particular attention to downstream task diversity and the distinction between in-distribution, partial-shift, and out-of-distribution transfer. Our analysis shows that current WFMs provide increasing evidence of reusable wireless representations, but this evidence varies considerably across task families and evaluation settings. Differences in datasets, modalities, architectures, pretraining objectives, adaptation protocols, and distribution shifts make it difficult to determine which design choices drive transfer and generalization. We conclude by identifying open directions for improving data availability, evaluation rigor, generalization, efficient adaptation, and real-world deployment, providing a unified framework for understanding the current WFM landscape and the requirements for developing more reusable foundation models for future physical-layer wireless systems.

Closest papers

Nearest neighbours by meaning across the whole index.

Wireless Physical-Layer Foundation Models: Architectures, Learning Paradigms, Applications, and Deployment

eess.SP ·2026-08-20 ·Mohammad Cheraghinia, Davide Buffelli, Liu Li, Mohammad Alhellani, Jaron Fontaine +4 more
hot direction similarity 0.80
Abstract

Foundation models, i.e., large neural networks pretrained on broad unlabeled data and adapted to many downstream tasks, have reshaped natural language processing and computer vision and are now being explored for the wireless physical layer. Wireless Physical-Layer Foundation Models (WPFMs) aim to learn transferable representations of signals such as channel state information (CSI), in-phase and quadrature (IQ) samples, and spectrograms so that a single pretrained backbone can support tasks ranging from channel estimation and prediction to localization and sensing while using limited task-specific data. This paper provides a dedicated review of WPFMs from learning design to practical deployment. We first establish the theoretical background, covering the neural architectures used for wireless signals, the self-supervised pretraining paradigms of masked modeling, contrastive learning, and generative pretraining, and the fine-tuning strategies that adapt pretrained models to downstream tasks. We then introduce a taxonomy that organizes existing models along five dimensions: architecture family, input modality and tokenization, pretraining objective, model scale and deployment target, and generalization capability. Building on this basis, we review applications across telecommunications, localization, and sensing, and, for each domain, analyze deployment feasibility by mapping model size to the memory, compute, and latency budgets of representative wireless hardware. Finally, we discuss model compression and efficient deployment, summarize the cross-cutting challenges, and outline open research directions. Our goal is to provide a reference that connects pretraining, architecture, and fine-tuning with the practical constraints of wireless systems.

0.47

Scaling of Wireless Foundation Models via Representation Diversity and Multi-Branch Architectures

eess.SP cs.AI ·2026-10-03 ·Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid
similarity 0.75
Abstract

Wireless foundation models learn representations from unlabeled radio signals for reuse across downstream tasks. Scaling model capacity is a common strategy for learning richer representations and improving downstream performance. However, its gains are less consistent in wireless self-supervised learning when pretraining data are limited. We investigate objective diversity as an alternative scaling axis: different self-supervised objectives emphasize different signal properties, and combining their representations can preserve more information to enable diverse tasks. We develop a fusion framework that combines frozen representations from independent encoders trained through reconstructive, predictive, and contrastive learning. This provides a reference for the benefits of diversity, but requires the maintenance of multiple encoders. To retain these benefits within the parameter budget of a standard single-objective encoder, we introduce a jointly trained multi-branch architecture with a shared trunk and objective-specific branches. We pretrain on a heterogeneous corpus of spectrogram and channel state information data and evaluate six downstream tasks that span communication, sensing, and positioning. At an equal output embedding dimension, fusion outperforms the evaluated single-objective encoders on all six tasks while using roughly one-third of their parameters. The multi-branch architecture retains much of the fusion benefit within a single-encoder parameter budget. Representation analyses indicate complementary contributions across objectives, with much of the added benefit retained in components orthogonal to the reconstruction representation subspace. These findings support objective diversity as an effective strategy for scaling wireless foundation models.

0.11

WiFo-R: Wireless Foundation Model with Recurrent Channel Representation

eess.SP ·2026-11-08 ·Liu Xuanyu, Cao Keyi, Cheng Xiang
similarity 0.74
Abstract

Wireless foundation models learn transferable channel state information (CSI) representations across heterogeneous wireless systems. However, conventional grid-aligned representations couple feature sequence length to CSI dimensions, restricting the allocation of representation capacity to different propagation conditions and task requirements while increasing inference overhead. This paper proposes WiFo-R, a wireless foundation model that learns progressive channel representations with selectable capacity. A channel-query cross-attention encoder aggregates spatial, temporal, and spectral CSI information, while parameter-shared recurrent updates refine existing channel features and introduce additional latent tokens. Multi-mask, multi-depth self-supervised pretraining equips intermediate states with strong reconstruction capabilities, followed by task-aligned post-training for channel estimation and CSI feedback. WiFo-R supports temporal and frequency-domain channel prediction, channel estimation, and variable-rate CSI feedback, and transfers to localization and LoS/NLoS classification. Experiments across in-distribution and out-of-distribution channel configurations demonstrate accurate reconstruction, progressive performance improvements, and strong transferability. A single feedback encoder--decoder supports six payload lengths at fixed quantization precision, while cross-attention and selectable recurrent depth improve the accuracy--complexity trade-off for large-scale CSI observations.

0.23

RFShape: An IQ-Pretrained Wireless Foundation Model for Heterogeneous IQ & CIR Representations

eess.SP ·2026-11-02 ·Mohammad Cheraghinia, Sebbe Van Der Smissen, Jaron Fontaine, Delia Rico, Eli De Poorter +1 more
similarity 0.73
Abstract · 17 pages, 12 figures, 8 tables

In wireless systems, foundation models have been proposed as alternative artificial intelligence models to replace task-specific models with a shared pretrained model that can be reused across many downstream applications (source separation, interference detection, localization, etc.). These wireless foundation models promise to reuse learned representations across diverse tasks, but choosing a foundation model also means choosing its input representation. For example, a model pretrained on spectrograms expects spectrograms, while one pretrained on in-phase/quadrature (IQ) samples expects IQ, limiting which pretrained model can be used for a given downstream problem. To remedy this, we present RFShape, a 7.4 M-parameter foundation model that breaks this coupling by adapting how a signal is presented to a shared pretrained encoder. RFShape is pretrained solely on synthetic IQ waveforms, without real captures, labels, or channel impulse responses (CIRs), and uses deterministic representation operators to support heterogeneous downstream inputs. Across ten tasks and nine datasets unseen during pretraining, the same encoder supports classification, ranging-error regression, and two-dimensional positioning. Representation selection alone increases 23-class radar recognition from 23.0% to 69.5% and short-range technology recognition from 70.8% to 97.1%. RFShape also outperforms CIR-pretrained ultra-wideband baselines by up to 12.7 percentage points for (N)LOS classification despite never observing CIRs during pretraining. These results show that foundation-model reuse need not be limited by the representation or modality seen during pretraining, and adapting how a signal is presented can extend a single pretrained encoder across heterogeneous wireless tasks.

0.30

Channel2World: A Wireless Foundation Model for RF Environment Representation

eess.SP ·2026-08-18 ·Hyung-Joo Moon, Joonkyu Jang, Kwang Soon Kim, Seong-Lyun Kim, Robert W. Heath +1 more
similarity 0.71
Abstract · 13 pages, 10 figures

Wireless channels are commonly treated as link-specific observations, although their multipath structure is governed by the surrounding radio-frequency (RF) environment. In this paper, we propose Channel2World, a wireless foundation model that learns a reusable environment-level representation from multiple-input multiple-output (MIMO) channel-position observations. The model aggregates channels collected within the same base-station-centered environment into a wireless world embedding using a Transformer-based encoder. The encoder is pretrained through context-query prediction, where context channels condition user equipment (UE) position and relative path-gain prediction for disjoint query channels. After pretraining, the encoder is frozen and used as a task-agnostic environment-conditioning module for downstream wireless models, enabling adaptation to unseen environments without site-specific fine-tuning. To learn an environment-level latent space that generalizes across deployments, we pretrain Channel2World using ray-tracing data from 26,000 environments, with approximately 5,000 channel measurements per environment. Evaluations on UE localization, beam-domain channel state information (CSI) reconstruction, and RF-observable geometry reconstruction show that the learned embeddings provide effective conditioning in unseen environments. For localization and CSI reconstruction tasks, embedding-based conditioning outperforms or remains competitive with site-specific fine-tuning, although fine-tuning requires task-specific labeled data and additional gradient-based adaptation. The embeddings also support the reconstruction of dominant reflector structures, indicating their utility as reusable environmental priors across tasks.

0.43

AWM: An All-in-One Wireless Foundation Model for Multi-User Channel Acquisition and Localization Without Downstream Tuning

eess.SP ·2026-10-16 ·Zirui Chen, Ziqing Xing, Zhaoyang Zhang, Hongning Ruan, Zili Wang +1 more
similarity 0.71
Abstract

Wireless foundation models (WFMs) seek to unify diverse wireless tasks and scenarios, yet existing methods still rely on task- or scenario-specific components or deployment-time fine-tuning. This paper presents an all-in-one wireless model (AWM), a WFM that unifies multi-user channel acquisition and localization, despite their distinct data modalities and functional objectives. We reveal that user location and channel state information (CSI) at different frequencies can be viewed as attribute-specific measurements of the same wireless link. By introducing in-scenario same-attribute reference pairs as prompts, AWM converts heterogeneous attributes into alignable relativity representations, formulating intra-band channel interpolation, inter-band channel prediction, and wireless localization as unified wireless-state transformations. Further, a multi-task MateFormer is developed to perform source-attribute relativity extraction, cross-attribute relativity alignment, and target-attribute synthesis within a unified architecture, avoiding task-specific output heads or downstream fine-tuning. Comprehensive experiments demonstrate the effectiveness of model unification, including substantial gains from cross-task knowledge sharing, seamless generalization to unseen scenarios, and an efficient closed-loop service for mobile users.

0.19

WiFo-D: Wireless Foundation Model Based on Discrete Representations

eess.SP ·2026-11-19 ·Xinyu Pan, Boxun Liu, Chen Chen, Xiang Cheng
similarity 0.71
Abstract

Wireless foundation models have shown strong generalization capabilities across heterogeneous wireless tasks and configurations. However, most existing models rely on continuous representations, limiting ultra-low-overhead channel state information (CSI) feedback, few-shot generalization, and robustness to noise. To address these limitations, this paper proposes a wireless foundation model based on discrete representations (WiFo-D), which learns multi-granularity discrete CSI representations. It comprises a CSI encoder, multi-codebook vector quantization, and a modulation-based decoder, with the learned token maps and quantized features supporting multi-rate CSI feedback, CSI reconstruction, and diverse CSI-related downstream tasks. Extensive experiments demonstrate strong CSI feedback performance at an ultra-low latent compression ratio of 1/32 with 3 bits per token, reducing normalized mean square error (NMSE) by more than 4.7 dB compared with the strongest baseline. Furthermore, for frequency-domain prediction with limited training samples, WiFo-D improves generalization and noise robustness over continuous-representation-based methods. The results also demonstrate its superiority across downstream tasks, including beam prediction, wireless localization, and line-of-sight/non-line-of-sight identification.

0.07

A Foundation Model for Large-Scale Wireless Network Planning , Operation and Optimization

eess.SP ·2026-09-08 ·Xinyu Qin, Wenqiang Pu, Hongcheng Dong, Bingsheng Peng, Ye Xue +4 more
similarity 0.67
Abstract

Wireless cellular networks form the connective tissue of human society, sustained by a continuous physical dialogue between engineered infrastructure and its surroundings. Radio signals emitted from base stations traverse terrain, diffract around buildings and scatter through streets before reaching billions of users. Together, these interactions produce the city-wide radio environment on which every network decision rests. Shaping this environment through deployment and optimization determines the connectivity societies rely on, yet learning it effectively at city scale and generalizing across diverse cities and deployments remain open challenges. Here we answer positively by introducing ChaRT, a foundation model that learns transferable radio representations from measurement reports generated by deployed cellular networks. These reports provide abundant multi-cell, multi-beam observations without dedicated campaigns, forming a scalable data foundation for city-scale learning. ChaRT embeds beam-level angular structure, network hierarchy and propagation-regime diversity in its architecture, and is pretrained through context-aware masked beam modelling and self-distillation with channel-model-constrained augmentation. We pretrain ChaRT on over one billion reports comprising 18.2 billion beam-level observations from 3,503 cells in one city. With a single set of weights, ChaRT reconstructs radio environments in unseen cities and transfers to radio map construction, new-site prediction and network parameter tuning. With only 1% of labelled data, it supports user localization, beam prediction, propagation scenario classification and estimation of the signal-to-interference-plus-noise ratio. The learned representation further enables beamspace clustering for reusable radio-grid construction. These results establish ChaRT as a transferable foundation for network-wide intelligence.

0.09