CS Paper Radar

WiFo-R: Wireless Foundation Model with Recurrent Channel Representation

Liu Xuanyu, Cao Keyi, Cheng Xiang

eess.SP ·submitted 2026-11-08 10:00 UTC · v1

Abstract

Wireless foundation models learn transferable channel state information (CSI) representations across heterogeneous wireless systems. However, conventional grid-aligned representations couple feature sequence length to CSI dimensions, restricting the allocation of representation capacity to different propagation conditions and task requirements while increasing inference overhead. This paper proposes WiFo-R, a wireless foundation model that learns progressive channel representations with selectable capacity. A channel-query cross-attention encoder aggregates spatial, temporal, and spectral CSI information, while parameter-shared recurrent updates refine existing channel features and introduce additional latent tokens. Multi-mask, multi-depth self-supervised pretraining equips intermediate states with strong reconstruction capabilities, followed by task-aligned post-training for channel estimation and CSI feedback. WiFo-R supports temporal and frequency-domain channel prediction, channel estimation, and variable-rate CSI feedback, and transfers to localization and LoS/NLoS classification. Experiments across in-distribution and out-of-distribution channel configurations demonstrate accurate reconstruction, progressive performance improvements, and strong transferability. A single feedback encoder--decoder supports six payload lengths at fixed quantization precision, while cross-attention and selectable recurrent depth improve the accuracy--complexity trade-off for large-scale CSI observations.

Closest papers

Nearest neighbours by meaning across the whole index.

Wireless Foundation Models: State-of-the-Art and Open Challenges

eess.SP cs.AI ·2026-09-04 ·Alonso M. Pacheco Huachaca, Juan J. Rodriguez Rodriguez, Ahmed Aboulfotouh, Nelson L. S. da Fonseca, Carlos A. Astudillo +1 more
survey similarity 0.74
Abstract

Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapting them to downstream tasks. However, the rapidly growing literature remains fragmented across modalities, pretraining objectives, architectures, adaptation strategies, and evaluation protocols, making it difficult to assess progress toward broadly transferable models. This survey provides a systematic analysis of WFMs for physical-layer applications. We first introduce the main WFM design components, including pretraining, backbone architectures, and downstream adaptation. We then organize the literature into five physical-layer task families: signal recognition and demodulation, channel representation learning, RF sensing and localization, beam management, and spectrum sensing and monitoring, while separately examining multi-task PHY models. Across these categories, we analyze how existing models are pretrained, adapted, and evaluated, with particular attention to downstream task diversity and the distinction between in-distribution, partial-shift, and out-of-distribution transfer. Our analysis shows that current WFMs provide increasing evidence of reusable wireless representations, but this evidence varies considerably across task families and evaluation settings. Differences in datasets, modalities, architectures, pretraining objectives, adaptation protocols, and distribution shifts make it difficult to determine which design choices drive transfer and generalization. We conclude by identifying open directions for improving data availability, evaluation rigor, generalization, efficient adaptation, and real-world deployment, providing a unified framework for understanding the current WFM landscape and the requirements for developing more reusable foundation models for future physical-layer wireless systems.

0.20

Scaling of Wireless Foundation Models via Representation Diversity and Multi-Branch Architectures

eess.SP cs.AI ·2026-10-03 ·Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid
similarity 0.74
Abstract

Wireless foundation models learn representations from unlabeled radio signals for reuse across downstream tasks. Scaling model capacity is a common strategy for learning richer representations and improving downstream performance. However, its gains are less consistent in wireless self-supervised learning when pretraining data are limited. We investigate objective diversity as an alternative scaling axis: different self-supervised objectives emphasize different signal properties, and combining their representations can preserve more information to enable diverse tasks. We develop a fusion framework that combines frozen representations from independent encoders trained through reconstructive, predictive, and contrastive learning. This provides a reference for the benefits of diversity, but requires the maintenance of multiple encoders. To retain these benefits within the parameter budget of a standard single-objective encoder, we introduce a jointly trained multi-branch architecture with a shared trunk and objective-specific branches. We pretrain on a heterogeneous corpus of spectrogram and channel state information data and evaluate six downstream tasks that span communication, sensing, and positioning. At an equal output embedding dimension, fusion outperforms the evaluated single-objective encoders on all six tasks while using roughly one-third of their parameters. The multi-branch architecture retains much of the fusion benefit within a single-encoder parameter budget. Representation analyses indicate complementary contributions across objectives, with much of the added benefit retained in components orthogonal to the reconstruction representation subspace. These findings support objective diversity as an effective strategy for scaling wireless foundation models.

0.11

Channel2World: A Wireless Foundation Model for RF Environment Representation

eess.SP ·2026-08-18 ·Hyung-Joo Moon, Joonkyu Jang, Kwang Soon Kim, Seong-Lyun Kim, Robert W. Heath +1 more
similarity 0.73
Abstract · 13 pages, 10 figures

Wireless channels are commonly treated as link-specific observations, although their multipath structure is governed by the surrounding radio-frequency (RF) environment. In this paper, we propose Channel2World, a wireless foundation model that learns a reusable environment-level representation from multiple-input multiple-output (MIMO) channel-position observations. The model aggregates channels collected within the same base-station-centered environment into a wireless world embedding using a Transformer-based encoder. The encoder is pretrained through context-query prediction, where context channels condition user equipment (UE) position and relative path-gain prediction for disjoint query channels. After pretraining, the encoder is frozen and used as a task-agnostic environment-conditioning module for downstream wireless models, enabling adaptation to unseen environments without site-specific fine-tuning. To learn an environment-level latent space that generalizes across deployments, we pretrain Channel2World using ray-tracing data from 26,000 environments, with approximately 5,000 channel measurements per environment. Evaluations on UE localization, beam-domain channel state information (CSI) reconstruction, and RF-observable geometry reconstruction show that the learned embeddings provide effective conditioning in unseen environments. For localization and CSI reconstruction tasks, embedding-based conditioning outperforms or remains competitive with site-specific fine-tuning, although fine-tuning requires task-specific labeled data and additional gradient-based adaptation. The embeddings also support the reconstruction of dominant reflector structures, indicating their utility as reusable environmental priors across tasks.

0.43

Wireless Physical-Layer Foundation Models: Architectures, Learning Paradigms, Applications, and Deployment

eess.SP ·2026-08-20 ·Mohammad Cheraghinia, Davide Buffelli, Liu Li, Mohammad Alhellani, Jaron Fontaine +4 more
hot direction similarity 0.72
Abstract

Foundation models, i.e., large neural networks pretrained on broad unlabeled data and adapted to many downstream tasks, have reshaped natural language processing and computer vision and are now being explored for the wireless physical layer. Wireless Physical-Layer Foundation Models (WPFMs) aim to learn transferable representations of signals such as channel state information (CSI), in-phase and quadrature (IQ) samples, and spectrograms so that a single pretrained backbone can support tasks ranging from channel estimation and prediction to localization and sensing while using limited task-specific data. This paper provides a dedicated review of WPFMs from learning design to practical deployment. We first establish the theoretical background, covering the neural architectures used for wireless signals, the self-supervised pretraining paradigms of masked modeling, contrastive learning, and generative pretraining, and the fine-tuning strategies that adapt pretrained models to downstream tasks. We then introduce a taxonomy that organizes existing models along five dimensions: architecture family, input modality and tokenization, pretraining objective, model scale and deployment target, and generalization capability. Building on this basis, we review applications across telecommunications, localization, and sensing, and, for each domain, analyze deployment feasibility by mapping model size to the memory, compute, and latency budgets of representative wireless hardware. Finally, we discuss model compression and efficient deployment, summarize the cross-cutting challenges, and outline open research directions. Our goal is to provide a reference that connects pretraining, architecture, and fine-tuning with the practical constraints of wireless systems.

0.47

RFShape: An IQ-Pretrained Wireless Foundation Model for Heterogeneous IQ & CIR Representations

eess.SP ·2026-11-02 ·Mohammad Cheraghinia, Sebbe Van Der Smissen, Jaron Fontaine, Delia Rico, Eli De Poorter +1 more
similarity 0.70
Abstract · 17 pages, 12 figures, 8 tables

In wireless systems, foundation models have been proposed as alternative artificial intelligence models to replace task-specific models with a shared pretrained model that can be reused across many downstream applications (source separation, interference detection, localization, etc.). These wireless foundation models promise to reuse learned representations across diverse tasks, but choosing a foundation model also means choosing its input representation. For example, a model pretrained on spectrograms expects spectrograms, while one pretrained on in-phase/quadrature (IQ) samples expects IQ, limiting which pretrained model can be used for a given downstream problem. To remedy this, we present RFShape, a 7.4 M-parameter foundation model that breaks this coupling by adapting how a signal is presented to a shared pretrained encoder. RFShape is pretrained solely on synthetic IQ waveforms, without real captures, labels, or channel impulse responses (CIRs), and uses deterministic representation operators to support heterogeneous downstream inputs. Across ten tasks and nine datasets unseen during pretraining, the same encoder supports classification, ranging-error regression, and two-dimensional positioning. Representation selection alone increases 23-class radar recognition from 23.0% to 69.5% and short-range technology recognition from 70.8% to 97.1%. RFShape also outperforms CIR-pretrained ultra-wideband baselines by up to 12.7 percentage points for (N)LOS classification despite never observing CIRs during pretraining. These results show that foundation-model reuse need not be limited by the representation or modality seen during pretraining, and adapting how a signal is presented can extend a single pretrained encoder across heterogeneous wireless tasks.

0.30

LWMa: Distributed Deployment of an Angle-Delay-Domain Wireless Foundation Model for Multiple Tasks

eess.SP ·2026-10-16 ·Zhizhen Ren, Xudong Zhang, Jingbo Tan, Jintao Wang
similarity 0.69
Abstract

The growing diversity of wireless services in sixth-generation (6G) wireless communication systems calls for reusable channel representations that support multiple tasks across different propagation environments. However, deploying such representations between user equipment and the base station in frequency-division duplexing systems faces uplink feedback constraints. This paper proposes a distributed framework based on an angle-delay-domain large wireless model (LWMa) for multiple tasks. LWMa exploits angle-delay structure and delay truncation to improve feature extraction and reduce computational cost. A scenario-specific network inspired by Perceiver IO (input-output) compresses embeddings for channel reconstruction tasks, while other tasks use a low-dimensional compact global embedding. Embedding reconstruction training followed by channel-quality-guided fine-tuning preserves information useful for downstream processing. Simulations demonstrate that the proposed method supports effective channel reconstruction and multiple tasks under limited feedback with reduced deployment complexity. Further evaluations show that the recovered embeddings generalize to additional tasks and support split inference.

0.15

Elastic Selective Spectral Hybrids for Train-Once, Export-Many Budgeted Inference

cs.LG ·2026-09-26 ·Dachuan Song, Chuchu Chen, Xuan Wang
similarity 0.67
Abstract

Deploying a language model under different computing and latency budgets calls for compact models with different quality-cost trade-offs. Towards this end, elastic spectral state space models provide ordered and temporally decomposed channels that can be truncated, but they are associated with linear time-invariant filters that cannot selectively preserve relevant past information or forget irrelevant information as the context evolves. To address this, we introduce the Elastic Selective Spectral Hybrid (ESSH), which realizes each Hankel spectral channel as an independent recurrent unit using fitted damped rotation modes. It also features an input-dependent decay and write/read gates that make temporal retention and state update input-dependent while preserving channel-wise truncation and a structured recurrence for efficient execution. ESSH combines these selective spectral mixers with sliding-window attention and jointly trains multiple capacities by reducing spectral-channel count and feed-forward width at different rates through a two-rate capacity map with full-model distillation. The resulting models support chunked parallel training and fused recurrent decoding while avoiding computation for discarded channels. At full capacity, ESSH achieves language-modeling quality comparable to similarly sized independently trained models, while smaller exports exhibit a smooth quality-cost trade-off. We validate the effectiveness of the proposed framework using language understanding, retrieval, cross-domain text, and DNA experiments, by assessing quality retention and the trade-off against independently trained and elastic baselines. At the 1.53B model configuration, fused batch-one decoding takes 1.37 ms per token on a B300, providing a 2.14-2.80x speedup over the tested Mamba-2 and Mamba-3 implementations and 3.03x over Transformer++ at matched parameter counts.

0.20

A JEPA-Based Field-Layer World Model for Bridging Channel Prediction and Estimation

eess.SP ·2026-08-10 ·Yuzhi Yang, Brahim Mefgouda, Hang Zou, Lina Bariah, Anis Bara +3 more
similarity 0.66
Abstract · submitted to IEEE trans

Channel state information (CSI) acquisition, reconstruction, and prediction are fundamental yet costly tasks in modern MIMO-OFDM wireless systems. Direct coefficient-level prediction of raw CSI is fragile in realistic propagation environments, since small spatial perturbations, local scattering changes, and phase variations can cause large errors in the complex channel domain. However, the underlying wireless propagation field still contains stable and predictable structures that can be exploited across time, frequency, antenna, and carrier dimensions. Motivated by this observation, we propose a JEPA-based field-layer world model (FWM) that learns a shared latent propagation state from multi-resolution CSI observations across the considered carrier bands and predicts its task-relevant evolution in the latent domain. The proposed FWM maps multiple CSI observation resolutions to a shared latent propagation-field space through scale-specific tokenizer heads. A latent prediction backbone is then trained to infer masked or future field states, while an incremental multi-scale alignment strategy allows new observation scales to be incorporated without retraining the entire model from scratch. For downstream reconstruction, the predicted latent field is used as a structured prior and combined with sparse current pilots. Experiments on single-band and cross-band reconstruction demonstrate improved symbol detection and, more notably, substantial beamforming gains despite modest NMSE improvements, indicating that FWM captures task-relevant spatial propagation structure beyond coefficient-wise CSI fitting.

0.35