WiFo-D: Wireless Foundation Model Based on Discrete Representations
Abstract
Wireless foundation models have shown strong generalization capabilities across heterogeneous wireless tasks and configurations. However, most existing models rely on continuous representations, limiting ultra-low-overhead channel state information (CSI) feedback, few-shot generalization, and robustness to noise. To address these limitations, this paper proposes a wireless foundation model based on discrete representations (WiFo-D), which learns multi-granularity discrete CSI representations. It comprises a CSI encoder, multi-codebook vector quantization, and a modulation-based decoder, with the learned token maps and quantized features supporting multi-rate CSI feedback, CSI reconstruction, and diverse CSI-related downstream tasks. Extensive experiments demonstrate strong CSI feedback performance at an ultra-low latent compression ratio of 1/32 with 3 bits per token, reducing normalized mean square error (NMSE) by more than 4.7 dB compared with the strongest baseline. Furthermore, for frequency-domain prediction with limited training samples, WiFo-D improves generalization and noise robustness over continuous-representation-based methods. The results also demonstrate its superiority across downstream tasks, including beam prediction, wireless localization, and line-of-sight/non-line-of-sight identification.