CS Paper Radar

Electromagnetic World Model for 6G: A Unified Framework for Joint Environment Reconstruction and Channel Prediction

Yizhu Zhao, Li Yu, Jianhua Zhang, Yuxiang Zhang, Zhen Zhang, Guangyi Liu

eess.SP ·submitted 2026-08-18 13:32 UTC · v1

Abstract

The integration of sensing, communication, and intelligence is becoming a key enabler for sixth generation (6G) wireless systems, where intelligent terminals are expected to simultaneously support efficient link establishment and reliable environmental sensing. However, existing studies mainly exploit sensing information or communication information to address a single task, such as channel prediction or environment reconstruction. Motivated by the shared dependence of optical and radio-frequency signals on the surrounding environment, we propose the electromagnetic world model (EMWM), the first unified framework for joint environment reconstruction and channel prediction. EMWM learns a common electromagnetic representation with the potential to provide a modeling foundation for 6G tasks. Specifically, partial channel state information (CSI) and multi-view red-green-blue (RGB) images are encoded into CSI and visual tokens and jointly processed by a hierarchical world-model backbone with local and global aggregation. Based on the learned representation, a mixture-of-experts (MoE)-based CSI prediction head reconstructs the complete CSI, while a depth prediction head estimates multi-view depth maps that are further converted into three-dimensional (3D) point clouds. Moreover, a large-scale multi-modal dataset is constructed based on a campus digital twin. Experimental results show that EMWM outperforms conventional neural network and large language model (LLM) baselines in both CSI prediction and environment reconstruction, achieving a squared generalized cosine similarity (SGCS) of 0.9699 for CSI prediction while demonstrating robustness across different signal-to-noise ratio (SNR) conditions and zero-shot generalization at 28 GHz.

Closest papers

Nearest neighbours by meaning across the whole index.

Channel2World: A Wireless Foundation Model for RF Environment Representation

eess.SP ·2026-08-18 ·Hyung-Joo Moon, Joonkyu Jang, Kwang Soon Kim, Seong-Lyun Kim, Robert W. Heath +1 more
similarity 0.69
Abstract · 13 pages, 10 figures

Wireless channels are commonly treated as link-specific observations, although their multipath structure is governed by the surrounding radio-frequency (RF) environment. In this paper, we propose Channel2World, a wireless foundation model that learns a reusable environment-level representation from multiple-input multiple-output (MIMO) channel-position observations. The model aggregates channels collected within the same base-station-centered environment into a wireless world embedding using a Transformer-based encoder. The encoder is pretrained through context-query prediction, where context channels condition user equipment (UE) position and relative path-gain prediction for disjoint query channels. After pretraining, the encoder is frozen and used as a task-agnostic environment-conditioning module for downstream wireless models, enabling adaptation to unseen environments without site-specific fine-tuning. To learn an environment-level latent space that generalizes across deployments, we pretrain Channel2World using ray-tracing data from 26,000 environments, with approximately 5,000 channel measurements per environment. Evaluations on UE localization, beam-domain channel state information (CSI) reconstruction, and RF-observable geometry reconstruction show that the learned embeddings provide effective conditioning in unseen environments. For localization and CSI reconstruction tasks, embedding-based conditioning outperforms or remains competitive with site-specific fine-tuning, although fine-tuning requires task-specific labeled data and additional gradient-based adaptation. The embeddings also support the reconstruction of dominant reflector structures, indicating their utility as reusable environmental priors across tasks.

0.43

Electromagnetic Twin: Completing the Wireless World from Sparse Channel Evidence

eess.SP ·2026-08-21 ·Tuo Wu, Jie Tang, Kangda Zhi, Junteng Yao, Maged Elkashlan +3 more
similarity 0.64
Abstract

Acquiring dense channel information over many locations and beams incurs considerable pilot and processing overhead. Radio maps and channel knowledge maps (CKMs) reduce this overhead by reusing site-specific channel information, but their contents must be refreshed when new measurements or environmental observations become available. This paper introduces an \emph{electromagnetic twin} as an updatable digital representation that uses sparse channel evidence to reconstruct the wireless state requested by communication queries. Rather than replacing radio maps or CKMs, the twin uses a CKM as channel memory, combines it with registered scene information, and regenerates its outputs after each evidence update. We instantiate this idea by completing a two-dimensional channel-gain field from sparse samples and an incomplete floor plan. A learned RF completion backbone recovers the main propagation structure, and a lightweight residual adapter tests whether frozen CLIP features provide useful side information. With $4\%$ measured locations and $55\%$ missing semantic objects, the RF backbone attains $4.44$ dB RMSE, compared with $8.29$ dB for CKM interpolation and $8.38$ dB for an incomplete physics prior. Residual adaptation reduces RMSE by a paired mean of $0.135$ dB (95\% confidence interval: $0.100$--$0.169$ dB), but a same-capacity random-feature control is statistically indistinguishable from the CLIP-conditioned adapter. The results therefore support the measurement--update--query loop and lightweight residual correction, while avoiding an unsupported attribution of the correction to visual semantics.

0.46

An Overview on Multimodal Wireless and Visual Sensing for Environment Reconstruction: Opportunities and Challenges

eess.SP ·2026-11-07 ·Guanlin Wu, Chao Hu, Yilong Chen, Yudong Guo, Rongfei Fan +3 more
survey similarity 0.62
Abstract

Physical-scene reconstruction through visual sensing and channel knowledge map (CKM) reconstruction through wireless sensing have attracted growing research interest but have largely evolved independently within the computer vision and wireless communications communities, respectively. When applied to the same physical environment, the two sensing modalities provide complementary observations. Visual sensing captures detailed scene geometry and appearance but is constrained by occlusion and poor lighting. Wireless sensing can provide information beyond visual line of sight regardless of lighting conditions, but its measurements are often sparse and difficult to associate with scene structures. These complementary strengths motivate a unified multimodal approach to physical-scene and CKM reconstruction. This paper provides an overview of such unified environment reconstruction through wireless and visual sensing. We first compare the capabilities and limitations of the two modalities and discuss potential applications that benefit from jointly reconstructing both targets. We then review two complementary research directions, namely wireless-assisted physical-scene reconstruction and vision-assisted CKM reconstruction, highlighting how each modality supports the reconstruction task associated with the other. Building on these perspectives, we discuss design principles for a joint representation that supports both targets and identify mutual refinement, in which each modality helps improve the reconstruction associated with the other. Finally, we discuss open challenges and future research directions, offering insights into developing site-specific environment models for sixth-generation (6G) and beyond networks.

0.30

A JEPA-Based Field-Layer World Model for Bridging Channel Prediction and Estimation

eess.SP ·2026-08-10 ·Yuzhi Yang, Brahim Mefgouda, Hang Zou, Lina Bariah, Anis Bara +3 more
similarity 0.62
Abstract · submitted to IEEE trans

Channel state information (CSI) acquisition, reconstruction, and prediction are fundamental yet costly tasks in modern MIMO-OFDM wireless systems. Direct coefficient-level prediction of raw CSI is fragile in realistic propagation environments, since small spatial perturbations, local scattering changes, and phase variations can cause large errors in the complex channel domain. However, the underlying wireless propagation field still contains stable and predictable structures that can be exploited across time, frequency, antenna, and carrier dimensions. Motivated by this observation, we propose a JEPA-based field-layer world model (FWM) that learns a shared latent propagation state from multi-resolution CSI observations across the considered carrier bands and predicts its task-relevant evolution in the latent domain. The proposed FWM maps multiple CSI observation resolutions to a shared latent propagation-field space through scale-specific tokenizer heads. A latent prediction backbone is then trained to infer masked or future field states, while an incremental multi-scale alignment strategy allows new observation scales to be incorporated without retraining the entire model from scratch. For downstream reconstruction, the predicted latent field is used as a structured prior and combined with sparse current pilots. Experiments on single-band and cross-band reconstruction demonstrate improved symbol detection and, more notably, substantial beamforming gains despite modest NMSE improvements, indicating that FWM captures task-relevant spatial propagation structure beyond coefficient-wise CSI fitting.

0.35

Scene Reconstruction Using Ubiquitous Wireless Signals via Diffusion Posterior Inference Over physics-Grounded Representations

cs.LG ·2026-10-15 ·Vahid Yazdnian, Yasaman Ghasempour
similarity 0.62
Abstract

Knowing the layout of the physical world matters for many applications, yet the sensors we rely on for it (e.g., cameras and LiDAR) can fail in darkness, in adverse weather, or behind walls. Wireless signals do not face these limitations: every link between a base station and a user is shaped by the buildings it passes, reflects from, or is blocked by, leaving information about the surrounding scene embedded in the wireless channel measured at the endpoints. However, mapping channel measurements to the environment is a severely ill-posed problem: a measurement records only the structures that interact with the transmitted electromagnetic waves along its propagation paths, and even these observations can often be explained by multiple plausible scenes. We therefore formulate wireless scene reconstruction as posterior inference and develop a hierarchical framework with two complementary stages to approach this problem. A wireless foundation model, pretrained to respect propagation physics, transforms each channel measurement into a representation of the scene structure that shaped the observation. A diffusion model then jointly integrates representations from multiple measurements to model and sample the posterior over building occupancy, with consensus over samples producing the final reconstruction. We demonstrate that the framework can accurately recover building footprints from wireless channel measurements alone and show that its performance depends critically on both design components: physics-grounded representations expose scene-relevant information, while joint posterior inference coherently integrates complementary observations.

0.17

LWMa: Distributed Deployment of an Angle-Delay-Domain Wireless Foundation Model for Multiple Tasks

eess.SP ·2026-10-16 ·Zhizhen Ren, Xudong Zhang, Jingbo Tan, Jintao Wang
similarity 0.62
Abstract

The growing diversity of wireless services in sixth-generation (6G) wireless communication systems calls for reusable channel representations that support multiple tasks across different propagation environments. However, deploying such representations between user equipment and the base station in frequency-division duplexing systems faces uplink feedback constraints. This paper proposes a distributed framework based on an angle-delay-domain large wireless model (LWMa) for multiple tasks. LWMa exploits angle-delay structure and delay truncation to improve feature extraction and reduce computational cost. A scenario-specific network inspired by Perceiver IO (input-output) compresses embeddings for channel reconstruction tasks, while other tasks use a low-dimensional compact global embedding. Embedding reconstruction training followed by channel-quality-guided fine-tuning preserves information useful for downstream processing. Simulations demonstrate that the proposed method supports effective channel reconstruction and multiple tasks under limited feedback with reduced deployment complexity. Further evaluations show that the recovered embeddings generalize to additional tasks and support split inference.

0.15

WiNeRF: Measurement Constrained Radiance Fields for Actionable Wireless Channel Modeling

cs.NI cs.LG ·2026-08-24 ·Saif Ur Rahman, Rafid Umayer Murshed, Anton Dmitriev, Cagri Tanriover, Rahul C. Shah +1 more
published similarity 0.61
Abstract · Accepted to EWSN 2026

Wireless embedded systems increasingly rely on wireless channel information for decision making, yet practical platforms operate under severe constraints, including few antennas, narrow bandwidth, and sparse, noisy measurements. While neural field based approaches inspired by Neural Radiance Fields (NeRFs) have recently been explored for continuous wireless channel modeling, existing approaches depend on dense measurements or external priors such as known geometry, visual context, or angle-of-arrival (AoA) information, limiting their practicality in real-world deployments. We present WiNeRF, a neural field framework that learns a spatially continuous, complex-valued wireless channel representation directly from sparse channel state information (CSI) collected by commodity WiFi devices. WiNeRF embeds intrinsic system constraints, such as antenna geometry, limited spatial resolution, and phase uncertainty, as inductive biases through a 3D conical wave sampling model, a multi-resolution implicit scene representation, and a differentiable optimization framework for complex-valued channel learning. Across diverse indoor environments with non-line-of-sight (NLoS) regions, WiNeRF achieves a median prediction SNR of 5.3 dB, outperforming prior neural baselines by 4.9 dB on average (approximately 3x higher prediction SNR), and produces a task-agnostic channel representation that can be directly reused in standard signal-processing pipelines, including beamforming, AoA estimation, and RSSI coverage mapping, without modifying existing hardware or wireless protocols.

0.37

Scaling of Wireless Foundation Models via Representation Diversity and Multi-Branch Architectures

eess.SP cs.AI ·2026-10-03 ·Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid
similarity 0.61
Abstract

Wireless foundation models learn representations from unlabeled radio signals for reuse across downstream tasks. Scaling model capacity is a common strategy for learning richer representations and improving downstream performance. However, its gains are less consistent in wireless self-supervised learning when pretraining data are limited. We investigate objective diversity as an alternative scaling axis: different self-supervised objectives emphasize different signal properties, and combining their representations can preserve more information to enable diverse tasks. We develop a fusion framework that combines frozen representations from independent encoders trained through reconstructive, predictive, and contrastive learning. This provides a reference for the benefits of diversity, but requires the maintenance of multiple encoders. To retain these benefits within the parameter budget of a standard single-objective encoder, we introduce a jointly trained multi-branch architecture with a shared trunk and objective-specific branches. We pretrain on a heterogeneous corpus of spectrogram and channel state information data and evaluate six downstream tasks that span communication, sensing, and positioning. At an equal output embedding dimension, fusion outperforms the evaluated single-objective encoders on all six tasks while using roughly one-third of their parameters. The multi-branch architecture retains much of the fusion benefit within a single-encoder parameter budget. Representation analyses indicate complementary contributions across objectives, with much of the added benefit retained in components orthogonal to the reconstruction representation subspace. These findings support objective diversity as an effective strategy for scaling wireless foundation models.

0.11