CS Paper Radar

Bridging the Data Gap: Digital Twin as a New Paradigm for AI-based Radio Sensing

Éloi Sainte-Beuve, Guillaume Larue, Louis-Adrien Dufrène, Quentin Lampin, Ali Al Khansa

cs.LG eess.SP ·submitted 2026-08-11 08:26 UTC · v1
published

Abstract

We present a methodology that places a 3D digital twin (DT) of the environment as the main enabler behind the development of radio sensing at scale. The DT acts as a world model, providing geometry, materials, and transmitter/receiver placements to a ray-tracing engine that generates time-indexed channel impulse responses (CIRs) for large numbers of plausible scenes (moving people and objects, layout variants, seasonal/weather conditions, etc). From these synthetic sequences, we train a sequential neural network that maps CIR time series to spatial occupancy estimates, enabling device-free localization (DFL) without instrumented targets. We posit that sensing is best approached as an environment-conditioned learning problem: rather than seeking a single global model, we advocate training or fine-tuning local models specialized to a site-specific DT. As a first experiment, we introduce a novel State Space Model architecture, trained and evaluated across multiple room geometries. The localization performances obtained demonstrate the potential of the approach.

Comment
Accepted at EUSIPCO 2026

Closest papers

Nearest neighbours by meaning across the whole index.

TRACE: Learning to Self-Calibrate Wireless Digital Twins from ISAC Measurements

cs.AI eess.SP ·2026-09-26 ·Saad Masrur, Saeed R. Khosravirad, Ismail Guvenc
similarity 0.67
Abstract · Under Review

Wireless digital twins (DTs) rely on 3D environment models to predict radio propagation and support wireless-network decisions, yet these models are often initialized from imperfect 3D maps. Errors in building position, height, footprint, and orientation can therefore cause a high-fidelity propagation engine to simulate the wrong physical environment. In this paper, we study how a deployed wireless network can repair an existing DT using its own radio frequency (RF) measurements. In particular, we introduce Twin Residual Alignment and Calibration Engine (TRACE), a physics-grounded learning-based self-calibration framework that treats twin maintenance as residual alignment between the physical world and the current DT. Using the same sensing configuration as the physical measurements, TRACE ray-traces the current DT, coherently backprojects the measured and simulated RF onto a common world grid, and extracts the same local region around each building's current DT position. A multi-view corrector then fuses evidence across sensing nodes and neighboring buildings to predict a gated six-parameter correction per building, without relying on absolute layout or sensor ordering, and supports iterative correction through re-rendering. On 5,400 held-out samples from unseen simulated scenes at 28 GHz, TRACE reduces 3D position RMSE from 2.202 m to 0.302 m and yaw RMSE from 4.978° to 0.894°, outperforming ViT and U-Net baselines under changes in layout, building count, sensing-node count, and SNR. On measured 28 GHz RF data from the NIST outdoor courtyard, a model trained only on synthetic RF reduces mean planar wall-position error from 1.00 m to 7.8 cm, without measured-data fine-tuning or geometric labels. These results show that the discrepancy between measured and twin-rendered RF can serve as a learning signal for repairing a wireless DT.

0.12

Digital Twin Enhanced Channel Twin for AI-Native CSI Inference: Generalizability and Scalability

eess.SP ·2026-09-22 ·Majumder Haider, Imtiaz Ahmed, Zoheb Hassan, Danda B. Rawat, Huaiyu Dai
similarity 0.66
Abstract

Accurate channel state information (CSI) is critical for advanced multi-antenna wireless networks. While high-fidelity and site-specific ray-tracing (RT) equipped wireless digital twins can overcome overhead for CSI acquisition. However, computing deterministic, calibrated RT based CSI from a wireless digital twin for every orthogonal frequency-division multiplexing (OFDM) symbol violates the strict microsecond latency budgets of the 5G NR numerology. To overcome this computational bottleneck, this paper investigates three approaches within a calibrated 3D digital twin framework, namely (i) the generalization of the channel twin, (ii) the performance enhancement using a neural receiver, and (iii) a data-driven interpolation framework for scalability. We compute high-precision CSI for a sparse subset of temporal anchors and employ an attention-based Transformer to predict the remaining symbols. Unlike polynomial splines or sequential long short-term memory (LSTM) networks, the Transformer exploits a global receptive field to capture the non-linear multipath dynamics while enabling parallelizable, real-time inference. To achieve spatial scalability, we introduce channel twin generalization. By fine-tuning the 3D RT models alongside the Transformer, the framework leverages the CSI dataset of one location to infer the channel behavior of an unseen environment. Transfer learning further adapts the model to a new environment using only a small fraction of locally collected data. Simulation results demonstrate that the proposed architecture substantially outperforms the baseline interpolators, achieves robust spatial transferability, and lowers the bit error rate through the unified neural receiver. These results establish a scalable, environment-agnostic foundation of distributed channel twins for high-quality, low-overhead CSI acquisition in next-generation cellular networks.

0.25

Digital Twin-Guided Wireless Localization via Probabilistic Inverse Learning

cs.IT eess.SP ·2026-10-27 ·Mahmoud Saad Abouamer, Henrik C. M. Frederiksen, Robin J. Williams, Shashi Raj Pandey, Petar Popovski
similarity 0.65
Abstract

This work investigates how site-specific digital twins (DTs) can support wireless localization using simplified distributed infrastructure. We propose PRISM (Probabilistic Refinement using Inverse learning and a Site-specific Model), a DT-guided probabilistic localization scheme with single-antenna access points (APs). Localization is formulated as a probabilistic inverse problem in which a conditional proposal distribution over UE locations is learned from multi-node channel impulse responses (CIRs). The proposal generates candidate locations, with its spread regularized during training and DT consistency used to reweight candidates and refine the estimate at inference. The DT serves as an approximate forward-consistency model, avoiding assumptions of exact channel fidelity or differentiability with respect to user position. Numerical experiments demonstrate gains over data-driven and classical fingerprinting benchmarks, while achieving a median error of approximately $0.7$ m using 10 single-antenna APs. Without retraining, PRISM remains effective under degraded inference-time DT features. PRISM also yields uncertainty estimates from its proposal covariance, with empirical $χ^2$ calibration approaching ideal behavior as APs increase.

0.32

Neural Multipath Fields for 6G FR3 Digital Twins: Latent Adaptation from Sparse Data

eess.SP ·2026-11-09 ·Srijita Sanyal, Adam Umra, Aydin Sezgin
similarity 0.65
Abstract

Wireless digital twins are essential for environment-aware 6G communications, motivating the investigation of frequency range 3 (FR3), an emerging mid-band regime offering a promising balance between bandwidth and propagation characteristics. Neural Radio Frequency (RF) fields provide continuous surrogates for site-specific radio propagation, but adapting a scene-specific field to a new environment can require substantial measurements and retraining. To this end, we propose the Latent-Adaptive Neural Multipath Field (LANMF), a scene-conditioned FR3 model that predicts path-resolved delays, complex channel impulse response (CIR) coefficients, and arrival and departure directions from transmitter-receiver coordinates. LANMF learns shared propagation representations across source environments and adapts to unseen scenes by optimizing only a 16-dimensional scene latent. Evaluated on six ray-traced indoor scenes at 7.5 GHz, latent-only adaptation yields improvements in prediction with just 5-10 target links (0.42-0.83% of available links). Compared with full-network fine-tuning, it updates only 16 persistent target parameters, reducing adaptation time by 28-30% and incremental peak GPU memory by 82-85%. While the proposed solution supports various wireless applications, we demonstrate its utility through beam-candidate reduction using a 64-beam codebook, retaining measurement-based final beam selection.

0.27

DeepRT-Cal: Learning to Calibrate Ray-Traced Twin Channel Statistics with Low-Fidelity Environmental Geometry

eess.SP ·2026-11-06 ·Shaoyi Liu, Jianhua Zhang, Li Yu, Yichen Cai, Tao Wu +3 more
similarity 0.65
Abstract · 15 pages, 14 figures, 3 tables

Sixth-generation (6G) wireless systems increasingly rely on digital twin channels (DTCs) to represent and interact with physical radio environments. Ray tracing (RT) is naturally suited to DTC construction because it provides deterministic and physically interpretable channel predictions. However, high-fidelity three-dimensional environment models are expensive to obtain, whereas geometric inaccuracies in low-fidelity models can alter the detected multipath components (MPCs) and consequently distort received-power and delay-domain twin channel statistics. Building on the DeepRT ray-tracing framework, this paper proposes DeepRT-Cal, a geometry-aware cross-fidelity calibration framework that predicts high-fidelity twin channel statistics from low-fidelity geometry and RT features.The network encodes global link descriptors, masked low-fidelity MPC tokens, propagation-corridor geometry, and link-centered environmental objects. During training, detailed geometry is introduced as privileged information with structured masking, while deployment requires only low-fidelity geometry and low-fidelity RT information. A link-conditioned cross-attention module retrieves the environmental context relevant to each Tx--Rx link. The prediction heads estimate high-fidelity twin channel statistics, including total received power, RMS delay spread, mean excess delay, and a normalized power-weighted power-delay profile (PDP). Outdoor evaluation shows that, in an non-line of sight (NLoS) region, the method reduces power MAE from 16.80 to 3.88 dB and RMS delay-spread MAE from 304.89 to 98.19 ns. In a LoS-dominated region, power prediction improves, while RMS delay-spread accuracy remains comparable to direct RT.

0.28

Foundation Models for Wireless Localization: Pretraining, Adaptation, and Utilization

eess.SP ·2026-08-31 ·Guangjin Pan, Jiajia Guo, Zheng Xing, Hui Chen, Chao-Kai Wen +2 more
similarity 0.64
Abstract · 4 pages, 1 table. This work has been submitted to the IEEE for possible publication

Accurate wireless localization is a key enabler for 6G networks, yet remains challenging under diverse and rapidly changing propagation conditions. Model-based methods degrade when multipath channels are non-resolvable and model mismatches occur, while supervised deep learning demands large labeled datasets and generalizes poorly to new deployments. Inspired by foundation models (FMs) in language and vision, this article presents a unified framework for FM-based wireless localization that learns transferable channel representations from large-scale unlabeled channel state information and adapts to new environments with minimal or even no supervision. We review the fundamentals of FMs, compare the FM paradigm with existing localization approaches, and introduce a three-stage framework spanning large-scale pretraining, localization-oriented fine-tuning, and context-augmented inference, together with the location-aware applications it enables. Ray-tracing-based case studies show improved positioning accuracy and cross-environment generalization. Finally, we present an outlook on key research directions toward AI-native networks for wireless localization.

0.21

Electromagnetic Twin: Completing the Wireless World from Sparse Channel Evidence

eess.SP ·2026-08-21 ·Tuo Wu, Jie Tang, Kangda Zhi, Junteng Yao, Maged Elkashlan +3 more
similarity 0.64
Abstract

Acquiring dense channel information over many locations and beams incurs considerable pilot and processing overhead. Radio maps and channel knowledge maps (CKMs) reduce this overhead by reusing site-specific channel information, but their contents must be refreshed when new measurements or environmental observations become available. This paper introduces an \emph{electromagnetic twin} as an updatable digital representation that uses sparse channel evidence to reconstruct the wireless state requested by communication queries. Rather than replacing radio maps or CKMs, the twin uses a CKM as channel memory, combines it with registered scene information, and regenerates its outputs after each evidence update. We instantiate this idea by completing a two-dimensional channel-gain field from sparse samples and an incomplete floor plan. A learned RF completion backbone recovers the main propagation structure, and a lightweight residual adapter tests whether frozen CLIP features provide useful side information. With $4\%$ measured locations and $55\%$ missing semantic objects, the RF backbone attains $4.44$ dB RMSE, compared with $8.29$ dB for CKM interpolation and $8.38$ dB for an incomplete physics prior. Residual adaptation reduces RMSE by a paired mean of $0.135$ dB (95\% confidence interval: $0.100$--$0.169$ dB), but a same-capacity random-feature control is statistically indistinguishable from the CLIP-conditioned adapter. The results therefore support the measurement--update--query loop and lightweight residual correction, while avoiding an unsupported attribution of the correction to visual semantics.

0.46

Latent Twin Operator

cs.CE math.NA ·2026-09-28 ·Deepanshu Verma, Riley Chen, Matthias Chung
benchmarkhot direction similarity 0.64
Abstract · 17 pages, 2 figures, 5 tables

Surrogate models deployed on real physical systems rarely see data at fixed resolutions: sensor configurations vary across deployments and may evolve over time as sensing infrastructure changes. We introduce the Latent Twin Operator (LTO), a latent-space surrogate for time-evolving PDEs with a Convolutional Conditional Neural Process (ConvCNP)-style encoder and decoder that accepts a context set of $N$ sensor observations with arbitrary placement and can be queried at any resolution. A learned latent evolution map advances the encoded state directly between arbitrary time points, decoupling temporal evolution from the observation and query discretizations. We derive an explicit $\mathcal{O}(N^{-2/(3D)})$ rate for the context discretization error in spatial dimension $D$ under quasi-uniform refinement. We verify the predicted decay empirically on a 2D heat-equation benchmark. Across time-dependent PDE benchmarks, LTO achieves strong accuracy under one-step comparisons and transfers from native to coarser spatial resolutions with fixed parameters. On Navier--Stokes, its direct latent evolution further reduces error over longer prediction horizons relative to recursive evaluation.

0.32