CS Paper Radar

WM4ISAC: World Model for Proactive ISAC Under Dynamic Blockage

Zichao Xiao, Linlong Wu, Bhavani Shankar Mysore R

eess.SP ·submitted 2026-10-06 12:41 UTC · v1
publishedtheory

Abstract

Dynamic blockage severely degrades vehicular integrated sensing and communication (ISAC), since narrow millimeter-wave beams must be adjusted before the line-of-sight (LoS) link is blocked or misaligned. This paper proposes WM4ISAC, a proactive ISAC framework built on a world model that learns a reusable latent dynamics model of the traffic environment from downlink radar heatmaps, rather than directly mapping observations to beam indices. The proposed framework uses a vision (V) module to compress sensing observations, an action-conditioned memory (M) module to predict latent environment evolution, and lightweight event heads to evaluate LoS alignment, blockage, and scatter-assisted non-line-of-sight (NLoS) alignment for candidate beams. A codebook-level controller then uses these event predictions to proactively switch between LoS and NLoS beams without knowing the future user or blocker states. Simulations under dynamic blockage show that WM4ISAC improves the mean rate by $28.9\%$ over current LoS tracking, raises the 5\%-tile rate from $0.9$ Mbps to $30.5$ Mbps, and reaches $88.7\%$ of the perfect-information upper bound.

Comment
Accepted to IEEE ISAC 2026

Closest papers

Nearest neighbours by meaning across the whole index.

BeamGuard: Risk-Aware Multimodal Beam Forecasting and Adaptive Virtual Beamwidth Control for 6G mmWave V2I Links

eess.SP ·2026-08-26 ·Abidemi Orimogunje, Dejan Vukobratovic, Sunwoo Kim, Igbafe Orikumhi, Vukan Ninkovic +2 more
published similarity 0.60
Abstract · Accepted for Publication in IEEE Open Journal of the Communications Society . 18 pages, 5 figures, 11 Tables

Reliable beam management is a central challenge for 6G millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) links, where narrow beams provide high array gain but are vulnerable to mobility-induced misalignment, blockage, and domain variation. BeamGuard is a multimodal sensing-aided beam-management framework that combines exteroceptive sensing with optional partial in-band mmWave power observations to forecast future beam distributions and select adaptive virtual beamwidth actions for reliable V2I control. It fuses camera, radar, LiDAR, GPS, and mmWave power observations with a temporal multimodal forecaster, then converts the predicted posterior into a beam center and virtual codebook-level beamwidth through a risk-aware planner. Here, virtual beamwidth denotes adjacent-beam coverage in the codebook index space rather than physical analog wide-beam synthesis. BeamGuard supports sensor-only operation for beam-training overhead reduction, limited in-band operation with masked beam-power entries, and full hybrid operation with sensing and communication-side measurements. We evaluate BeamGuard on DeepSense 6G Scenarios 32 and 33, with additional held-out tests on Scenarios 31 and 34, covering day--night training, transfer, limited adaptation, ablations, budget sweeps, and lightweight baselines. The full-hybrid anchor, used as the complete-system reference, achieves Top-1/Top-3/Top-5 accuracies of approximately \(0.393/0.778/0.897\), while the planner attains a threshold-based outage probability of about \(0.0060\) with a gain ratio of about \(0.895\). Matched-budget baselines further show that BeamGuard improves over multilayer perceptron, recurrent, and temporal convolutional predictors under comparable in-band observation settings. These results demonstrate robust, overhead-aware beam management through multimodal forecasting and risk-aware virtual beamwidth control.

0.64

Cross-View Vision-Aided Proactive BS Selection and Beam Prediction for mmWave V2I Communications

eess.SP ·2026-09-01 ·Zijiao Hu, Haiyao Yu, Gaoyang Pang, Guangchen Wang, Litianyi Zhang +4 more
code/data similarity 0.59
Abstract

This paper investigates environmental-sensing-aided proactive base station (BS) selection and beam prediction for millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) wireless systems. We exploit onboard panoramic street-view images and a preloaded satellite map to predict communication-relevant environmental information around the vehicle, including nearby building footprints and heights. The predicted height map provides a compact environmental prior and is combined with historical mobility information to jointly predict the next-slot line-of-sight (LoS) state, transmission rate, and transmit and receive beam selections. On our dataset covering different real-world regions across New South Wales, Australia, the proposed framework achieves 91.4% LoS classification accuracy, 0.638 bps/Hz mean absolute error of data rate prediction, and more than 40% higher transmission rate than the conventional reactive baseline in geographically unseen regions, outperforming all evaluated deployable learning-based baselines. The dataset and code will be released at https://github.com/Huzijiao/Cross-view_V2I

0.25

Current-Future Rate Tradeoffs in ISAC Under Random Path Changes

eess.SP ·2026-11-03 ·Hang Ruan, Zhaofeng Liu, Taneli Riihonen
similarity 0.56
Abstract · 6 pages, 5 figures

In mobile wireless links, motion changes path directions and visibility, and blockage can shift communication to a different propagation path. Integrated sensing and communication (ISAC) allows a base station (BS) to use echoes of data transmissions to monitor these changes and guide subsequent beam selection. Illuminating objects that govern future path availability may reduce the beamforming gain on the current communication route. Existing sensing-communication tradeoffs and dynamic beam-control frameworks do not directly quantify the future communication gain from this current-rate sacrifice. We quantify sensing value by the future-rate gain enabled by echo-adaptive beam selection. We derive explicit expressions for the future communication gain and the net gain after accounting for the current-rate loss. The analysis uses a coupled communication-echo channel with binary-state Markov motion over a finite burst informed by one processed echo. We show that monitoring is worthwhile when its future-rate gain exceeds the current loss, while more informative observations yield zero additional future rate if they cannot change any future optimal beam. We derive interpretable gain bounds exposing the roles of improved scene discrimination, motion memory and future beam-rate differences. Reciprocal-channel tests demonstrate positive net accumulated-rate gains from monitoring a moving blocker during reflected-path service, including continuous position uncertainty.

0.39

RadioSight: Predictive mmWave XR Network Optimization from Dynamic Neural Radio Fields

cs.NI ·2026-08-30 ·Lihao Zhang, Paul Kudyba, Zhenlin An, Haijian Sun
top venue similarity 0.56
Abstract · Accepted to ACM MobiCom 2026. 21 pages, 20 figures, 3 tables

Next-generation extended reality (XR) networks rely on mmWave communication for multi-gigabit throughput, yet highly directional links are vulnerable to user mobility and blockages, causing frequent outages under reactive beam management. Emerging neural radio fields can predict radio propagation, but prior work remains limited to offline channel reconstruction. We introduce RadioSight, a real-time multi-modal radio field system for predictive mmWave optimization and proactive Multi-User MIMO beamforming. RadioSight combines backward beam-tracing with real-time semantic object synchronization to anticipate RF geometry changes without full model retraining. Implemented as an edge-executable pipeline for commercial 28 GHz arrays, RadioSight determines each scheduling window's beams during the preceding window without exhaustive beam sweeps. Experiments show that RadioSight reduces beam-search error by up to ~50%, improves median throughput by 2x, and enhances link stability.

0.55

StarBOA: Real-Time Mamba State-Space Unrolling for Sparse Radar Micro-Doppler in ISAC Networks

cs.LG cs.ITcs.NI ·2026-09-27 ·Mustafa Bora Çelik, Ceren Çelik, Orhan Gazi
similarity 0.56
Abstract · 5 pages, 2 figures

In Integrated Sensing and Communications (ISAC), radar sensing must operate under chirp subsampling with up to 90\% missing data. An attention-based baseline, limited to a 52~ms buffer, collapses toward maximum uniform entropy ($H=2.584$ bits) as sparsity increases, failing to capture long-range gait-cycle context. We propose StarBOA, which replaces attention with a causal Mamba state-space model that updates incrementally on a per-window basis without re-scanning past reconstructions. By maintaining a persistent state, StarBOA integrates over $100\times$ more temporal history at no additional per-step computational cost. StarBOA outperforms the baseline's published results across all sparsity levels, with SSIM gains increasing from $+0.0379$ at 50\% missing data to $+0.2472$ at 90\%. Each window is processed in 1.53~ms with zero lookahead, demonstrating efficient causal reconstruction under extreme chirp subsampling.

0.40

RaMOD: Moving-Object Detection from Raw mmWave Radar Cubes under Ego Motion

cs.RO cs.CV ·2026-11-09 ·Yuan Fang, Long Zhuang, Lingzi Xing, Xijia Wei, Jingqi Jiang +3 more
similarity 0.56
Abstract

Millimeter-wave (mmWave) radar provides weather-robust sensing and direct Doppler measurements, yet automotive perception pipelines often reduce its output to sparse point clouds or two-dimensional projections, leaving raw range-azimuth-Doppler (RAD) cubes underutilized. Ego motion induces Doppler responses from world-static structures, while Doppler wrapping aliases radial velocities, complicating moving-object detection and velocity estimation. We present RaMOD (Radar-based Moving-Object Detection), a real-time framework for moving-object detection and velocity estimation from raw RAD cubes acquired by a vehicle-mounted single-chip radar. RaMOD explicitly estimates frame-wise ego motion and uses the estimated radar translational velocity to predict the Doppler region of world-static structures and suppress returns within it. It temporally encodes the suppressed cubes into multi-scale features to predict RAD-space boxes with class labels. For each detected object, it predicts radial and forward velocities under raw-Doppler and Doppler-unwrapped hypotheses, together with Doppler-wrapping probabilities. On our BRIDGE-Liv dataset, RaMOD outperforms all compared raw-radar methods across RAD-cube, RA, and RD detection settings, achieving 80.8% cube mAP at IoU 0.30, 15.7 percentage points above the strongest RAD-cube baseline. Velocity MAE is 1.128 m/s, with 99.87% Doppler-wrapping accuracy.

0.21

SiGMA: Site-Grounded Multi-Modal ISAC Data Generation for Environment-Aware Communications

eess.SP cs.DB ·2026-11-16 ·Yijie Bian, Wei Guo, Kai Zhang, Xiao Ye, Shurui Xu +3 more
code/data similarity 0.56
Abstract

Learning-based multi-modal integrated sensing and communication (ISAC) requires data that associate environmental observations with the wireless response generated by the same site and dynamic scene state. Acquiring such data at new sites requires sensor calibration, coordinated measurements, and cross-modal association. We present site-grounded multi-modal ISAC data generation (SiGMA), which combines OpenStreetMap (OSM), Overture Maps, and procedural three-dimensional (3D) reconstruction to create georeferenced urban scenes. A shared scene geometry and time-indexed actor state link synchronized red-green-blue (RGB) images, light detection and ranging (LiDAR) point clouds, positioning records, frequency-modulated continuous-wave (FMCW) Radar in-phase and quadrature (IQ) samples, and ray-traced wireless channels. For configurable reflected propagation under direct-link blockage, SiGMA generates optional reconfigurable intelligent surface (RIS) component channels for phase-configuration evaluation across shared scene states. The evaluation results demonstrate that the framework improves zero-shot beam prediction performance on real DeepSense 6G measurements compared with an OSM-derived synthetic-data baseline. A camera-assisted RIS case study further demonstrates the generation of sensing-associated supervision for configurable reflected propagation. The dataset generation pipeline is available at https://github.com/Trans-cending/SiGMA-main.

0.43

IMM-based Multiple Object Tracking using a State Prediction Neural Network

cs.RO cs.AI ·2026-09-10 ·Chan-Bin Lim, Dong-Hee Paek, Seung-Hyun Kong
similarity 0.55
Abstract · 8 pages, 4 figures

Object tracking is essential for autonomous vehicles to avoid obstacles and plan routes. Radar maintains detection performance even in adverse weather and can measure relative velocity through the Doppler effect, making it well suited for object tracking. In this paper, we propose a data-driven state PRedictor-based Interacting Multiple Model tracking method (PR-IMM) that improves nonlinear object-motion representation while preserving the stability and interpretability of physics-based motion models. The proposed method employs a transformer-based PRediction model (PR) that incorporates radar Doppler measurements to predict object displacement. The PR model is integrated into the IMM as a mode alongside the CV, CA, and CT motion models, and their prior positions are dynamically combined according to the mode probabilities. Experimental results show that PR-IMM reduces position-estimation error by 57.3% over the IMM and by 16.5% over the PR, while reducing ID switches by 25.3% and improving IDF1 by 9.6% over the IMM.

0.33