CS Paper Radar

Cross-View Vision-Aided Proactive BS Selection and Beam Prediction for mmWave V2I Communications

Zijiao Hu, Haiyao Yu, Gaoyang Pang, Guangchen Wang, Litianyi Zhang, Wanchun Liu, George C. Alexandropoulos, Branka Vucetic, Yonghui Li

eess.SP ·submitted 2026-09-01 03:02 UTC · v1
code/data

Abstract

This paper investigates environmental-sensing-aided proactive base station (BS) selection and beam prediction for millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) wireless systems. We exploit onboard panoramic street-view images and a preloaded satellite map to predict communication-relevant environmental information around the vehicle, including nearby building footprints and heights. The predicted height map provides a compact environmental prior and is combined with historical mobility information to jointly predict the next-slot line-of-sight (LoS) state, transmission rate, and transmit and receive beam selections. On our dataset covering different real-world regions across New South Wales, Australia, the proposed framework achieves 91.4% LoS classification accuracy, 0.638 bps/Hz mean absolute error of data rate prediction, and more than 40% higher transmission rate than the conventional reactive baseline in geographically unseen regions, outperforming all evaluated deployable learning-based baselines. The dataset and code will be released at https://github.com/Huzijiao/Cross-view_V2I

Closest papers

Nearest neighbours by meaning across the whole index.

BeamGuard: Risk-Aware Multimodal Beam Forecasting and Adaptive Virtual Beamwidth Control for 6G mmWave V2I Links

eess.SP ·2026-08-26 ·Abidemi Orimogunje, Dejan Vukobratovic, Sunwoo Kim, Igbafe Orikumhi, Vukan Ninkovic +2 more
published similarity 0.63
Abstract · Accepted for Publication in IEEE Open Journal of the Communications Society . 18 pages, 5 figures, 11 Tables

Reliable beam management is a central challenge for 6G millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) links, where narrow beams provide high array gain but are vulnerable to mobility-induced misalignment, blockage, and domain variation. BeamGuard is a multimodal sensing-aided beam-management framework that combines exteroceptive sensing with optional partial in-band mmWave power observations to forecast future beam distributions and select adaptive virtual beamwidth actions for reliable V2I control. It fuses camera, radar, LiDAR, GPS, and mmWave power observations with a temporal multimodal forecaster, then converts the predicted posterior into a beam center and virtual codebook-level beamwidth through a risk-aware planner. Here, virtual beamwidth denotes adjacent-beam coverage in the codebook index space rather than physical analog wide-beam synthesis. BeamGuard supports sensor-only operation for beam-training overhead reduction, limited in-band operation with masked beam-power entries, and full hybrid operation with sensing and communication-side measurements. We evaluate BeamGuard on DeepSense 6G Scenarios 32 and 33, with additional held-out tests on Scenarios 31 and 34, covering day--night training, transfer, limited adaptation, ablations, budget sweeps, and lightweight baselines. The full-hybrid anchor, used as the complete-system reference, achieves Top-1/Top-3/Top-5 accuracies of approximately \(0.393/0.778/0.897\), while the planner attains a threshold-based outage probability of about \(0.0060\) with a gain ratio of about \(0.895\). Matched-budget baselines further show that BeamGuard improves over multilayer perceptron, recurrent, and temporal convolutional predictors under comparable in-band observation settings. These results demonstrate robust, overhead-aware beam management through multimodal forecasting and risk-aware virtual beamwidth control.

0.64

Robust Beam Prediction for V2X Networks with Multi-Modal Sensing

cs.LG ·2026-09-09 ·Chen Shang, Dinh Thai Hoang, Diep N. Nguyen, Jiadong Yu
published similarity 0.62
Abstract · 6 pages, 3 figures

Integrated sensing and communication (ISAC) provides a promising foundation for beam prediction in future vehicle-to-everything (V2X) networks. However, existing sensing-assisted beamforming methods still rely heavily on radio-frequency sensing, which may become unreliable in complex vehicular environments. Meanwhile, the growing availability of heterogeneous sensors, such as cameras and LiDAR, offers new opportunities to improve beam prediction through richer environmental perception. Motivated by this, this paper proposes a multi-modal beam prediction framework for V2X networks. Specifically, we develop BeamTransFuser, a hierarchical Transformer-based architecture that progressively fuses camera, LiDAR, radar, and GPS observations for robust beam prediction. In addition, to handle possible missing modalities in practical deployment, we introduce a generative module that reconstructs missing modality features from the available observations. Experimental results on a real-world multi-modal V2X dataset show that the proposed framework consistently outperforms representative baselines, while the generative module further improves robustness under incomplete sensing conditions.

0.32

Link Both Views: Cross-Image Routing Attention for Dual-Endpoint V2I Beam-Pair Power Prediction

eess.SP cs.LG ·2026-10-13 ·Shiliang Lu, Lu Bai, Ziwei Huang, Xiang Cheng
similarity 0.62
Abstract

For sensing-aided communications, single-endpoint sensing offers only a partial view of propagation, motivating link-centric sensing across both endpoints. We propose cross-image routing attention (CIRA) for sparse association and mutual enhancement of propagation-relevant features from dual-endpoint RGB images. Building on CIRA, CiFormer predicts millimeter-wave (mmWave) beam-pair power matrices for vehicle-to-infrastructure (V2I) communications. Experiments show that CiFormer reduces mean absolute error and improves top-1 beam-pair selection accuracy by 3.15 percentage points over the strongest baseline. Visualizations and ablation studies support dual-endpoint sensing and selective cross-view interaction in capturing propagation-relevant dependencies, suggesting broader applications in wireless tasks beyond beam prediction.

0.20

SiGMA: Site-Grounded Multi-Modal ISAC Data Generation for Environment-Aware Communications

eess.SP cs.DB ·2026-11-16 ·Yijie Bian, Wei Guo, Kai Zhang, Xiao Ye, Shurui Xu +3 more
code/data similarity 0.61
Abstract

Learning-based multi-modal integrated sensing and communication (ISAC) requires data that associate environmental observations with the wireless response generated by the same site and dynamic scene state. Acquiring such data at new sites requires sensor calibration, coordinated measurements, and cross-modal association. We present site-grounded multi-modal ISAC data generation (SiGMA), which combines OpenStreetMap (OSM), Overture Maps, and procedural three-dimensional (3D) reconstruction to create georeferenced urban scenes. A shared scene geometry and time-indexed actor state link synchronized red-green-blue (RGB) images, light detection and ranging (LiDAR) point clouds, positioning records, frequency-modulated continuous-wave (FMCW) Radar in-phase and quadrature (IQ) samples, and ray-traced wireless channels. For configurable reflected propagation under direct-link blockage, SiGMA generates optional reconfigurable intelligent surface (RIS) component channels for phase-configuration evaluation across shared scene states. The evaluation results demonstrate that the framework improves zero-shot beam prediction performance on real DeepSense 6G measurements compared with an OSM-derived synthetic-data baseline. A camera-assisted RIS case study further demonstrates the generation of sensing-associated supervision for configurable reflected propagation. The dataset generation pipeline is available at https://github.com/Trans-cending/SiGMA-main.

0.39

Radar-Only Long-Term Beam Prediction in mmWave Vehicular Networks: An Empirical Study of Doppler Input and Cross-Modal Distillation

eess.SP ·2026-10-14 ·Jeongwan Kang, Miguel Bordallo López, Nhan Thanh Nguyen, Junhyeong Kim, Sunwoo Kim
similarity 0.61
Abstract · 13 pages, 6 figures, 3 tables; supplementary material (11 pages) as an ancillary file. This work has been submitted to the IEEE for possible…

Sensing-aided beam prediction could cut the beam-training overhead of millimeter-wave vehicular links, and two design choices could strengthen a radar-only predictor: a Doppler-resolved input and knowledge distilled from a camera during training. We measure what each is worth in received power rather than in top-1 accuracy, whose differences of a few points amount to only tenths of a decibel. We use real DeepSense 6G measurements, mainly at one roadside site, and one convolutional-recurrent predictor family evaluated open-loop up to 0.67 s ahead. Adding a range-Doppler map to the range-angle map lowers the mean beam-selection loss by 0.28 dB (95% bootstrap interval [0.14, 0.41]). The gain comes from the Doppler content, not from the extra input, and replicates, as pre-specified, at a second base station, although holding the last measured beam beats both predictors there. Cross-modal knowledge distillation from a motion-mask vision-radar teacher, by contrast, changes received power by -0.01 dB ([-0.07, +0.06]). The tested teacher, student, fusion and distillation variants show the same null in the metric each was scored on. Where distillation helps, in an exploratory run with few training passes, a radar-only teacher trained on all training passes reproduces most of the gain. For this predictor family and the full training set, the measurable gain at the link comes from Doppler-resolved radar content; no tested route for transferring training-only visual information adds a resolved gain.

0.55

Few-Shot Beam Selection for Embodied AI via In-Context Learning and Conformal Prediction

eess.SP ·2026-11-05 ·Weicao Deng, Ruihan Li, Feihang Xu, Min Li
similarity 0.60
Abstract · 6 pages, 4 figures. Accepted by the 2026 IEEE International Symposium on Information Theory Workshop (ISIT 2026 Workshop) on Reliable Machin…

Millimeter-wave (mmWave) communications are essential for supporting massive multimodal sensory data exchange in Embodied Artificial Intelligence (EAI) systems. However, fast and reliable beam selection for mmWave communication remains a critical bottleneck due to the prohibitive overhead associated with conventional beam training. Although location-aided beam prediction offers a promising alternative, its performance is often limited by localization errors and the need for extensive training data. To address these challenges, we propose a novel framework termed In-Context Learning driven Cross-Validation Conformal Prediction (ICL+CVCP) for beam prediction. The proposed framework utilizes the training-free adaptation capability of ICL, enabling effective operation with only a small number of demonstration samples and eliminating the need for large-scale data collection and model fine-tuning. In addition, the CVCP module constructs compact, distribution-free candidate beam sets that provably contain the optimal beam with a user-defined probability. Experimental results confirm that ICL+CVCP consistently satisfies the desired empirical coverage while significantly reducing pilot overhead and computational latency, thereby meeting the stringent reliability and efficiency requirements of EAI applications.

0.28

Enabling Versatile Human Sensing through Wi-Fi Beamforming Feedback

eess.SP ·2026-11-12 ·Jingzhe Zhang, Peiliang Wang, Yitong Shen, Ning Wang, Mingzhe Chen +1 more
similarity 0.60
Abstract

Wi-Fi sensing enables contactless human sensing, while most existing systems rely on Channel State Information, which is accessible only on a limited range of Wi-Fi chipsets. In contrast, Beamforming Feedback Information (BFI) is standardized in modern Wi-Fi and readily accessible on a wide range of commodity devices, offering new opportunities for human sensing. In this paper, we present BeamLens, a Wi-Fi sensing system that extracts fine-grained spatial information from BFI to enable versatile human sensing. Specifically, we jointly estimate the angle of departure and relative time of flight from BFI to extract fine-grained spatial information and leverage two AP-STA links to capture complementary azimuth and elevation views. We further design a sparse physical antenna array and construct a uniform virtual antenna array to enhance spatial resolution. Moreover, we fuse complementary views through self-supervised learning, combining temporally aware cross-view contrastive learning and temporal masked reconstruction to learn a versatile backbone for diverse human sensing tasks. Extensive evaluations demonstrate that BeamLens achieves 90.16\% accuracy in human activity recognition, a mean per-joint position error of 8.64\,cm in 3D human pose estimation, and 70.64\% intersection over union in human silhouette estimation, while exhibiting strong generalization to unseen environments and subjects.

0.11

Digital Twin-Assisted Fast Beam Alignment for mmWave MIMO Networks

cs.IT cs.LGcs.NI ·2026-10-31 ·Muhammad Kamran Saeed, Ashfaq Khokhar
hot direction similarity 0.60
Abstract

Millimeter-wave (mmWave) communication relies on directional beam sweeping for initial access, which incurs substantial latency and signaling overhead as antenna arrays grow large and deployments become denser. Machine-learning-based beam prediction can reduce this overhead, but its effectiveness depends on training data that accurately reflects the deployment environment, a requirement that is difficult to meet in practice. This paper presents a latency-aware beam management architecture that integrates digital-twin-assisted prediction, regionbased localization, weighted ensemble learning, and explainability-driven beam pruning into a unified framework. A digital twin (DT) generates site-specific ray-traced channel knowledge offline, enabling environment-aware beam prediction without exhaustive real-world measurements and supporting both initial access and beam tracking. The proposed ensemble learning scheme combines a base classifier and a specialist classifier through reliability-weighted fusion to improve prediction accuracy and robustness, while explainable artificial intelligence (XAI)-based attribution pruning reduces the beam codebook to a small subset of the most informative beams for beam allocation. To capture the distributional mismatch between the DT and real-world environments: the network was trained on imperfect digital-twin data but evaluated on real-world surrobase data. Results show that the proposed method achieves 96.80% top-1 and 98.36% top-3 beam prediction accuracy, while reducing over-the-air sounding overhead by nearly an order of magnitude relative to exhaustive sweeping, outperforming convolutional and deep neural network baselines from prior work.

0.34