CS Paper Radar

Link Both Views: Cross-Image Routing Attention for Dual-Endpoint V2I Beam-Pair Power Prediction

Shiliang Lu, Lu Bai, Ziwei Huang, Xiang Cheng

eess.SP cs.LG ·submitted 2026-10-13 11:31 UTC · v1

Abstract

For sensing-aided communications, single-endpoint sensing offers only a partial view of propagation, motivating link-centric sensing across both endpoints. We propose cross-image routing attention (CIRA) for sparse association and mutual enhancement of propagation-relevant features from dual-endpoint RGB images. Building on CIRA, CiFormer predicts millimeter-wave (mmWave) beam-pair power matrices for vehicle-to-infrastructure (V2I) communications. Experiments show that CiFormer reduces mean absolute error and improves top-1 beam-pair selection accuracy by 3.15 percentage points over the strongest baseline. Visualizations and ablation studies support dual-endpoint sensing and selective cross-view interaction in capturing propagation-relevant dependencies, suggesting broader applications in wireless tasks beyond beam prediction.

Closest papers

Nearest neighbours by meaning across the whole index.

Cross-View Vision-Aided Proactive BS Selection and Beam Prediction for mmWave V2I Communications

eess.SP ·2026-09-01 ·Zijiao Hu, Haiyao Yu, Gaoyang Pang, Guangchen Wang, Litianyi Zhang +4 more
code/data similarity 0.62
Abstract

This paper investigates environmental-sensing-aided proactive base station (BS) selection and beam prediction for millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) wireless systems. We exploit onboard panoramic street-view images and a preloaded satellite map to predict communication-relevant environmental information around the vehicle, including nearby building footprints and heights. The predicted height map provides a compact environmental prior and is combined with historical mobility information to jointly predict the next-slot line-of-sight (LoS) state, transmission rate, and transmit and receive beam selections. On our dataset covering different real-world regions across New South Wales, Australia, the proposed framework achieves 91.4% LoS classification accuracy, 0.638 bps/Hz mean absolute error of data rate prediction, and more than 40% higher transmission rate than the conventional reactive baseline in geographically unseen regions, outperforming all evaluated deployable learning-based baselines. The dataset and code will be released at https://github.com/Huzijiao/Cross-view_V2I

0.25

Predictive Beamforming via Echo-Beam Modality Separation with Cross-Attention for ISAC Systems

eess.SP ·2026-10-07 ·Seokjun Park, Jiwhan Jang, Jinseok Choi
published similarity 0.59
Abstract

In this paper, we propose a deep learning-based predictive beamforming algorithm for integrated sensing and communications in vehicle-to-infrastructure networks, where echo signals are leveraged to enhance communication performance. We formulate a sum spectral efficiency maximization problem under a sensing signal-to-interference-plus-noise ratio (SINR) constraint and construct a penalty-based unconstrained surrogate objective for network training. Based on this formulation, the beamforming matrix is predicted using sensing echoes and historical beamformers from previous time slots. To this end, we develop a predictive beamforming network that processes sensing echoes and beamforming inputs through separate encoders to preserve their modality-specific characteristics. This separate design enables each modality to learn rich and complementary representations which are more effectively exploited through a cross-attention mechanism compared to naive input fusion. The resulting features are fused via cross-attention, while gated recurrent units capture temporal dependencies across time slots. Simulation results validate the performance of the proposed method.

0.45

Robust Beam Prediction for V2X Networks with Multi-Modal Sensing

cs.LG ·2026-09-09 ·Chen Shang, Dinh Thai Hoang, Diep N. Nguyen, Jiadong Yu
published similarity 0.59
Abstract · 6 pages, 3 figures

Integrated sensing and communication (ISAC) provides a promising foundation for beam prediction in future vehicle-to-everything (V2X) networks. However, existing sensing-assisted beamforming methods still rely heavily on radio-frequency sensing, which may become unreliable in complex vehicular environments. Meanwhile, the growing availability of heterogeneous sensors, such as cameras and LiDAR, offers new opportunities to improve beam prediction through richer environmental perception. Motivated by this, this paper proposes a multi-modal beam prediction framework for V2X networks. Specifically, we develop BeamTransFuser, a hierarchical Transformer-based architecture that progressively fuses camera, LiDAR, radar, and GPS observations for robust beam prediction. In addition, to handle possible missing modalities in practical deployment, we introduce a generative module that reconstructs missing modality features from the available observations. Experimental results on a real-world multi-modal V2X dataset show that the proposed framework consistently outperforms representative baselines, while the generative module further improves robustness under incomplete sensing conditions.

0.32

Enabling Versatile Human Sensing through Wi-Fi Beamforming Feedback

eess.SP ·2026-11-12 ·Jingzhe Zhang, Peiliang Wang, Yitong Shen, Ning Wang, Mingzhe Chen +1 more
similarity 0.58
Abstract

Wi-Fi sensing enables contactless human sensing, while most existing systems rely on Channel State Information, which is accessible only on a limited range of Wi-Fi chipsets. In contrast, Beamforming Feedback Information (BFI) is standardized in modern Wi-Fi and readily accessible on a wide range of commodity devices, offering new opportunities for human sensing. In this paper, we present BeamLens, a Wi-Fi sensing system that extracts fine-grained spatial information from BFI to enable versatile human sensing. Specifically, we jointly estimate the angle of departure and relative time of flight from BFI to extract fine-grained spatial information and leverage two AP-STA links to capture complementary azimuth and elevation views. We further design a sparse physical antenna array and construct a uniform virtual antenna array to enhance spatial resolution. Moreover, we fuse complementary views through self-supervised learning, combining temporally aware cross-view contrastive learning and temporal masked reconstruction to learn a versatile backbone for diverse human sensing tasks. Extensive evaluations demonstrate that BeamLens achieves 90.16\% accuracy in human activity recognition, a mean per-joint position error of 8.64\,cm in 3D human pose estimation, and 70.64\% intersection over union in human silhouette estimation, while exhibiting strong generalization to unseen environments and subjects.

0.14

CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applications

cs.CV cs.AI ·2026-08-16 ·Yubo Zhang, Yiyao Liu
similarity 0.57
Abstract

Synchronized camera and wireless measurements observe the same scene through different physical channels. The central difficulty is that a representation learned in one deployment can fail when viewpoint, traffic, illumination, and propagation geometry change. This paper presents CM-MAE, a self-supervised vision--wireless pretraining framework for cross-scenario representation transfer. The evaluated real-data model uses only RGB frames and the measured 64-beam received-power vector available in DeepSense 6G; it does not use ray-traced paths, calibrated depth, or beam-index labels during pretraining. Its central pretraining term is a \emph{soft contrastive alignment loss}. Instead of making the synchronized image--wireless pair the only positive pair, this loss builds a target distribution from similarities between measured beam-power profiles, so nonidentical samples with similar directional responses are not forced apart as false negatives. A masked joint decoder provides the complementary local objective by reconstructing hidden visual patches and wireless angular clusters under modality dropout. After pretraining, a differential-rate fine-tuning rule lets a new fusion head adapt quickly while the encoders move slowly. Under a sequence-disjoint DeepSense 6G protocol, adding the soft alignment loss improves a matched linear-probe transfer average from 24.88\% to 29.49\%. Mild fusion fine-tuning reaches 77.38\% Top-1 accuracy on unseen Scenarios 6--8, and optional transductive normalization adaptation reaches 78.69\%. Since the fusion setting uses the contemporaneous 64-beam power vector at inference, these results should be read as representation-transfer diagnostics, not as proactive beam-prediction or reduced-sweeping claims.

0.04

RayAR: Autoregressive Dominant Path Generation for Low-Overhead MIMO Beam Alignment

eess.SP ·2026-10-31 ·Junxi Huang, Xiucheng Wang, Nan Cheng, Kailong Wang, Jiang Guo +1 more
similarity 0.57
Abstract

Beam alignment in multiple-input multiple-output (MIMO) systems requires selecting suitable transmit and receive beam pairs with limited measurement overhead. Although 3GPP Release 18 investigates beam prediction from partial measurements, collecting these measurements still incurs probing overhead. Geometry can focus this probing through the departure and arrival directions of dominant paths, whose identification requires accounting for coupled diffraction interactions. To address this challenge, we propose RayAR, an autoregressive method that generates dominant propagation paths from urban geometry. RayAR conditions candidate ranking on the path prefix, local diffraction geometry, and receiver reachability, updating this context after each selection until the receiver becomes visible. The completed path's departure and arrival directions rank beam pairs for probing, allowing the pair with the highest received power to be selected from a small candidate set. Under 3GPP Release 18 beam-management metrics, RayAR reduces probing by 96.88\% relative to exhaustive sweeping and achieves the highest optimal-pair hit rate among compared methods at the same budget. Real-world measurements further demonstrate the accuracy of this geometric guidance, with simulation-trained RayAR achieving the lowest departure and arrival angular errors among compared methods without fine-tuning and a mean arrival-direction error of 9.07$^\circ$.

0.36

Efficient Multimodal Beam Prediction for Real-World 6G UAV Communications via Image-Position-Synthetic Fusion

eess.SP eess.IV ·2026-10-10 ·Rifat Bin Reza, Md Ahadul Haque Suvo, Jia Uddin, Saifur Rahman Sabuj
similarity 0.56
Abstract · 19 pages, 7 figures, 5 tables, 2 algorithms

Camera-based beam selection can reduce the need for exhaustive channel measurement in highly mobile millimeter-wave UAV links, but the complementary value of visual and position-derived representations and their behavior under modality degradation require further investigation. This paper develops a staged multimodal framework for current-beam prediction using real-world UAV measurements. The proposed 32-beam classifier combines an ImageNet-pretrained EfficientNet-B3 visual encoder with two deterministic position-derived representations: an explicit Geometric-Kinematic vector and a nonlinear synthetic feature basis constructed from position. The image and synthetic representations are fused first, followed by late fusion with the geometry representation. Experiments on DeepSense 6G Scenario 23 show that Image-Synthetic fusion achieves 86.92% Top-1, 99.03% Top-3, and 99.56% Top-5 accuracy, improving Top-1 performance by 2.64 percentage points over image-only inference and outperforming the 60.71% Top-1 accuracy of synthetic-only inference. Adding the Geometric-Kinematic branch yields the highest measured performance, reaching 87.14% Top-1, 99.12% Top-3, and 99.60% Top-5 accuracy. Controlled input interventions further demonstrate complementary behavior under visual degradation and strong sensitivity to severe synthetic-input corruption. Position-derived nonlinear features provide complementary information to visual context and improve current-beam prediction in the evaluated real-world UAV setting.

0.47

Radio Echo Representation Learning for Semantic Sensing in Multi-Modal ISAC Systems

eess.SP ·2026-10-11 ·Guanping Shang, Anzheng Tang, Kwok Kit Chan, Shenghui Song
similarity 0.54
Abstract · This paper has been submitted to the IEEE trans journals

Semantic sensing extends integrated sensing and communication (ISAC) beyond physical parameter estimation by exploiting task-oriented representations from radio echoes. Nevertheless, existing multimodal sensing remains largely limited to vision-assisted radio physical parameter estimation or typically processes the visual and radio modalities separately, leaving radio representations underutilized for visual task enhancement. Feature-level fusion enables closer cross-modal interaction, while echo interference complicates the learning of user-specific radio representations and its semantic consistency with the visual entities. To address these challenges, this paper proposes a multimodal semantic sensing framework for orthogonal frequency-division multiplexing (OFDM)-ISAC systems. We propose a radio encoder to learn radio representations oriented toward visual localization from superimposed pilot echoes, together with Variational Radio-Visual Grounding (VRVG) to promote semantic consistency between the learned radio representations and visual spatial features. The radio representations are then formulated as semantic probes to highlight the corresponding entities in the visual scene through cross-modal fusion. Experiments using real-world RCooper dataset show that the resulting synergistic radio-visual embeddings enable accurate radio-visual user matching and significantly improve both user-specific visual localization and physical parameter estimation performance. The results substantiate the benefits of radio representation learning and semantically consistent fusion for multimodal semantic sensing.

0.30