CS Paper Radar

Few-Shot Beam Selection for Embodied AI via In-Context Learning and Conformal Prediction

Weicao Deng, Ruihan Li, Feihang Xu, Min Li

eess.SP ·submitted 2026-11-05 01:44 UTC · v1

Abstract

Millimeter-wave (mmWave) communications are essential for supporting massive multimodal sensory data exchange in Embodied Artificial Intelligence (EAI) systems. However, fast and reliable beam selection for mmWave communication remains a critical bottleneck due to the prohibitive overhead associated with conventional beam training. Although location-aided beam prediction offers a promising alternative, its performance is often limited by localization errors and the need for extensive training data. To address these challenges, we propose a novel framework termed In-Context Learning driven Cross-Validation Conformal Prediction (ICL+CVCP) for beam prediction. The proposed framework utilizes the training-free adaptation capability of ICL, enabling effective operation with only a small number of demonstration samples and eliminating the need for large-scale data collection and model fine-tuning. In addition, the CVCP module constructs compact, distribution-free candidate beam sets that provably contain the optimal beam with a user-defined probability. Experimental results confirm that ICL+CVCP consistently satisfies the desired empirical coverage while significantly reducing pilot overhead and computational latency, thereby meeting the stringent reliability and efficiency requirements of EAI applications.

Comment
6 pages, 4 figures. Accepted by the 2026 IEEE International Symposium on Information Theory Workshop (ISIT 2026 Workshop) on Reliable Machine Learning for Wireless Embodied Intelligence

Closest papers

Nearest neighbours by meaning across the whole index.

RadioSight: Predictive mmWave XR Network Optimization from Dynamic Neural Radio Fields

cs.NI ·2026-08-30 ·Lihao Zhang, Paul Kudyba, Zhenlin An, Haijian Sun
top venue similarity 0.62
Abstract · Accepted to ACM MobiCom 2026. 21 pages, 20 figures, 3 tables

Next-generation extended reality (XR) networks rely on mmWave communication for multi-gigabit throughput, yet highly directional links are vulnerable to user mobility and blockages, causing frequent outages under reactive beam management. Emerging neural radio fields can predict radio propagation, but prior work remains limited to offline channel reconstruction. We introduce RadioSight, a real-time multi-modal radio field system for predictive mmWave optimization and proactive Multi-User MIMO beamforming. RadioSight combines backward beam-tracing with real-time semantic object synchronization to anticipate RF geometry changes without full model retraining. Implemented as an edge-executable pipeline for commercial 28 GHz arrays, RadioSight determines each scheduling window's beams during the preceding window without exhaustive beam sweeps. Experiments show that RadioSight reduces beam-search error by up to ~50%, improves median throughput by 2x, and enhances link stability.

0.55

Predictive Beamforming via Echo-Beam Modality Separation with Cross-Attention for ISAC Systems

eess.SP ·2026-10-07 ·Seokjun Park, Jiwhan Jang, Jinseok Choi
published similarity 0.61
Abstract

In this paper, we propose a deep learning-based predictive beamforming algorithm for integrated sensing and communications in vehicle-to-infrastructure networks, where echo signals are leveraged to enhance communication performance. We formulate a sum spectral efficiency maximization problem under a sensing signal-to-interference-plus-noise ratio (SINR) constraint and construct a penalty-based unconstrained surrogate objective for network training. Based on this formulation, the beamforming matrix is predicted using sensing echoes and historical beamformers from previous time slots. To this end, we develop a predictive beamforming network that processes sensing echoes and beamforming inputs through separate encoders to preserve their modality-specific characteristics. This separate design enables each modality to learn rich and complementary representations which are more effectively exploited through a cross-attention mechanism compared to naive input fusion. The resulting features are fused via cross-attention, while gated recurrent units capture temporal dependencies across time slots. Simulation results validate the performance of the proposed method.

0.45

Digital Twin-Assisted Fast Beam Alignment for mmWave MIMO Networks

cs.IT cs.LGcs.NI ·2026-10-31 ·Muhammad Kamran Saeed, Ashfaq Khokhar
hot direction similarity 0.61
Abstract

Millimeter-wave (mmWave) communication relies on directional beam sweeping for initial access, which incurs substantial latency and signaling overhead as antenna arrays grow large and deployments become denser. Machine-learning-based beam prediction can reduce this overhead, but its effectiveness depends on training data that accurately reflects the deployment environment, a requirement that is difficult to meet in practice. This paper presents a latency-aware beam management architecture that integrates digital-twin-assisted prediction, regionbased localization, weighted ensemble learning, and explainability-driven beam pruning into a unified framework. A digital twin (DT) generates site-specific ray-traced channel knowledge offline, enabling environment-aware beam prediction without exhaustive real-world measurements and supporting both initial access and beam tracking. The proposed ensemble learning scheme combines a base classifier and a specialist classifier through reliability-weighted fusion to improve prediction accuracy and robustness, while explainable artificial intelligence (XAI)-based attribution pruning reduces the beam codebook to a small subset of the most informative beams for beam allocation. To capture the distributional mismatch between the DT and real-world environments: the network was trained on imperfect digital-twin data but evaluated on real-world surrobase data. Results show that the proposed method achieves 96.80% top-1 and 98.36% top-3 beam prediction accuracy, while reducing over-the-air sounding overhead by nearly an order of magnitude relative to exhaustive sweeping, outperforming convolutional and deep neural network baselines from prior work.

0.34

PT$^3$: Prototype-Guided Self-Supervised Pretraining for Generalizable mmWave Human Point Cloud Representation

cs.AI ·2026-10-28 ·Ziyang Liu, Kieren Yu, Xiao Yang, Xin Yang, Kaishun Wu
similarity 0.61
Abstract · 30 pages

Multi-source millimeter-wave (mmWave) observations offer an opportunity to learn human representations reusable across sensing tasks. However, sparse detections and multipath effects make these observations unstable, challenging existing point cloud pretraining methods. We propose PT$^3$, a prototype-guided self-supervised pretraining framework for mmWave human point clouds. PT$^3$ represents local states in spatial regions as sparse compositions of shared prototypes and learns their temporal evolution through autoregressive prediction. Observation consistency further stabilizes representations under radar perturbations. After pretraining on unlabeled sequences from multiple sources, the same frozen encoder supports action classification, dense point generation, joint pose estimation, and future motion prediction on datasets not used for pretraining. Across these tasks, PT$^3$ outperforms the compared pretraining baselines and achieves competitive or superior performance to task-specific models.

0.30

Cross-View Vision-Aided Proactive BS Selection and Beam Prediction for mmWave V2I Communications

eess.SP ·2026-09-01 ·Zijiao Hu, Haiyao Yu, Gaoyang Pang, Guangchen Wang, Litianyi Zhang +4 more
code/data similarity 0.60
Abstract

This paper investigates environmental-sensing-aided proactive base station (BS) selection and beam prediction for millimeter-wave (mmWave) vehicle-to-infrastructure (V2I) wireless systems. We exploit onboard panoramic street-view images and a preloaded satellite map to predict communication-relevant environmental information around the vehicle, including nearby building footprints and heights. The predicted height map provides a compact environmental prior and is combined with historical mobility information to jointly predict the next-slot line-of-sight (LoS) state, transmission rate, and transmit and receive beam selections. On our dataset covering different real-world regions across New South Wales, Australia, the proposed framework achieves 91.4% LoS classification accuracy, 0.638 bps/Hz mean absolute error of data rate prediction, and more than 40% higher transmission rate than the conventional reactive baseline in geographically unseen regions, outperforming all evaluated deployable learning-based baselines. The dataset and code will be released at https://github.com/Huzijiao/Cross-view_V2I

0.25

Direct Covariance-to-Beamformer Mapping for Low-Latency Hybrid ISAC Beamforming with Subsequent DoA Estimation

cs.LG eess.SY ·2026-11-01 ·Anjali K. S., Manoj Kumar Panda, Chandramani Singh
similarity 0.60
Abstract

Integrated sensing and communication (ISAC) systems typically employ a two-stage beamforming pipeline, in which target directions are first estimated from the received covariance matrix and then used to compute the beamforming weights by solving non-convex optimization problems. Although effective, this approach introduces processing latency that can limit beam adaptation in dynamic environments. This letter proposes a beamforming deep neural network (BFDNN) for direct covariance-to-beamformer learning in ISAC systems. BFDNN is a compact regression network that maps covariance-matrix features directly to the hybrid beamforming weights produced by a hybrid ISAC beamformer, eliminating the direction-of-arrival (DoA) estimation stage during inference. Compared with MUSIC, classification-DNN, and regression-DNN based beamforming pipelines, BFDNN generates comparable beam patterns and higher effective spectral efficiencies while reducing the beamforming prediction latency by 25-30 times on the evaluated platform, demonstrating the potential of direct covariance-to-beamformer learning for low-latency ISAC beam updates. Moreover, the target directions can be inferred indirectly from the generated radiation pattern, yielding DoA accuracy competitive with that of dedicated learning-based methods in the evaluated scenario.

0.16

Robust Resource Allocation for STAR-RIS-Assisted ISAC Networks Using Deep Learning

cs.PF ·2026-10-19 ·Yuwen Cao, Jiajun Wu, Howard H. Yang, Tomoaki Ohtsuki, Tony Q. S. Quek
theory similarity 0.60
Abstract

In this paper, we focus on investigating the resource allocation in an integrated sensing and communication (ISAC) system assisted by a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS). Due to the coupled non-convex nature of the optimization problem, solving the above joint resource optimization problem while guaranteeing superior sensing performance is challenging, especially in dynamic environment. To conquer such challenge, prior iterative optimization algorithms have been presented. However, practical implementations of these prior algorithms face notable computational challenges, e.g., the reliance on accurate global channel information and the assumption of ideal phase shifts. In this context, we propose a model-driven deep learning framework for jointly optimizing the transmit beamforming and waveform in ISAC networks with low-overhead. In addition, we adopt the Cramer-Rao lower bound (CRLB) as the sensing performance metric, and the multi-user interference (MUI) energy as the communication performance metric for performance evaluation. Besides, our framework jointly optimizes the transmit beamforming, waveform and the STAR-RIS reflection/transmission coefficient matrices by minimizing the weighted sum of MUI energy and CRLB. Our study also considers the impact of imperfect channel information, making the research scenario more aligned with real-world applications. Simulation results validate that the proposed framework not only achieves higher sum-rate performance comparable to traditional iterative algorithms but also significantly reduces computational complexity in terms of algorithm execution time, as well as exhibits inherent robustness.

0.11

Large Language Model-based Optimization for Wireless Communication: A Survey

eess.SY cs.AI ·2026-11-15 ·Muhammad Sohaib, Taehyung Kim, Hyeri Heo, Jemu Ryu, Chaehyun Lee +2 more
survey similarity 0.60
Abstract · 31 pages,9 figures

The growing complexity and dynamism of modern wireless communication frameworks have made real-time optimization essential for efficient resource allocation. Traditional optimization and machine-learning techniques often struggle with generalization, adaptability, stability, and scalability in heterogeneous, time-varying environments. Large language models (LLMs) have recently emerged as powerful tools capable of reasoning over structured prompts and generating context-aware decisions in real time without domain-specific retraining. This survey provides a comprehensive review of LLM-driven optimization techniques applied to wireless communication problems such as power control, bandwidth allocation, task offloading, and intelligent surface configuration. We introduce a functional taxonomy of LLM-enabled wireless resource management strategies and analyze the prompt engineering methodologies employed in recent literature. Furthermore, we develop a generalized analytical framework that categorizes LLM-based optimization architectures, including direct solution generation, closed-loop optimization with external verifiers, and representation encoding within trainable neural pipelines. To demonstrate practical applicability, we present representative case studies on LLM-assisted beam prediction for millimeter-wave systems and adaptive wireless resource allocation. Finally, we discuss emerging hybrid AI approaches for wireless networks.

0.22