CS Paper Radar

LiDAR-Derived Surface Priors for Multimodal Sensing-Assisted NLoS Beam Search in Indoor 60-GHz Networks

Amod Ashtekar, Dalton Davis, Rafaela Lomboy, Omar Ibrahim, Raj Sai Sohel Bandari, Mohammed E. Eltayeb

eess.SY ·submitted 2026-08-18 23:58 UTC · v1

Abstract

Highly directional 60-GHz Internet-of-Things (IoT) links can exploit naturally occurring indoor surfaces to sustain connectivity under blockage. Identifying viable non-line-of-sight (NLoS) paths, however, can require extensive RF beam training. This paper investigates whether LiDAR can reduce this search overhead by providing a surface-aware prior without assuming a direct mapping between optical return and mmWave reflection. The proposed framework uses LiDAR-derived geometry and return statistics to rank candidate propagation directions, while RF measurements remain responsible for final beam selection. The experimental validation is organized in three stages to separate descriptor robustness, cross-modal association, and beam-search performance. Controlled LiDAR measurements first quantify how geometric and radiometric surface descriptors vary with acquisition geometry. Matched LiDAR and 60-GHz measurements in an L-shaped corridor then determine whether these descriptors are associated with the measured surface-mediated RF response under a prescribed NLoS interaction. Finally, a separate room-scale campaign evaluates the resulting prior using exhaustive TX-RX beam maps without prescribing the underlying propagation mechanism. The measurements show that descriptor reliability depends on acquisition geometry and point-cloud representation, and that LiDAR and RF surface responses exhibit cross-modal association without supporting deterministic RF-power prediction. In the room experiment, local three-ring 3-D planarity retains a beam within 3 dB of exhaustive search at 74.5% of the measured locations while reducing RF beam-pair probing by 72% relative to exhaustive probing over the candidate search region. These results establish LiDAR-derived local surface structure as a communication-oriented prior for concentrating RF probing and reducing mmWave beam-search uncertainty.

Closest papers

Nearest neighbours by meaning across the whole index.

Distributed ISAC-Enabled Multimodal Recovery of Missing 2-D LiDAR Measurements

eess.SY ·2026-09-19 ·Mohammed E Eltayeb
similarity 0.72
Abstract

Recovering missing regions in 2-D LiDAR scans is crucial for maintaining geometric awareness in environmental sensing. LiDAR-only reconstruction relies on measurements surrounding the missing region and can degrade as the unobserved sector grows or the surface geometry becomes more complex. This paper presents a distributed integrated sensing and communication (ISAC) framework that uses directional 60-GHz beam-training measurements from multiple receivers to assist in the recovery of missing regions in 2-D LiDAR scans. Transmitter and receiver positions, beam directions, and relative beam-power thresholding are used to construct an RF-derived surface prior without requiring RF time-of-flight measurements. The resulting RF-derived range estimates are then fused with LiDAR measurements to estimate the missing geometry. The proposed framework is evaluated in an indoor environment using LiDAR and 60-GHz phased-array measurements from 55 receiver viewpoints comprising 37,620 beam-pair power measurements across 72 controlled missing-sector cases. The results show that RF-assisted reconstruction provides larger accuracy gains as the missing-sector width increases. For the 80-degree missing-sector case investigated in this paper, RF+polar fusion is shown to reduce the mean absolute error (MAE) from 2.271 m for polar LiDAR interpolation to 0.617 m, corresponding to a 72.8% reduction. The results further show that useful RF-assisted recovery can be maintained even with fewer beam-pair measurements under limited beam training. These findings demonstrate that directional communication measurements can support environmental sensing by providing complementary geometric information for missing LiDAR regions.

0.11

Multimodal Learning for Beamforming Using Camera, LiDAR, and Radio-Frequency Pilots

eess.SP ·2026-09-18 ·Yinghan Li, Wei Yu
top venue similarity 0.61
Abstract

This paper proposes a multimodal learning framework that integrates camera images, LiDAR point clouds, and radio-frequency (RF) pilots to realize multi-user multiple-input single-output (MU-MISO) beamforming optimization in mixed line-of-sight (LoS) and non-line-of-sight (NLoS) environments. In LoS-dominant environments, beamforming can be designed by utilizing sensing information related to user locations. However, LoS paths cannot be guaranteed to exist for all users in realistic dynamic environments due to blockages. To characterize NLoS propagation, detailed three-dimensional (3D) information of surrounding obstacles is required. This paper integrates camera images and LiDAR points with RF pilots to capture detailed 3D geometric, object-class, and material information of users and surrounding objects. The obtained multimodal information provides useful cues for both direct LoS paths and reflected NLoS propagation, and provides rich channel-related information for beamforming design. Specifically, a bounding-box detection neural network is first used to extract two-dimensional spatial, object-class, and material information from camera images. The image-derived information then guides the selection of LiDAR points to obtain 3D geometric information of users and surrounding obstacles, and assigns object-class and material labels to the selected points. The image-guided LiDAR features, together with RF pilots, are jointly processed by a designed neural architecture to optimize the beamforming vectors. Simulation results show that the proposed method achieves a higher minimum rate than benchmarks.

0.63

CFAR Detection on Non-Coherently Integrated Angular Maps for mmWave Radio SLAM

eess.SP ·2026-11-10 ·Paolo Tosi, Ossi Kaltiokallio, Marcus Henninger, Silvio Mandelli, Mikko Valkama
similarity 0.61
Abstract · 6 pages, 4 figures, 1 table. This work has been submitted to the IEEE for possible publication

Reliable multipath detection is essential for millimeter-wave simultaneous localization and mapping (SLAM), where propagation paths reflecting off the environment provide geometric constraints beyond the dominant line-of-sight component. This paper develops constant false alarm rate (CFAR)-based detectors for beam-swept bistatic integrated sensing and communications (ISAC). Starting from conventional CFAR on the I/Q datacube, we derive a modified detector for non-coherently integrated angular power maps, where the post-integration noise statistics differ from those assumed by standard cell-averaging CFAR. To improve practicality, we introduce a multi-cell cell-under-test formulation and a plus-shaped training window that reduces computational cost while accounting for sidelobe structure. The proposed methods are evaluated on experimental 60 GHz indoor measurements using a snapshot-SLAM estimator. Compared with a singular value decomposition (SVD)-based detector, the proposed CFAR approaches reduce the overall positioning RMSE from 0.30 m to 0.24-0.26 m, with the largest improvement in non-line-of-sight snapshots. The multi-cell non-coherent detector further lowers the computational complexity without degrading positioning accuracy, demonstrating its suitability for practical multipath radio-SLAM.

0.26

mmWave UE Positioning Under Blockage: Limits for ISAC-Assisted Handover

cs.NI eess.SP ·2026-10-30 ·Seyed Bagher Hashemi Natanzi, Bo Tang
similarity 0.59
Abstract

Proactive handover can save a millimeter-wave (mmWave) link before a passing body blocks it, but only if the network knows where the user is. We ask whether the radio units that serve a user can localize it accurately enough from its uplink sounding reference signals. We derive position error bounds that include synchronization and array calibration errors, with and without reflected paths known from a digital twin, and test two estimators in a ray-traced street canyon on held-out scenarios. Three findings stand out. First, with line of sight to both radio units, array calibration, not bandwidth, limits the bound. Second, blockage degrades the line-of-sight-only bound sharply, whereas known reflections keep the map-aided bound low. Third, a simple dominant-path estimator fails where it matters most: its errors grow sharply around blockage, and proactive handover becomes worse than the 3GPP baseline. A map-aided multipath tracker cuts the median error from 12 to 3.7 cm and removes this significant penalty at link margins of 15 dB and above, but does not yet beat the baseline.

0.35

GLocFM: A Geometry-Aware Foundation Model for 3D Indoor Wireless Localization

eess.SP cs.AI ·2026-08-10 ·Chenghong Bian, Chaozheng Wen, Hongze Chen, Jun Zhang
similarity 0.58
Abstract · 13 pages, single column

Learning-based wireless localizers often fail to utilize geometric information about the propagation environment, limiting their ability to exploit non-line-of-sight (NLoS) propagation and generalize across scenes. To bridge this gap, we propose GLocFM, a Geometry-aware Localization Foundation Model, which jointly exploits WiFi measurements and scene geometry represented as a 3D point cloud. We formulate localization as a maximum-likelihood (ML) estimation problem, where the goal is to find a transmitter position that maximizes the likelihood of the wireless observations conditioned on the scene geometry. The likelihood of a candidate transmitter position is calculated by a learned scoring function that matches the observed delay--angle-of-arrival (AoA) spectrum against the spectrum predicted for that candidate. A hierarchical scene encoder extracts propagation-relevant features to produce geometric priors for LoS and one-bounce reflection paths. For scenarios with imperfect synchronization, we further introduce a time-of-flight (ToF)-robust GLocFM model to handle unknown ToF offsets. GLocFM is trained on a multi-modal synthetic indoor localization dataset comprising 221 diverse scenes whose associated wireless signals are generated using Sionna RT. On both synthetic and the NeRF$^{2}$ dataset based on real measurements, GLocFM reduces mean 3D localization error relative to one of the state-of-the-art localization baselines by 49.5\% and 48.8\%, respectively. Ablations across different number of receiver, bandwidths, and array sizes further demonstrate the effectiveness and robustness of the proposed framework.

0.40

Doppler-aided Position-Velocity Tracking of Hidden Objects using mmWave Radar

cs.RO cs.CV ·2026-10-25 ·Yerin Cheon, Kush Garg, Akshat Dave
benchmark similarity 0.58
Abstract · 8 pages, 8 figures

Safe indoor operation requires autonomous tracking of objects that are not directly visible to the robot. Optical non-line-of-sight (NLoS) methods depend on ambient lighting and scene geometry or on weak multi-bounce returns that need long acquisitions. Millimeter-wave (mmWave) radar offers an attractive alternative: walls act as reflectors for mmWave signals, and frequency-modulated continuous-wave (FMCW) radars enable fast, practical measurement of range, angle, and velocity. However, the low resolution of these radars leads to spatially ambiguous observations. The Doppler information, although particularly sensitive to target motion, remains underexplored in indoor NLoS localization: existing methods emphasize spatial representations and either collapse or discard the Doppler dimension before learning. To leverage the complete Range-Azimuth-Doppler (RAD) information, we acquire the first indoor NLoS radar dataset that pairs sequential RAD measurements with synchronized position and velocity ground truth under controlled variations in motion: 576 sequences totaling 720,856 frames across 12 trajectories of a mobile robot moving along varying speeds, starting positions, and material configurations. We then formulate NLoS tracking as sequential position-velocity estimation rather than frame-wise localization: a shared 3-D encoder processes the full RAD representation of consecutive frames, separate recurrent branches estimate position and velocity, and post-inference refinement combines the two into a motion-consistent trajectory. Our method achieves 8.95cm position and 1.75cm/s velocity errors on held-out trajectories and generalizes to unseen scenarios involving a moving human target. Together, our dataset and tracker establish a benchmark for tracking hidden moving targets with a low-cost radar.

0.19

UpDown-SC: Gravity-Canonicalized Dual-Envelope Scan Context for Indoor LiDAR Place Recognition

cs.CV cs.RO ·2026-09-24 ·Jie Xu, Yongxin Yang, Ziyi Jin, Kangjin Yu, Hongjun Huang +2 more
code/data similarity 0.58
Abstract · 8 pages, 7 figures, 2 tables. Code and evaluation artifacts: https://github.com/jiejie567/updown-sc

LiDAR place recognition is a key front end for loop closure and global relocalization, yet indoor retrieval remains difficult when attitude or sensor mounting height changes between mapping and query sessions. Scan Context stores the maximum height in each polar cell; indoors, broad ceilings can suppress the lower and mid-level geometry that distinguishes adjacent rooms and corridors. We present UpDown-SC, a training-free polar descriptor that first canonicalizes gravity and then represents two complementary surfaces: the upper envelope of lower/middle structures and the lower envelope of overhead structures. Their physical split is estimated once from a cell-balanced map height distribution and reused by every query. A mask-aware, non-uniform two-channel distance retains discriminative lower-level evidence while limiting sensitivity to its cross-session variation, without treating unobserved cells as zero-height measurements. Conventional Scan Context shortlisting and circular yaw alignment are retained, so retrieved hypotheses directly initialize geometric verification. Experiments across repeated indoor sessions, mounting-height changes, mixed outdoor-to-indoor trajectories, and an outdoor transfer sequence show more reliable first-choice retrieval on the indoor and mounting-height-varied sessions. A paired test finds a significant gain over Scan Context on the in-house sessions. UpDown-SC also gives the best or second-best F1max and AUPR under threshold-based acceptance while retaining a lightweight CPU front end. Continuous replay confirms that the retrieved hypotheses support metric prior-map localization. Code and evaluation artifacts: https://github.com/jiejie567/updown-sc.

0.46

SiGMA: Site-Grounded Multi-Modal ISAC Data Generation for Environment-Aware Communications

eess.SP cs.DB ·2026-11-16 ·Yijie Bian, Wei Guo, Kai Zhang, Xiao Ye, Shurui Xu +3 more
code/data similarity 0.58
Abstract

Learning-based multi-modal integrated sensing and communication (ISAC) requires data that associate environmental observations with the wireless response generated by the same site and dynamic scene state. Acquiring such data at new sites requires sensor calibration, coordinated measurements, and cross-modal association. We present site-grounded multi-modal ISAC data generation (SiGMA), which combines OpenStreetMap (OSM), Overture Maps, and procedural three-dimensional (3D) reconstruction to create georeferenced urban scenes. A shared scene geometry and time-indexed actor state link synchronized red-green-blue (RGB) images, light detection and ranging (LiDAR) point clouds, positioning records, frequency-modulated continuous-wave (FMCW) Radar in-phase and quadrature (IQ) samples, and ray-traced wireless channels. For configurable reflected propagation under direct-link blockage, SiGMA generates optional reconfigurable intelligent surface (RIS) component channels for phase-configuration evaluation across shared scene states. The evaluation results demonstrate that the framework improves zero-shot beam prediction performance on real DeepSense 6G measurements compared with an OSM-derived synthetic-data baseline. A camera-assisted RIS case study further demonstrates the generation of sensing-associated supervision for configurable reflected propagation. The dataset generation pipeline is available at https://github.com/Trans-cending/SiGMA-main.

0.39