CS Paper Radar

Distributed ISAC-Enabled Multimodal Recovery of Missing 2-D LiDAR Measurements

Mohammed E Eltayeb

eess.SY ·submitted 2026-09-19 03:51 UTC · v1

Abstract

Recovering missing regions in 2-D LiDAR scans is crucial for maintaining geometric awareness in environmental sensing. LiDAR-only reconstruction relies on measurements surrounding the missing region and can degrade as the unobserved sector grows or the surface geometry becomes more complex. This paper presents a distributed integrated sensing and communication (ISAC) framework that uses directional 60-GHz beam-training measurements from multiple receivers to assist in the recovery of missing regions in 2-D LiDAR scans. Transmitter and receiver positions, beam directions, and relative beam-power thresholding are used to construct an RF-derived surface prior without requiring RF time-of-flight measurements. The resulting RF-derived range estimates are then fused with LiDAR measurements to estimate the missing geometry. The proposed framework is evaluated in an indoor environment using LiDAR and 60-GHz phased-array measurements from 55 receiver viewpoints comprising 37,620 beam-pair power measurements across 72 controlled missing-sector cases. The results show that RF-assisted reconstruction provides larger accuracy gains as the missing-sector width increases. For the 80-degree missing-sector case investigated in this paper, RF+polar fusion is shown to reduce the mean absolute error (MAE) from 2.271 m for polar LiDAR interpolation to 0.617 m, corresponding to a 72.8% reduction. The results further show that useful RF-assisted recovery can be maintained even with fewer beam-pair measurements under limited beam training. These findings demonstrate that directional communication measurements can support environmental sensing by providing complementary geometric information for missing LiDAR regions.

Closest papers

Nearest neighbours by meaning across the whole index.

LiDAR-Derived Surface Priors for Multimodal Sensing-Assisted NLoS Beam Search in Indoor 60-GHz Networks

eess.SY ·2026-08-18 ·Amod Ashtekar, Dalton Davis, Rafaela Lomboy, Omar Ibrahim, Raj Sai Sohel Bandari +1 more
similarity 0.72
Abstract

Highly directional 60-GHz Internet-of-Things (IoT) links can exploit naturally occurring indoor surfaces to sustain connectivity under blockage. Identifying viable non-line-of-sight (NLoS) paths, however, can require extensive RF beam training. This paper investigates whether LiDAR can reduce this search overhead by providing a surface-aware prior without assuming a direct mapping between optical return and mmWave reflection. The proposed framework uses LiDAR-derived geometry and return statistics to rank candidate propagation directions, while RF measurements remain responsible for final beam selection. The experimental validation is organized in three stages to separate descriptor robustness, cross-modal association, and beam-search performance. Controlled LiDAR measurements first quantify how geometric and radiometric surface descriptors vary with acquisition geometry. Matched LiDAR and 60-GHz measurements in an L-shaped corridor then determine whether these descriptors are associated with the measured surface-mediated RF response under a prescribed NLoS interaction. Finally, a separate room-scale campaign evaluates the resulting prior using exhaustive TX-RX beam maps without prescribing the underlying propagation mechanism. The measurements show that descriptor reliability depends on acquisition geometry and point-cloud representation, and that LiDAR and RF surface responses exhibit cross-modal association without supporting deterministic RF-power prediction. In the room experiment, local three-ring 3-D planarity retains a beam within 3 dB of exhaustive search at 74.5% of the measured locations while reducing RF beam-pair probing by 72% relative to exhaustive probing over the candidate search region. These results establish LiDAR-derived local surface structure as a communication-oriented prior for concentrating RF probing and reducing mmWave beam-search uncertainty.

0.20

CFAR Detection on Non-Coherently Integrated Angular Maps for mmWave Radio SLAM

eess.SP ·2026-11-10 ·Paolo Tosi, Ossi Kaltiokallio, Marcus Henninger, Silvio Mandelli, Mikko Valkama
similarity 0.63
Abstract · 6 pages, 4 figures, 1 table. This work has been submitted to the IEEE for possible publication

Reliable multipath detection is essential for millimeter-wave simultaneous localization and mapping (SLAM), where propagation paths reflecting off the environment provide geometric constraints beyond the dominant line-of-sight component. This paper develops constant false alarm rate (CFAR)-based detectors for beam-swept bistatic integrated sensing and communications (ISAC). Starting from conventional CFAR on the I/Q datacube, we derive a modified detector for non-coherently integrated angular power maps, where the post-integration noise statistics differ from those assumed by standard cell-averaging CFAR. To improve practicality, we introduce a multi-cell cell-under-test formulation and a plus-shaped training window that reduces computational cost while accounting for sidelobe structure. The proposed methods are evaluated on experimental 60 GHz indoor measurements using a snapshot-SLAM estimator. Compared with a singular value decomposition (SVD)-based detector, the proposed CFAR approaches reduce the overall positioning RMSE from 0.30 m to 0.24-0.26 m, with the largest improvement in non-line-of-sight snapshots. The multi-cell non-coherent detector further lowers the computational complexity without degrading positioning accuracy, demonstrating its suitability for practical multipath radio-SLAM.

0.26

Dr-LiSA: Direct Radar-Lidar Scan Alignment for SE(3) Localization

cs.RO ·2026-09-22 ·Alex Zhang, Daniil Lisus, Cedric Le Gentil, Timothy D. Barfoot
similarity 0.60
Abstract · 8 pages, 6 figures, paper under review

This paper introduces Dr-LiSA, a first-of-its-kind direct method for localizing 2D spinning radar intensity measurements in $SE(3)$ against 3D lidar maps. Radar-lidar localization combines the complementary strengths of the two sensing modalities: radar is robust to adverse weather and precipitation, while lidar provides high-fidelity 3D maps in favourable conditions. However, existing radar-lidar localization methods are restricted to planar $SE(2)$ localization and have generally fallen short of the accuracy achieved by lidar-lidar and even radar-radar systems. A key challenge is the substantial sensing-modality gap between radar and lidar, which observe and represent scene structure in fundamentally different ways. Dr-LiSA bridges this gap using a learned forward model that predicts radar measurements from a lidar submap at a candidate pose, enabling direct photometric alignment of predicted and observed radar scans in $SE(3)$. Dr-LiSA outperforms prior radar-lidar approaches in $SE(2)$ while achieving planar accuracy competitive with state-of-the-art radar-radar localization across more than 90 km of on-road data.

0.24

Benchmarking Regularization Methods For 3D Radio Tomographic Imaging

eess.IV eess.SP ·2026-09-08 ·Wanqin Ma, Yijun Chen, Alikhan Umirbayev, Jichen Zhang, Ross Murch
similarity 0.59
Abstract · 5 pages, 2 figures, in the process of ICASSP 2027

Integrated Sensing and Communication (ISAC) is an important technology for 6G, enabling wireless systems to perceive their physical environment. Radio Tomographic Imaging (RTI) is a potential technique for device-free sensing in ISAC, reconstructing object locations and shapes from Received Signal Strength (RSS) measurements. It can complement other techniques, such as radar and LiDAR, by providing a narrowband modality with wavelength resolution. Recently, an extended version of RTI, known as the extended phaseless Rytov approximation (x3DPRA), has been developed to enhance RTI reconstruction quality, estimate material parameters, and extend RTI from two to three dimensions (3D). However, the 3D formulation is even more ill-posed than the 2D form, as the number of measurements is far fewer than the number of unknown voxels. In this work, we systematically evaluate and compare three distinct regularization approaches (Ridge, Total Variation, and Tensor Nuclear) within the x3DPRA framework. We provide a detailed performance analysis by evaluating both reconstruction quality and computational runtime across the three methods. Our findings show that Total Variation regularization provides the best reconstruction quality but not the fastest runtime, providing guidance for developing high-resolution 3D RTI systems for future ISAC applications.

0.35

LiDAR Resolution Recovery via Foundation-Model-Guided Diffusion

cs.CV ·2026-10-06 ·Samed Doğan, Nico Leuze, Alfred Schöttl
similarity 0.59
Abstract

High-beam-count LiDAR sensors are costly, yet many perception pipelines require dense angular sampling. Using a pretrained Stable Diffusion model as the backbone, we fine-tune a LiDAR-conditioned depth model with pseudo-depth targets from a 2D foundation model. During training, the LiDAR conditioning is randomly decimated at different beam budgets. We then investigate how much of a LiDAR scan can be recovered from heavily decimated input and characterize performance across the input beam budget. We evaluate against physically held-out real beams on nuScenes and report recovery separately from fit accuracy. Our model yields its largest advantage in very sparse regimes, achieving a $δ_{1.25}$ accuracy of $66.8$% from $4$-beam input where scattered interpolation reaches only $45.1$%. A class-stratified error breakdown further reveals that planar surfaces recover first while objects introducing depth discontinuities degrade earliest. Together, these results quantify the recovery/resolution trade-off for foundation-model-guided LiDAR enhancement.

0.20

What Limits mmWave Human-State Sensing for Robot Perception?

cs.RO cs.HC ·2026-11-06 ·Shuntian Zheng, Guangming Wang, Hongyang He, Shuai He, Yu Guan
similarity 0.56
Abstract

Assistive robots and search-and-rescue platforms require reliable human state sensing in smoke, darkness, and privacy-sensitive environments, where cameras and LiDAR may be unreliable Millimeter-wave radar offers an alternative that works without ambient light, penetrates smoke, and does not capture visual appearance. However, the compact arrays that fit robot size, power, and cost budgets have limited apertures, producing joint-localization errors on the order of decimeters at a few meters, large enough to compromise the safety margins and tracking accuracy a robot depends on. Existing pipelines reduce pose error through frame fusion, multiple viewpoints, return selection, or stronger estimators, but examine one technique at a time, without relating its effect to a shared measurement limit or separating gains from added information from gains from estimator completion. We address this gap with a framework that models the human and environment as one time-varying scattering field and states a Cramer-Rao type error floor for joint localization as a function of bandwidth, aperture, signal-to-noise ratio, fused frame count, phase coherence, and visibility of retained returns. We then use existing frame fusion, multi viewpoint, return selection, and pose estimation methods as matched probes of this floor rather than as competing pipelines. Under the evaluated conditions, experiments on three datasets and a live deployment show these strategies move joint localization error in the predicted directions, for example lowering mean per-joint position error from about 97 to 65 mm with a second viewpoint, while a stronger estimator mainly lowers overall error by completing joints the measurement cannot resolve. These results give the robotics community a principled basis for deciding whether to prioritize observation design or estimator capacity when deploying reliable mmWave human sensing.

0.28

Single-Radar Bilateral 3D Near-Field Imaging for Mobile Robots

cs.RO cs.CV ·2026-11-08 ·Yingqi Wang, Tingwei Chen, Zhongqin Wang, Min Xu
similarity 0.56
Abstract

Mobile robots operating in homes need reliable 3D perception of nearby furniture and surrounding structures, yet recovering this information on both sides of the robot's path with a single forward-mounted millimeter-wave radar remains challenging because of near-field wavefront curvature, viewpoint-dependent target visibility, and limited elevation diversity. This paper presents a motion-assisted framework for reconstructing structures on both sides of a robot's trajectory. Our near-field model relates scene reflectivity to stepped-frequency multiple-input multiple-output (MIMO) observations across frequencies and robot positions using spherical paths from transmitter (Tx) to scatterer to receiver (Rx). Bilateral Tx combining provides wideband directional weighting, while sliding-aperture back-projection coherently focuses the measurements using near-field propagation distances. Top-K power fusion combines local images with different visibility. The reconstruction provides lateral-forward support for multi-layer height extraction, followed by guarded adaptive height refinement using the original MIMO channels. Experiments in controlled, office/study, and corridor environments produce mean lateral-forward localization errors of 4.65, 5.63, and 5.98 cm, respectively, with peak-to-background ratios (PBRs) exceeding 13 dB. The framework recovers bilateral 3D scattering structure from one forward pass using a single radar, without relying on learned representations of the scene.

0.25

SiGMA: Site-Grounded Multi-Modal ISAC Data Generation for Environment-Aware Communications

eess.SP cs.DB ·2026-11-16 ·Yijie Bian, Wei Guo, Kai Zhang, Xiao Ye, Shurui Xu +3 more
code/data similarity 0.55
Abstract

Learning-based multi-modal integrated sensing and communication (ISAC) requires data that associate environmental observations with the wireless response generated by the same site and dynamic scene state. Acquiring such data at new sites requires sensor calibration, coordinated measurements, and cross-modal association. We present site-grounded multi-modal ISAC data generation (SiGMA), which combines OpenStreetMap (OSM), Overture Maps, and procedural three-dimensional (3D) reconstruction to create georeferenced urban scenes. A shared scene geometry and time-indexed actor state link synchronized red-green-blue (RGB) images, light detection and ranging (LiDAR) point clouds, positioning records, frequency-modulated continuous-wave (FMCW) Radar in-phase and quadrature (IQ) samples, and ray-traced wireless channels. For configurable reflected propagation under direct-link blockage, SiGMA generates optional reconfigurable intelligent surface (RIS) component channels for phase-configuration evaluation across shared scene states. The evaluation results demonstrate that the framework improves zero-shot beam prediction performance on real DeepSense 6G measurements compared with an OSM-derived synthetic-data baseline. A camera-assisted RIS case study further demonstrates the generation of sensing-associated supervision for configurable reflected propagation. The dataset generation pipeline is available at https://github.com/Trans-cending/SiGMA-main.

0.39