CS Paper Radar

Rethinking Radar 3D Perception: Representation Learning from Raw Spectra

Miao Zhang, Mohamed Abdelsamad, Bin Yang, Sherif Abdulatif, Benedikt Loesch, Marco Altmann, Abhinav Valada, Bin Yang

cs.AI cs.CVcs.LGcs.RO ·submitted 2026-11-09 12:54 UTC · v1
top venue

Abstract

Raw radar spectra are widely viewed as too cluttered and noisy for direct representation learning, motivating handcrafted reductions, sparse point clouds, or compact Doppler descriptors in radar perception. We challenge this assumption and argue that the main limitation lies not in the raw representation itself, but in the absence of a learning objective that separates structured signal from noise. Handcrafted reductions partially address this problem but impose rigid assumptions about what constitutes signal, discarding weak yet informative structure while retaining artifacts that fit the reduction model. Once removed, such information cannot be recovered by supervised learning. We propose an alternative: structure is the component of a radar spectrum that remains reconstructable under localized corruption, while noise is the component that does not. This perspective motivates self-supervised masked modeling for dense radar spectra without predefined signal-noise separation. We instantiate it with Leakage-aware Spectral MAE, a masked autoencoder for raw radar cubes using a corruption strategy inspired by cross-bin energy spreading caused by spectral leakage. We also demonstrate the importance of Doppler organization: treating Doppler as a primary spatial dimension in an x-y-D representation, with height encoded as features, substantially outperforms naive channel stacking and enables effective learning from dense 4D spectra. Without handcrafted reductions, our approach consistently outperforms state-of-the-art radar-based detectors and point-cloud-based self-supervised learning (SSL) counterparts. These results establish raw radar spectra as an effective representation for 3D perception when paired with an appropriate pretraining objective.

Comment
19 pages, 5 figures, 18 tables. Accepted at NeurIPS 2026. Miao Zhang and Mohamed Abdelsamad contributed equally

Closest papers

Nearest neighbours by meaning across the whole index.

RadarDINO: Distilling a Visual Foundation Model into mmWave Radar for Human Mesh Reconstruction

cs.CV ·2026-11-06 ·Furkan Mert Algan, Zhifan Ni, Eckehard Steinbach
similarity 0.68
Abstract

Millimeter-wave (mmWave) radar offers a privacy-preserving and illumination-robust alternative for human mesh reconstruction (HMR). However, high-fidelity radar HMR remains challenging. Sparse point cloud-based methods suffer from information loss and missed detections, while raw radar tensor methods like RT-Mesh lack fine-grained semantics and explicit local body modeling. In this paper, we propose RadarDINO, a radar HMR framework that distills visual semantics from a DINOv3 teacher into 3D radar representations and introduces explicit geometric supervision. DINOv3 descriptors are transferred to radar voxels via calibrated RGB-radar geometry, providing voxel- and body-part-level supervision for part-aware radar representations. We further incorporate vertex- and joint-losses to directly constrain reconstructed geometry. On the M4Human dataset, our method outperforms the SOTA baseline across all three evaluation splits.

0.19

4D Radar Perception Algorithms for Autonomous Driving: A Review

cs.RO cs.CVeess.SP ·2026-09-16 ·Xumin Wu, Jun Zhou, Jilin Mei, Chen Min, Yu Hu
similarity 0.67
Abstract · 12 pages, 9 figures, 5 tables. Submitted to IEEE Sensors Journal

Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to semantic segmentation, motion estimation, occupancy prediction, and dynamic scene reconstruction. This review organizes the field according to the evolution of perception tasks and algorithms. It first introduces radar fundamentals, data representations, and quality-enhancement methods, and then reviews object-level perception, motion and localization, local and dense spatial perception, and dynamic scene understanding. Across these directions, we compare radar-only learning, multimodal fusion, and cross-modal supervision and knowledge distillation. Particular attention is paid to how elevation, Doppler measurements, and radar physical priors are exploited across tasks. We further summarize the task coverage, input data, annotations, and evaluation protocols of existing datasets, clarifying the empirical support for different research directions. Finally, we discuss the common challenges and future directions of 4D radar perception for autonomous driving. This review provides a task-oriented perspective on the transition from sparse object perception to dynamic spatial understanding.

0.18

Accuracy- and Real-Time-Aware 4D Radar Preprocessing for Autonomous Driving Perception Systems

cs.CV ·2026-09-16 ·Woo-Jin Jung, Dong-Hee Paek, Jeong-Su Park, Seung-Hyun Kong
similarity 0.61
Abstract · 7 pages, 7 figures, Transactions of the Korean Society of Automotive Engineers

4D radar has emerged as a promising next-generation sensor for improving the robustness of autonomous driving perception systems because of its stable sensing capability under adverse weather conditions. However, deploying 4D radar in embedded environments with limited hardware resources requires radar-representation preprocessing that jointly considers perception accuracy, real-time performance, and computational complexity. This paper proposes a preprocessing framework for 4D-radar-based 3D object detection. First, Percentile-based 3D Shape Preservation (P3DP) extracts point clouds from radar tensors while preserving object-shape information and suppressing noise and false alarms. Second, Multi-frame-based Noise Point Discrimination using Kernel Density Estimation (MF-KDE) improves the density and reliability of sparse radar point clouds. Finally, Embedded \& NetScore (ENS) evaluates suitability for embedded deployment by jointly considering accuracy, real-time performance, adverse-weather robustness, and model complexity.

0.21

DRaGAN: Dynamic Graph Attention Network for Multi-Radar Point Cloud Encoding in Automotive Radar Perception

cs.CV ·2026-11-16 ·Christof Leitgeb, Thomas Puchleitner, Max Peter Ronecker, Daniel Watzenig
publishedcode/data similarity 0.59
Abstract · Accepted to 2027 IEEE/SICE International Symposium on System Integration (SII)

Radar represents a key modality for weather-robust perception. Unlike optical sensors such as camera and LiDAR, radar can penetrate fog, rain and snow due to its longer wavelength, and recent hardware advances have steadily improved its spatial resolution, thus making it increasingly relevant for autonomous systems. While processing raw radar data requires substantial memory computation, most existing work has focused on preprocessed point-cloud data similar to LiDAR. However, the sparse radar points and sensor-relative anisotropy make LiDAR-oriented encoders suboptimal. To address this problem, we present DRaGAN, a dynamic graph attention network for multi-radar point clouds. DRaGAN introduces a sensor-relative Fourier encoding of angle and range to capture fixed-aperture radar characteristics, gated short- and long-range hub nodes along each sensor's line of sight for efficient local-global message passing, and attention-guided dynamic rewiring that prunes weak edges and adds a bounded number of latent connections restricted to two-hop neighborhoods. This reduces the number of processed edges in deeper layers while preserving representation quality. On TruckScenes, DRaGAN improves test NDS by 10.10 points over the evaluated RadarGNN baseline and reduces the reported model FLOP count by 63.7%. This trade-off includes an increase in model latency from 40 to 53.16 ms and in trainable parameters from 1.2M to 1.7M on the evaluated implementations. Code and pretrained models are available at https://github.com/chr-is-tof/DRaGAN.

0.38

STAR: Scene- and Task-Aware 4D Radar Preprocessing Towards End-to-End Cognitive Radar

cs.CV cs.AI ·2026-09-21 ·Seung-Hyun Song, Dong-Hee Paek, Seung-Hyun Kong
benchmark similarity 0.59
Abstract

Four-dimensional (4D) Radar has emerged as a key sensor for environmental perception, providing range, azimuth, elevation, and Doppler measurements while remaining robust to illumination changes and adverse weather conditions. However, conventional Radar preprocessing methods, such as constant false alarm rate (CFAR) detection, select measurements primarily based on signal-level criteria and may therefore discard information valuable for downstream perception during point cloud generation. In addition, existing 4D Radar perception pipelines typically optimize Radar data processing and downstream perception independently, preventing task objectives from directly guiding the preprocessing stage. To address these limitations, we propose a Scene- and Task-Aware Radar (STAR) Preprocessor together with an end-to-end training framework. The STAR Preprocessor incorporates scene context and downstream task objectives to generate task-relevant Radar points, enabling the Radar representation to be optimized directly for perception. On the K-Radar benchmark, the proposed method achieves 74.3 AP, outperforming the previous state of the art by 5.6 AP points. Furthermore, applying the task-relevant points generated by STAR to various existing 3D detectors improves detection performance in most evaluation settings and yields an overall positive average gain over point clouds produced by conventional preprocessing.

0.28

Over-the-Scene Computation: Illumination-Programmed Functional Sensing of Unresolvable Populations

cs.IT cs.ET ·2026-11-05 ·Seyed Mohammad Azimi-Abarghouyi, Christopher G. Brinton
similarity 0.58
Abstract

Decisions about dense populations depend on how much will cross a boundary by a deadline and when the first member arrives. Conventional radar forms a range-Doppler map, whose cells add noise and whose detections merge unresolved members. We introduce over-the-scene computation, where illumination makes the scene compute such functionals without resolving members. With random echo phases, a correlator's mean output energy sums member reflectivities weighted by a kernel set by the waveform and template. The waveform's ambiguity function is this computation's transfer function, determining computable functionals and their noise cost. One readout aggregates members over a small delay-Doppler area but along a line segment growing with duration, longest for the chirp of matching slope among constant-envelope waveforms. Members predicted to share a range lie on such a line, so a chirp's mean beat spectrum is the predicted range profile at a look-ahead horizon set by its rate. For unbiased estimation, a Cramer-Rao bound over all equal-energy waveforms favors resolving members above unit signal-to-noise ratio (SNR) and grouping weaker ones into unit-SNR sets. At 0.65 members per cell, -10 dB member SNR, and one sweep, the chirp's bin sum inside the boundary comes within 16% of this bound in root-mean-square error and, with 77 times fewer samples per horizon, outperforms every unbiased estimator from a coherent processing interval of equal dwell, bandwidth, and energy. No finite set of waveform-template probes determines an unconstrained Rayleigh-fluctuating population's first arrival, but bisection localizes it if first arrivals outweigh later arrivals' sidelobes.

0.34

A Robust Learning Framework for Deep-Learning-Based Radar Target Detection With Partially Mislabeled Training Data

eess.SP ·2026-10-05 ·Chuanfei Zang, Yiru Lin, Yumiao Wang, Xingyu Chen, Xiaobo Yang +1 more
similarity 0.58
Abstract

Deep-learning-based radar target detection has substantially improved detection performance, but its effectiveness depends critically on the correctness of the training labels assigned to radar echo samples. In practical applications, training data may contain partially mislabeled samples, which can cause detection models to learn biased supervisory information and thereby degrade detection performance. To address this issue, this paper proposes SL-RLF, a robust learning framework for deep-learning-based radar target detection with partially mislabeled training data. Specifically, we establish a probabilistic model to characterize the generation mechanisms of label errors in radar target detection and analyze the robustness of detection models under partial label errors within a risk minimization formulation. Theoretical analysis shows that, under appropriate assumptions, a loss function satisfying the symmetry condition enables the detection model in the learning framework to be robust against partial label errors. Guided by this result, we design a loss function satisfying the symmetry condition and construct the proposed robust learning framework, SL-RLF. Theoretically, under the corresponding label-error conditions, the optimal detection model learned by SL-RLF from partially mislabeled training data can achieve the same detection performance under the true data distribution as the optimal model learned from accurately labeled data. Experimental results demonstrate that, under different types and levels of partial label errors, the proposed SL-RLF consistently outperforms representative methods, including Co-teaching and TCE, and its robustness is generally consistent with the theoretical analysis.

0.27

ICIBS: Increasing the Context for Ice Boundary Segmentation

cs.CV ·2026-10-20 ·Marcel Dreier, Dakota Pyles, Nora Gourmelon, Moritz Koch, Fei Wu +4 more
benchmarkdatasetcode/data similarity 0.58
Abstract

Mountain glaciers and ice sheets are undergoing rapid loss of ice mass. To assess their current volume and ice-thickness distribution, and to accurately forecast their future, ground-penetrating radar systems are employed to measure ice thickness. These instruments produce radio-echo sounding data that reveal the internal structure of the ice and its boundaries at the surface and beneath the ice body. However, delineating these interfaces is time-consuming as the surveyed area can span several hundred kilometers. To accelerate the labelling process, automated methods have emerged, but they often struggle to delineate the ice bottom, particularly in temperate glaciers. The high water content inherent in temperate ice increases both scattering and attenuation of the radar signal, resulting in weak and ambiguous reflections at the ice bottom and generally noisier data. As a result, the visual features corresponding to the ice bottom become ambiguous. To address this issue, we propose several extensions to deep learning models that incorporate additional contextual information into the prediction. Specifically, we integrate modifications that incorporate additional spatial and geo-spatial contextual information into the network. With these enhancements, we achieve a new state-of-the-art performance on the IceAnatomy benchmark dataset, with mean errors of 10.9 m for the FAU subset and 43.4 m for the CReSIS subset in a single combined system. We also demonstrate that our method generalises well to previously unseen data, outperforming the baseline by 49.6 % on new campaign data from Patagonia. The model code and the new dataset are available at https://github.com/ki7077/ICIBS/tree/main and https://zenodo.org/records/23392580.

0.29