CS Paper Radar

FreqPKC: Frequency-Aware PeakConv for Radar Semantic Segmentation

Yangyong Deng, Pengyu Zhang, Shaoqiu Song, Xiaotao Huang, Jian Wang

cs.CV ·submitted 2026-10-24 07:22 UTC · v1

Abstract

Automotive millimeter-wave (mmWave) radar has attracted increasing attention for semantic segmentation in autonomous driving, owing to its robustness under adverse weather and lighting conditions. Recent works have introduced radar-specific neural operators such as PeakConv (PKC), inspired by constant false alarm rate (CFAR) detection, to better model the peak-dominated characteristics of radar images. However, existing methods typically treat the guard bandwidth as learnable parameters, without explicitly characterizing the frequency response of the PKC operator. In this work, we revisit PKC from a frequency-domain perspective and propose Frequency-Aware PeakConv (FreqPKC), which explicitly models and exploits its underlying spectral characteristics. By analyzing the frequency response of PKC, FreqPKC enables the network to capture a broader range of frequency components and adaptively adjust its effective bandwidth. With the proposed Frequency-Aware (FA) module, the network can infer appropriate guard bandwidths to balance high- and low-frequency information: it enhances high-frequency components in target regions for more precise segmentation while suppressing noise through low-frequency filtering in background areas. Building on FreqPKC, we further develop FreqPKC-Net, a radar semantic segmentation (RSS) framework that integrates frequency-guided adaptive modulation with cross-view fusion for multi-view inputs, and can also be adapted to single-view data. Experiments on the public datasets CARRADA, CARRADA-RAC, and a self-built dataset named RS-SAR demonstrate that FreqPKC-Net consistently outperforms existing SoTA methods on both range-Doppler and range-angle views.

Closest papers

Nearest neighbours by meaning across the whole index.

Radar Intelligent Detection with Coarse-Grained Labels

eess.SP ·2026-10-06 ·Chuanfei Zang, Yumiao Wang, Xingyu Chen, Yanbin Wang, Guolong Cui +1 more
published similarity 0.62
Abstract · IGARSS 2026 Oral

Many deep learning based radar target detectors rely on range-cell level labels for training, which are expensive to obtain. To reduce the labeling burden, this paper presents a training strategy that uses only range-window level labels. Specifically, two sub-echoes are randomly cropped from the same window echo, resulting in a known relative shift between them. A siamese Transformer is then used to identify target-salient responses from one sub-echo and form pseudo labels, which are mapped to the paired sub-echo according to the known shift. In addition, a shift-equivariant consistency (SEC) constraint is imposed to align the predicted responses of the two sub-echoes after shift compensation. By exploiting shift priors within each labeled window, the proposed approach learns reliable detection without requiring cell-level labels. Experimental results show that it consistently surpasses classical constant false alarm rate (CFAR) detectors and achieves performance close to range-cell level labels training, while substantially reducing labeling cost.

0.30

Radar Panoptic Transformer: Semantic-Guided Mask Queries for Dynamic Scene Understanding

cs.CV cs.LG ·2026-11-15 ·Mayank Mayank, Bharanidhar Duraisamy, Rohit Mohan, Abhinav Valada
similarity 0.61
Abstract · 9 pages, 4 figures

Automotive radar provides long-range sensing and direct Doppler velocity measurements, but its sparse and non-uniformly sampled point clouds pose significant challenges for panoptic segmentation. Dynamic objects often yield only a few detections amid a dominant static background, providing limiting the geometric cues for separating object instances. We propose \emph{Radar Panoptic Transformer (RPT)}, an end-to-end point-based network that incorporates radar-adaptive feature extraction with semantic-guided mask prediction. Its backbone aggregates pose-aligned temporal context through grouped vector attention and learns per-point neighborhood radii conditioned on range, azimuth, and radar cross section (RCS). Point-wise semantic predictions initialize queries at likely foreground detections and guide masked cross-attention through query-point class agreement, producing instance masks without geometric clustering. An auxiliary RCS-consistency loss matches instance-level statistics between predicted and annotated instances. RPT achieves state-of-the-art performance on RadarScenes with $71.6\%$ mIoU and $82.2\%$ PQ. We further evaluate RPT on MAN TruckScenes, where it outperforms the evaluated baselines in a long-range, full-surround radar setting with sensing ranges up to $230\,\mathrm{m}$. RPT achieves real-time end-to-end inference at $31$\,Hz on RadarScenes, exceeding the sensor frame rate.

0.20

4D Radar Perception Algorithms for Autonomous Driving: A Review

cs.RO cs.CVeess.SP ·2026-09-16 ·Xumin Wu, Jun Zhou, Jilin Mei, Chen Min, Yu Hu
similarity 0.60
Abstract · 12 pages, 9 figures, 5 tables. Submitted to IEEE Sensors Journal

Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to semantic segmentation, motion estimation, occupancy prediction, and dynamic scene reconstruction. This review organizes the field according to the evolution of perception tasks and algorithms. It first introduces radar fundamentals, data representations, and quality-enhancement methods, and then reviews object-level perception, motion and localization, local and dense spatial perception, and dynamic scene understanding. Across these directions, we compare radar-only learning, multimodal fusion, and cross-modal supervision and knowledge distillation. Particular attention is paid to how elevation, Doppler measurements, and radar physical priors are exploited across tasks. We further summarize the task coverage, input data, annotations, and evaluation protocols of existing datasets, clarifying the empirical support for different research directions. Finally, we discuss the common challenges and future directions of 4D radar perception for autonomous driving. This review provides a task-oriented perspective on the transition from sparse object perception to dynamic spatial understanding.

0.18

Real-Time Radar Semantic and Panoptic Scene Understanding

cs.CV ·2026-10-19 ·Santosh Parit, Julia Hindel, Rohit Mohan, Georgi Pramatarov, Paul Newman +2 more
similarity 0.59
Abstract

Robust scene understanding under varying environmental conditions is essential for safe autonomous driving. While cameras and LiDAR degrade in adverse weather and poor lighting, Frequency-Modulated Continuous-Wave (FMCW) spinning radar provides dependable 360° perception at extended ranges with minimal compute cost. However, real-time FMCW radar scene understanding is challenging due to complex signal returns, limited temporal resolution, and scarce annotated datasets. We introduce StreamRPS, a novel framework for streaming FMCW radar panoptic segmentation, comprising an automated label-generation pipeline via LiDAR scene completion and a real-time streaming network for semantic and panoptic segmentation. Our encoder-decoder streaming architecture comprises a radar-specific hierarchical Transformer encoder and task-specific decoders for semantic or panoptic prediction. Our encoder introduces a stem to capture range-dependent signatures, anisotropic patch embeddings to preserve angular resolution, and axial polar attention to separately model the periodic azimuth and bounded range axes. We further introduce azimuth roll rotation augmentation to simulate ego-vehicle rotation during training. Comprehensive experiments on the SAX and BOREAS datasets validate both our auto-labeling methodology and streaming segmentation network against established baselines. We outperform the strongest baseline by at least 1.4pp while processing sectors at over 400 FPS in a 4-sector streaming setting. We additionally provide manual annotations for 100 SAX radar scans, enabling independent evaluation of the entire framework.

0.41

STAR: Scene- and Task-Aware 4D Radar Preprocessing Towards End-to-End Cognitive Radar

cs.CV cs.AI ·2026-09-21 ·Seung-Hyun Song, Dong-Hee Paek, Seung-Hyun Kong
benchmark similarity 0.59
Abstract

Four-dimensional (4D) Radar has emerged as a key sensor for environmental perception, providing range, azimuth, elevation, and Doppler measurements while remaining robust to illumination changes and adverse weather conditions. However, conventional Radar preprocessing methods, such as constant false alarm rate (CFAR) detection, select measurements primarily based on signal-level criteria and may therefore discard information valuable for downstream perception during point cloud generation. In addition, existing 4D Radar perception pipelines typically optimize Radar data processing and downstream perception independently, preventing task objectives from directly guiding the preprocessing stage. To address these limitations, we propose a Scene- and Task-Aware Radar (STAR) Preprocessor together with an end-to-end training framework. The STAR Preprocessor incorporates scene context and downstream task objectives to generate task-relevant Radar points, enabling the Radar representation to be optimized directly for perception. On the K-Radar benchmark, the proposed method achieves 74.3 AP, outperforming the previous state of the art by 5.6 AP points. Furthermore, applying the task-relevant points generated by STAR to various existing 3D detectors improves detection performance in most evaluation settings and yields an overall positive average gain over point clouds produced by conventional preprocessing.

0.28

RaMOD: Moving-Object Detection from Raw mmWave Radar Cubes under Ego Motion

cs.RO cs.CV ·2026-11-09 ·Yuan Fang, Long Zhuang, Lingzi Xing, Xijia Wei, Jingqi Jiang +3 more
similarity 0.59
Abstract

Millimeter-wave (mmWave) radar provides weather-robust sensing and direct Doppler measurements, yet automotive perception pipelines often reduce its output to sparse point clouds or two-dimensional projections, leaving raw range-azimuth-Doppler (RAD) cubes underutilized. Ego motion induces Doppler responses from world-static structures, while Doppler wrapping aliases radial velocities, complicating moving-object detection and velocity estimation. We present RaMOD (Radar-based Moving-Object Detection), a real-time framework for moving-object detection and velocity estimation from raw RAD cubes acquired by a vehicle-mounted single-chip radar. RaMOD explicitly estimates frame-wise ego motion and uses the estimated radar translational velocity to predict the Doppler region of world-static structures and suppress returns within it. It temporally encodes the suppressed cubes into multi-scale features to predict RAD-space boxes with class labels. For each detected object, it predicts radial and forward velocities under raw-Doppler and Doppler-unwrapped hypotheses, together with Doppler-wrapping probabilities. On our BRIDGE-Liv dataset, RaMOD outperforms all compared raw-radar methods across RAD-cube, RA, and RD detection settings, achieving 80.8% cube mAP at IoU 0.30, 15.7 percentage points above the strongest RAD-cube baseline. Velocity MAE is 1.128 m/s, with 99.87% Doppler-wrapping accuracy.

0.21

Super-Resolution of Range-Doppler Maps: A Case Study with Chirp-Sequence Radar and Transformer

eess.SP ·2026-08-27 ·Sven Hinderer, Jonathan Riese, Zheming Yin, Bin Yang
similarity 0.59
Abstract

Range-Doppler (rD) maps produced by chirp- sequence (CS) radar systems are fundamentally limited in reso- lution by bandwidth, carrier frequency, and coherent processing interval constraints. Improving resolution through hardware is often impractical due to regulatory, cost, and real-time operation requirements. In this work, we investigate deep learning-based super- resolution of rD maps in both range and Doppler using a real- world dataset collected with an Infineon millimeter-wave CS radar. We propose a memory-efficient transformer architecture based on dual-path shifted window (DPSWIN) attention, which combines axial/dual-path attention with 1D shifted window (SWIN) attention for scalable processing of high-dimensional radar data. Our model is benchmarked against existing 2D SWIN attention-based super-resolution models, which we adapt to the rD-map super-resolution task. We prioritize reconstruction fidelity over perceptual quality and employ root mean squared error (RMSE)-based training objectives. We avoid adversarial or perceptual losses that may introduce visually plausible but physically incorrect structures. In addition, we incorporate CFAR-based target-detection losses to optimize downstream target detectability in the super-resolved rD maps. We further study the impact of signal processing and training design choices on the super-resolution, including magnitude compression, spatial upsampling strategies, and loss formulations. Experimental results demonstrate that the proposed framework achieves computationally efficient rD map super-resolution on previously unseen real-world environments.

0.24

Enabling Emergency Communication via Semantic Radar-Centric ISAC

cs.NI ·2026-09-06 ·Mohaimin Al Barat, Chaoyu Zhang, Hexuan Yu, Kai Zeng, Y. Thomas Hou +1 more
published similarity 0.57
Abstract · 6 pages, 1 figure, 5 tables. Accepted by IEEE MILCOM 2026

Combat aircraft and other modern military platforms field two co-located RF assets: a radar for sensing and a dedicated radio for communication. In contested battlefield environments, however, the dedicated communication path is highly likely to be targeted and disrupted by jamming, blockage, or physical damage, while the radar remains fully operational. A natural fallback is to repurpose the surviving radar aperture as an emergency communication channel. The difficulty is that radar is purposely engineered for sensing rather than communication, so loading any information onto its waveform perturbs the beampattern and inevitably erodes sensing performance: the more bits we push, the more sensing we lose. We identify the core problem as enabling emergency communication via a radar-centric integrated sensing and communication (ISAC) link while preserving the radar's primary sensing function. Therefore, we propose a semantic radar-centric ISAC framework that pairs a learned vector-quantized semantic encoder, which compresses task-relevant content into a few tens to a few hundred bits, with a wideband phased-MIMO radar restricted to a conservative spatial-spectral configuration subset that respects a bounded sensing-degradation budget. Experiments on SAR target classification and text classification show that our framework supports reliable emergency communication for downstream tasks while keeping the radar beampattern almost unchanged.

0.38