CS Paper Radar

Learning to Assess Heartbeat Observability for mmWave Heart-Rate Sensing

Yuxuan Hu, Shilin Shan, Jianfei Yang, Feng Xu

cs.AI ·submitted 2026-10-02 16:46 UTC · v1
code/data

Abstract

Contactless heart-rate sensing with millimeter-wave (mmWave) radar requires assessing whether individual measurements support reliable estimation. We study learning to assess heartbeat observability, defined as the readability of the heartbeat component in an acquired phase spectrum, for selective heart-rate estimation. Coherent superposition of scatterer returns can suppress this component even under similar macroscopic observation geometry, motivating assessment directly from acquired measurements. To obtain training supervision across different observability conditions, we develop a controllable multi-scatterer frequency-modulated continuous-wave (FMCW) simulator. Agreement between the dominant heartbeat-band peak and the known heart rate provides an automatic observability label for each simulated measurement. We propose HEAR (Heartbeat Estimation with Assessed Reliability), a compact dual-task Transformer that jointly predicts an observability score and heart rate. Its input combines spectral magnitudes with frequencies relative to the respiration fundamental, providing context for respiratory harmonics. Trained solely on simulated observations, HEAR transfers zero-shot to two public real-world datasets collected at 60 and 120 GHz from 134 subjects. The same learned score supports selective prediction with both HEAR's own heart-rate head and multiple existing estimators. On the 120 GHz dataset, score-based selection reduces the HR head's mean absolute error from 17.9 BPM at full coverage to 1.6 BPM at 50% coverage. The complete pipeline achieves an end-to-end processing latency of 50.8 ms on an edge device. Project page: https://yuxuanhu9.github.io/HEAR/.

Comment
19 pages, 11 figures. Project page: https://yuxuanhu9.github.io/HEAR/

Closest papers

Nearest neighbours by meaning across the whole index.

Kapture: Capturing Cardiac Dynamics with Koopman-Governed Learning for Efficient Radar-Based Electrocardiogram Recovery

eess.SP cs.AI ·2026-10-04 ·Tong Wu, Jing Peng, Ziqi Feng, Yuanyuan Zhang
code/data similarity 0.71
Abstract · 5 pages, 3 figures, 2 tables

Millimeter-wave (mmWave) radar enables unobtrusive, contactless electrocardiogram (ECG) reconstruction for cardiac monitoring. Time-frequency spectrograms preserve fine cardiac patterns but often require large backbones to separate ECG-relevant features from respiration, motion, multipath, and subject-dependent interference. We propose Kapture, a parameter-efficient Koopman-governed framework that projects radar hidden states into a low-dimensional observable space and identifies a regularized full linear evolution operator from adjacent observable states. The Koopman-predicted observables refine subsequent hidden states for ECG reconstruction. To suppress predictable interference dynamics, a temporal contrastive objective pulls neighboring states together and separates non-neighbors, while reconstruction supervision preserves task relevance. Using approximately 80 minutes of quasi-static radar-ECG recordings containing realistic noise from body movements and other sources, Kapture consistently improves reconstruction across matched backbone widths, with the largest gains under aggressive compression. The compact configuration approaches the full-width reference accuracy with 68.1% fewer parameters and 91.3% fewer profiler-covered floating-point operations (FLOPs), while the full-width configuration delivers the strongest overall reconstruction performance. Our code will be made publicly available after potential publication.

0.34

VitalFR3: Wireless Vital Sign Sensing in the Upper Mid-Band (FR3)

eess.SP ·2026-10-03 ·Gholamreza Bakhshi, Hatem Abou-Zeid
similarity 0.64
Abstract · 14 pages, 12 figures

Frequency range 3 (FR3) is being explored for sixth-generation (6G) integrated sensing and communication (ISAC).However, experimental evidence on the feasibility of physiological sensing in this band is limited. This paper presents VitalFR3, an SDR-based frequency-modulated continuous-wave (FMCW) measurement platform that integrates a direct-sampling Ettus USRP X440 with a SignalCraft SC2470 frequency converter. To the best of our knowledge, this is the first calibrated SDRbased FMCW platform evaluated for respiration and cardiac-rate estimation from human measurements across multiple FR3center frequencies. Using a 100 MHz waveform, we operate the platform at six RF center frequencies from 10 to 22.5 GHz.We demonstrate how to characterize and calibrate the completeVitalFR3 transmit and receive path directly from loopback recordings, achieving a magnitude error below 0.061 dB at all six frequencies. We then propose a low-complexity end-to-end processing pipeline for vital sign estimation. This involves the identification of a persistent target-associated response in fast time, respiratory tracking in slow time, followed by cardiac- rate estimation. The system is evaluated across 16 human measurements, achieving a respiratory-rate mean absolute error of 0.758 breaths per minute, and the majority of the cardiac- rate estimates fall within 5 BPM of their reference rates. In a separate breath-hold measurement, the estimated cardiac rate is 84.3 BPM versus approximately 84.5 BPM from the reference. These results establish VitalFR3 as a calibrated and configurable measurement platform for experimental physiological sensing across FR3.

0.18

A Universal Raw-IQ Radar Encoder for Cross-Sensor Human Sensing

cs.CV cs.LG ·2026-11-03 ·Jonas Leo Mueller, Dario Zanca, Sebastian Hoefler, Jan Petermann, Thomas Altstidl +3 more
publishedbenchmarkpositioncode/data similarity 0.64
Abstract · Accepted at the 2027 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

Radar-based human sensing typically relies on end-to-end task-specific models trained on hand-chosen signal projections, which generalize poorly across unseen users, tasks, and hardware. We argue that the dominant signal processing choice, the micro-Doppler spectrogram, is a poor starting point for transfer because it keeps the Doppler axis, which carrier frequency rescales, and discards the angular axis, which carrier frequency leaves unchanged. We instead pretrain a convolutional beta-VAE without labels on clutter-removed raw radar measurements from four platforms spanning 60 and 77 GHz and 4 to 12 virtual antennas, aligned by a unified spectral interpolation grid. For every downstream benchmark the encoder stays frozen, and only a small supervised temporal classifier is trained on its embeddings. We compare against supervised models trained end to end on each benchmark and a pretrained radar foundation model across ten settings covering activity, gesture, sign-language, and gait recognition. When the test users and the radar are seen during training, our encoder is best on all five benchmarks. For users never seen in training, it leads on three of four benchmarks, by 4.8 to 23.2 points. On subject-disjoint gait recognition, it is best for each of the four held-out subjects and 8.3 points above the strongest baseline on average, even though its pretraining excluded every recording of this radar. Excluding the test radar from pretraining costs at most 5.3 points on any benchmark. Code is available at https://github.com/jonasmueler/UniversalRadarEncoder_WACV.

0.50

A Synchronized Tri-Modality Wireless System for Multi-Point Non-Contact Cardiac Monitoring

cs.AR eess.SPeess.SY ·2026-11-05 ·Wei Ren, Kaili Zhao, Huansheng Yi, Miaoyang Hu, Jianqi Wang +2 more
similarity 0.61
Abstract · 11 pages, 9 figures

Cardiac physiological monitoring is fundamental to evaluating cardiovascular health and diagnosing related diseases. Non-contact radar sensing can capture chest-wall vibrations with spatial specificity, enabling localized physiological monitoring and cardiac assessment. Progress, however, has been limited by the absence of a reliable, research-grade hardware platform for rigorous validation of radar-based methods. Prior systems typically pair radar, namely Doppler cardiography (DCG), with only electrocardiography (ECG) or other coarse references, providing no direct mechanical ground truth and thus constraining fine-grained evaluation of radar outputs. We present a tri-modality wireless system that integrates ECG, seismocardiography (SCG), and DCG under a unified acquisition and control framework for time-aligned recording and analysis. The tri-modality system combines miniaturized wearable ECG/SCG modules with a high-resolution mmWave radar module, supporting spatially resolved sensing and subsequent feature extraction. To our knowledge, this is the first integrated ECG--SCG--DCG hardware system for comprehensive cardiac monitoring; it enables multi-point thoracic acquisition, achieves precise cross-modal synchronization, and maintains specifications suitable for wearable operation. Experiments on a linear-motion platform show close agreement between DCG- and SCG-derived displacements, confirming accurate displacement measurement. Human-subject studies further demonstrate cross-modal consistency and robust extraction of feature points, establishing ECG as the electrical anchor and SCG as the mechanical ground truth for DCG. Overall, the system provides a rigorous, spatially resolved validation platform that advances non-contact cardiac sensing and supports next-generation radar-based monitoring.

0.24

Phenomenon-Graph JEPA: Label-Efficient Representation Learning for Contactless Cardiorespiratory Sensing

cs.LG cs.ET ·2026-09-26 ·Constantino Álvarez Casado, Nhi Nguyen, Mohammad Rakibur Rahman, Le Nguyen, Manuel Lage Cañellas +2 more
similarity 0.61
Abstract · 9 pages, 4 figures, 7 tables, 24 numbered equations. Extended version of a conference submission, with additional methodological details, im…

Millimeter-wave (mmWave) radar and RGB-D cameras can record cardiac and respiratory waveforms continuously and without contact, but labeled recordings remain scarce because every label requires a supervised acquisition session. Self-supervised pretraining can exploit the unlabeled signals, yet contrastive methods depend on signal transformations and negative pairs whose validity is uncertain for cardiorespiratory data, where time warping changes breathing rate and distant windows can share the same physiological state. We present Phenomenon-Graph JEPA, a joint-embedding predictive architecture that learns from four processed one-dimensional streams without negative pairs or synthetic augmentation in its base configuration. Each stream is encoded by a temporal convolutional branch and a band-limited spectral branch. During pretraining, the model predicts stopped target embeddings along typed edges, which connect streams assigned to the same physiological phenomenon, and forward in time within a state episode. We treat this physiological typing as a testable hypothesis and compare it with wrong-edge and all-pairs prediction graphs. In the OMuSense-23 dataset, pretraining improves label-efficiency area over matched supervised training by 3.91 percentage points (95% interval 2.08 to 5.80, Holm-adjusted p = 0.006), and by 3.74 points under a second configuration evaluated on the same test participants. However, the wrong-edge and all-pairs controls do not establish a benefit from physiological typing. Optional Takens-inspired delay coordinates improve a validation comparison with learned history, whereas two wrist-only WESAD protocols do not establish a pretraining advantage. The study therefore separates the measured benefit of predictive representations from the physiological prior used to organize their training.

0.20

RT-VSS: In-House Ray Tracing for Vital Signs Sensing in FR3 Band

eess.SP ·2026-09-14 ·Rudranil Chattopadhyay, Zhuangzhuang Cui, Achiel Colpaert, Sofie Pollin
similarity 0.60
Abstract · Submitted to the IEEE conference for potential publication

Vital Signs Sensing, enabled by the evolution of wireless communications, is inherently challenging as the chest's micro-Doppler signatures can be corrupted by multipath, body movement and noise. Additionally, the prospects of the Frequency Range (FR) 3 band, spanning 7-24 GHz, are compelling due to centimeter-scale wavelength improving phase sensitivity to chest motion, while its abundant bandwidth and rich multipath enhance temporal and spatial diversity. In this paper, we validate the feasibility of using cellular communications in the FR3 band to monitor a human's breathing and heartbeat in an indoor environment. Using Blender to model physiologically accurate vital-signs signals as ground truth and Sionna Ray Tracing simulations, we find that it is feasible to extract breathing and heartbeat waveforms at FR3 frequencies. Furthermore, we perform a comparative analysis of ISAC performance against representative sub-6 GHz (FR1) and mmWave (FR2) frequencies, indicating the utility of the study across the frequency bands.

0.26

Track-conditioned Residual Frequency Estimation For Low-resolution FMCW Radar

eess.SP ·2026-09-24 ·Huy Trinh, George Shaker
similarity 0.59
Abstract

Low-resolution FMCW radar normally forms a complete range-Doppler representation before detection and tracking. After association, however, the tracker already predicts the target's next range and radial velocity. We propose track-conditioned residual estimation (TCRE), which removes the predicted moving-target phase before spectral formation, summarizes each 64-sample chirp by four coherent complex sums, and estimates the remaining beat-frequency and Doppler-frequency errors from phase progression. We account for the first-order fast-time and slow-time coupling of a moving target and derive the local phase-unwrapping region and three-receiver local information bound. Four summaries retain 93.77 percent of the zero-residual fast-time information while reducing the retained representation by a factor of 16. In 5,000 matched 60-GHz cluttered simulations, TCRE reduces range RMSE by 32.8 to 46.3 percent and velocity RMSE by 58.6 to 71.0 percent relative to a fully specified same-prior residual ZFFT.

0.52

Interaction-Gated Time-Frequency Learning for Parameter-Efficient PPG-Based Heart Rate Estimation

cs.LG cs.AIeess.SP ·2026-10-20 ·Anh Khoi Pham, Phat Lam, Thien Truong Nguyen Ly, Lam Pham
benchmark similarity 0.56
Abstract · Conference preprint, accepted at SoICT 2026

Photoplethysmography (PPG) enables low-cost and non-invasive heart rate (HR) monitoring but remains sensitive to waveform distortion, physiological variability, and measurement interference. Temporal waveform characteristics and frequency-domain periodicity provide complementary information for HR estimation; however, effectively exploring and integrating these representations within a compact model remains challenging. This paper proposes TF-IG, a parameter-efficient interaction-gated time-frequency learning framework for PPG-based HR estimation. TF-IG employs a dual-branch architecture in which a temporal branch captures pulse morphology via dilated depthwise-separable convolutions, while a frequency branch extracts cardiac periodicity information from bounded log-spectrogram representations. To combine the two domains, we introduce an interaction-gated fusion module that explicitly models feature agreement and discrepancy, while also learning feature-wise weights to balance temporal and spectral information. A parameter-shared regression head further maps the temporal, spectral, and fused representations into the final HR prediction space. Experiments on the benchmark BIDMC PPG and Respiration Dataset using a subject-exclusive training, validation, and test protocol show that TF-IG achieves a mean absolute error (MAE) of 1.227 BPM, a root mean square error (RMSE) of 2.060 BPM, a Pearson correlation coefficient of 0.9934, and 92.28 percent of estimates within 3 BPM, while remaining parameter-efficient with only 84.6K parameters. Ablation results further demonstrate the complementary contributions of the temporal and frequency branches, interaction-gated fusion, and shared regression head. These results indicate that explicitly modeling cross-domain interactions provides an effective accuracy-complexity trade-off for lightweight PPG-based HR estimation.

0.11