CS Paper Radar

Quality and Similarity Indicators for Video-Based Heart Rate and Respiratory Rate Fusion: A Controlled Evaluation

Nhi Nguyen, Le Nguyen, Manuel Lage Cañellas, Miguel Bordallo López, Constantino Álvarez Casado

cs.CV ·submitted 2026-11-16 17:10 UTC · v1

Abstract

Camera-based heart rate (HR) and respiratory rate (RR) estimates vary in reliability from window to window, and a common remedy is to fuse several extraction methods with weights from reference-free signal quality indicators. However, few studies test whether these indicators identify the most accurate method in each window or outperform simpler fusion. We evaluate 11 quality indicators and 8 inter-method similarity measures for fusing 7 HR and 10 RR extractors on four public datasets (75 test subjects). Filters, indicator directions, weighting parameters and a learned ridge baseline are selected on a separate five-subject set before testing. Fusion is compared with equal averaging, a constant typical-rate predictor, the best single method selected in advance and in hindsight, and a per-window oracle with a permutation-based null, using subject-level bootstrap confidence intervals. For HR, quality-weighted fusion reduced mean absolute error by 10.9% [5.2, 18.4] relative to averaging and by 15.6% [8.1, 23.1] relative to the method selected in advance, and was statistically indistinguishable from the best method selected in hindsight. Weighting methods by their agreement did not improve on averaging. For RR, the indicators could not identify the more accurate estimates: sharpened quality weighting increased error (-2.6% [-4.8, -0.8]), fused estimates were uncorrelated with the reference (r <= 0.22), and averaging was less accurate than the typical-rate predictor (-3.1% [-6.1, -0.4]). With a second respiratory reference, apparent RR gains reflected estimates moving toward its typical rate. Quality-guided fusion is worthwhile for video HR; for RR, 30-s windows improved estimates but not fusion.

Comment
15 pages, 7 figures, 4 tables; with 14 pages supplementary material included

Closest papers

Nearest neighbours by meaning across the whole index.

Oracle headroom without signal: null-calibrated evaluation of candidate selection for thermal heart rate estimation

cs.CV ·2026-10-01 ·Mohammad Rakibur Rahman, Nhi Nguyen, Sasan Sharifipour, Le Nguyen, Manuel Lage Cañellas +2 more
unusual similarity 0.65
Abstract · 5 pages, 3 figures

Camera-based physiological monitoring can produce multiple estimates from several facial regions, extraction methods, and processing settings. Signal quality indices aim to select reliable estimates without a physiological reference, and their potential is often assessed with an oracle that selects the estimate closest to the reference in each window. This retrospective selection can reward chance agreement. We model the effect with order statistics. For K independent candidates unrelated to the reference, the expected oracle error decreases approximately as 1/K. We analyze thermal heart rate estimation on 96 iBVP recordings with 168 candidates per 10 s window. The oracle achieves a mean absolute error of 0.91 bpm, compared with 10.74 bpm for the best fixed configuration, 18.03 bpm for the best quality index, and 8.61 bpm for a constant predictor. With K = 24, a forehead signal from another recording matches the correct one, with 4.62 against 4.61 bpm. Oracle evaluations should report candidate count, valid coverage, and matched null controls.

0.49

CardioFusion-AI: Robust ECG--PPG Fusion for Multimodal Physiological Monitoring Under Signal Degradation

eess.SP cs.LGq-bio.QM ·2026-08-26 ·Navaneetha Krishnan Kamalakannan, Janakiraman Kamalakannan
code/data similarity 0.63
Abstract · 7 pages, 4 figures. Under review at IEEE Journal of Biomedical and Health Informatics. Code: https://github.com/ka-cyber/CardioFusion-AI

Wearable electrocardiogram (ECG) and photoplethysmogram (PPG) sensors are complementary but individually fragile: motion artifact, poor contact, and sensor dropout can degrade one or both signals. Fusion strategies that assume both modalities are equally trustworthy can become less reliable than a single clean modality under degradation. We present CardioFusion-AI, a framework whose signal-processing front end, including R-peak and systolic-peak detection, an Orphanidou-type signal-quality index, and beat-by-beat pulse transit time estimation, is validated on 53 real intensive-care recordings (848 windows; heart-rate mean absolute error 1.61 bpm for ECG and 2.78 bpm for PPG) and a real annotated fetal ECG database (R-peak F1 0.89-0.98). We then conduct a controlled synthetic degradation study comparing eight ECG-PPG fusion strategies across six degradation regimes spanning graded corruption and complete modality loss, using five independent training seeds. Attention fusion achieved the lowest descriptive overall error (1.66+/-0.43 bpm). Both adaptive gates reallocated weight toward the healthy modality under complete modality loss, but showed near-zero correlation between gate weight and signal quality under graded degradation (r = 0.10-0.24). Signal-quality conditioning produced a specific improvement under missing-PPG conditions (1.56+/-0.59 bpm), approaching the 1.48 bpm unimodal ceiling. With only five training seeds, no pairwise comparison survives Holm-corrected significance testing; effect sizes and confidence intervals are therefore reported. These results indicate that modality availability and modality quality are functionally distinct problems for adaptive fusion.

0.59

Cross-Dataset Transfer and Reliability of Explainable Artificial Intelligence for RhythmFormer Remote Photoplethysmography

cs.CV cs.AIeess.IV ·2026-09-03 ·Louis Chen, Torbjörn E. M. Nordling
similarity 0.60
Abstract · 92 pages, 38 figures, incl. supplementary

Background. Remote photoplethysmography estimates the cardiovascular pulse from facial video, and its explanations have rested on inspecting heatmaps rather than on quantitative evidence about where a model reads it. We quantified the explanations and asked whether such explanations transfer between datasets and track model performance. Method. We trained eight condition-specific RhythmFormer models on NCKU-rPPG, recorded under three illumination levels, speaking, rotation, and cycling, estimated one heart rate per 5.12-second clip, and set them beside a UBFC-rPPG reproduction. Raw attention, rollout, attention flow, and Beyond Intuition were assessed by skin coverage and the Salience-guided Faithfulness Coefficient (SaCo). Results. Beyond Intuition ranked highest on both datasets, at median coverage 0.789 and SaCo 0.837 on Static level 3 against 0.826 and 0.917 on UBFC-rPPG; lower ranks differed. Within one participant of one condition, neither measure was related to a clip's heart-rate error, waveform correlation, or signal-to-noise ratio on either dataset: 186 of the 252 coefficients fell below $|ρ|=0.10$ and 28 reached $p<0.05$ against the 13 expected by chance. Across the eight scenarios only Beyond Intuition's coverage followed the three performance measures, at $ρ=-0.43$, $+0.57$, and $+0.43$, while the attention-only methods' SaCo ran opposite to each. It failed at 40 lux alone, its median coverage falling to 0.180 and its median SaCo to $-0.178$, whereas motion degraded the estimates far more without such a drop. Conclusions. Skin coverage and SaCo carry information complementary to the performance measures rather than a proxy for them: attributing to the skin does not guarantee an accurate estimate. What an attribution reveals about a condition is where the model looks rather than how faithfully its map is ordered.

0.27

PPG-Bench: A Unified Benchmark for PPG Foundation Models

cs.LG ·2026-10-09 ·Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Sandeep Singh, Siddharth Panwar
benchmarkcode/data similarity 0.58
Abstract

Photoplethysmography (PPG) is increasingly recorded by wearable and clinical devices at enormous scale, and a growing number of PPG foundation models (FMs) have been developed to compute reusable representations for various downstream tasks. These models are difficult to compare: different evaluations use different datasets, task definitions, preprocessing, downstream heads, hyperparameter tuning, and baselines. We present PPG-Bench, a unifying open-source benchmark evaluating five public PPG FMs across nine open-access datasets and 26 tasks spanning cardiovascular state estimation, activity, sleep, screening, and identification. We evaluate models under four downstream regimes of increasing adaptability (linear probing, random forests, frozen MLP probes, and end-to-end finetuning), with model-specific hyperparameter optimization and subject-disjoint cross-validation. We also evaluate against three controls: random/constant baseline, a deterministic pulse-rate-variability (PRV) feature set, and a generic time-series FM (MOMENT). Across all 68 task-regime combinations, 35.3% show no meaningful FM advantage over the random/constant baseline, and in 83.8% no PPG-specific FM outperforms both PRV and MOMENT. We also find that added downstream head capacity generally improves performance, but can cause significant degradation if the model is performing at chance/constant level. Current PPG FMs therefore cannot yet claim to provide generalised and transferrable representations of PPG signals, and future evaluation in this field should include checks against simple, non-learned controls. Code for the benchmark and instructions to evaluate more models can be found here - https://github.com/mannas-ai/ppg-bench.

0.31

Property-Specific Recoverability from Contact PPG to Camera rPPG under Heterogeneous Observation Conditions

eess.SP cs.AI ·2026-08-27 ·Timothy Oladunni, Farouk Ganiyu-Adewumi
similarity 0.57
Abstract

Camera-derived remote photoplethysmography (rPPG) is commonly validated through endpoint accuracy, but endpoint performance does not establish whether other physiological properties of source contact photoplethysmography (PPG) remain preserved recording by recording. We evaluated property-specific PPG-to-rPPG recoverability on 655 recordings from the Multi-Domain Mobile Video Physiology Dataset using CHROM as a fixed camera-rPPG observation pathway. The pathway reproduced the published CHROM correlation regime, with heart-rate MAE of 15.26 bpm and Pearson correlation of 0.0801. Matched-versus-shuffled validation revealed modest recording-specific autocorrelation correspondence, while spectral and recurrence-rate measures showed little matched discrimination. Maximal Lyapunov exponents showed essentially no recording-specific PPG-to-rPPG correspondence, with correlation of 0.0231 and permutation p-value of 0.5584, despite population-level overlap. Endpoint discrepancy exhibited Fitzpatrick-associated heterogeneity after adjustment for lighting and motion, including a Fitzpatrick VI versus III contrast of 9.32 bpm, while dynamical discrepancy showed no corresponding gradient. Aggregate RGB signal-to-noise ratio did not materially account for the endpoint contrast. In subject-held-out analysis, adding motion and lighting consistently reduced MAE across linear, ridge, and random-forest learners relative to rPPG-HR-only calibration, with reductions up to 13.32 percent. These findings show that recoverability is property-specific: physiological properties differ in recording-specific preservation and dependence on observation conditions, and population-level plausibility does not establish preservation of individual recordings.

0.27

Robust PPG-Exclusive Heart Rate Estimation During Maximal Exercise Using Population-Based Priors

eess.SP ·2026-10-27 ·Elisabetta De Giovanni, Iñigo Urteaga, Matteo Croci, Tomas Teijeiro
publishedbenchmark similarity 0.57
Abstract · Accepted and presented at 53rd Computing in Cardiology conference in Madrid, Spain on 20th - 23rd September 2026

PPG is the main technology for wearable heart rate (HR) monitoring. However, motion artifacts during intense physical activity reduce its reliability due to spectral overlap with the cardiac signal. This study investigates whether severely contaminated PPG signals can yield reliable HR estimates without auxiliary sensors by leveraging prior knowledge of HR dynamics. We acquired simultaneous PPG and ECG signals from 21 subjects during a maximal cycloergometer test. Using Leave-One-Subject-Out cross-validation, we built HR evolution priors from the ground-truth ECG and applied Dynamic Time Warping (DTW) to align normalized HR curves and estimate a barycenter average. DTW aligns normalized HR curves with minimal error across all subjects, validating robust population-based priors. For each test subject, we combined the PPG Power Spectral Density (PSD) with the prior distribution to generate a "posterior PSD". We identified and ranked candidate HR trajectories using heuristic search within the "posterior PSD" and selected the most likely path. Our approach reduced mean absolute error (MAE) in BPM relative to the ground-truth ECG by a median of 63.3% (IQR: 47.3%-74.6%) compared to a PPG+accelerometer benchmark. These results show that physiological priors and DTW-based alignment enable robust, PPG-exclusive HR monitoring during high-intensity exercise.

0.30

Apnea Burden-Guided Framework: Enhancing Out-of-Distribution Generalization in PPG-Based Sleep Apnea Characterization

eess.SP ·2026-08-12 ·Mantas Rinkevičius, Oskar Pfeffer, Amal Alissa, Nando Hegemann, Vaidotas Marozas
published similarity 0.57
Abstract · 16 pages, 13 figures, 4 tables, 53 references. Submitted to the IEEE Access journal

Sleep apnea is a common sleep-related breathing disorder associated with substantial cardiovascular and metabolic risk. Although overnight polysomnography remains the reference standard for diagnosis, its complexity and cost limit its suitability for long-term preventive monitoring at home. In wearable systems, arterial blood oxygen saturation (SpO2) is commonly used as the main predictor, whereas additional morphological features of the photoplethysmographic (PPG) pulse wave are usually underexplored. This study proposes a novel apnea burden prediction-based framework for sleep apnea severity assessment and investigates the influence of PPG features on model performance and out-of-distribution (OOD) generalization. The proposed framework first predicts apnea burden as a continuous measure, which is subsequently converted into the clinically relevant apnea-hypopnea index for subject-level classification into four severity groups in both in-distribution (ID) and OOD data. Three artificial neural network architectures were evaluated, and the performance metrics were averaged over five independent runs with different fixed random seeds. During OOD testing, the combination of PPG features and SpO2 led to increases of approximately 15.72% in macro-sensitivity, 9.22% in macro-accuracy, 16.01% in macro-F1-score, 11.08% in Cohen's kappa, and 13.22% in Matthews correlation coefficient, compared with using SpO2 alone. The low-complexity convolutional-recurrent models achieved the highest overall performance. The results indicated that the proposed apnea burden-guided framework, combined with PPG features and SpO2, improves sleep apnea characterization while showing encouraging OOD performance on an independent external dataset. Moreover, simpler hybrid architectures demonstrated strong potential for robust home-based preventive monitoring.

0.28

Validation of HRV Studio: A Transparent and Quality-Control-Aware Platform for Heart Rate Variability Analysis

cs.LG physics.med-phcs.SEq-bio.QM ·2026-08-25 ·Cyrus Mexon Evrard Djindot, Faliang Liu, Sylvain Laborde, Yinjia Zhang, Jessie Chen +4 more
code/data similarity 0.56
Abstract · 33 pages, 8 figures. Source code available at https://github.com/CyrusMexon/HRV-Analysis_TJU

Reproducibility of heart rate variability (HRV) analysis is limited by differences in preprocessing and computational conventions across software platforms. We developed HRV Studio, an open-source PyQt6-based desktop application integrating transparent HRV analysis with automated quality-control (QC) diagnostics. Validation included large-scale agreement with NeuroKit2, targeted Kubios benchmarking, spectral-method comparison, synthetic perturbation testing, recording-duration sensitivity analysis, and arrhythmia-focused QC stress testing. HRV Studio showed near-identical agreement for the widely used time-domain indices RMSSD and SDNN under matched conditions. In the primary five-minute NeuroKit2 comparison, frequency-domain median relative errors were 1.35% for LF, 0.18% for HF, and 1.41% for LF/HF, while VLF remained more convention-sensitive (37.79%). Nonlinear Poincaré indices also demonstrated high consistency. Sequence-harmonized Kubios benchmarking confirmed near-identical agreement for time-domain and nonlinear indices and strong agreement for most frequency-domain measures. Extended ten-minute analyses reproduced the same overall pattern with lower disagreement for some convention-sensitive spectral outputs. Synthetic and arrhythmia stress tests maintained 100% numerical stability while consistently triggering QC warnings. Overall, HRV Studio provides a transparent and reproducible platform for HRV research, with strong cross-platform consistency when NN sequences, preprocessing, and analytical conventions are harmonized. Stress-test results indicate computational robustness rather than clinical validation.

0.54