CS Paper Radar

Imputing Missing Data in Longitudinal Life-Logging Athlete Data

Saaz Kaur Sahdra, Kalina Yacef, HaeJin Lee, Judy Kay

cs.HC ·submitted 2026-10-30 04:03 UTC · v1

Abstract

Long-term, diverse personal informatics data enables athletes to understand and act on their health and performance goals, whether assessing readiness right now, tracking how soreness relates to training load over time, or predicting how sleep affects next-day performance. However, the inherent missingness in longitudinal data, if handled inappropriately, can bias these analyses. To our knowledge, no prior work has systematically benchmarked classical and deep learning imputation methods on long-term self-tracking data from athlete populations. We evaluate six imputation methods across four missingness mechanisms at missingness rates spanning 10-80%. Using seven diverse long-term self-tracking datasets from 231 individuals, we assess both point accuracy and the preservation of temporal and multivariate structure. Our results show that no single method dominates across all conditions and reveal a critical trade-off: while PAIN is superior on point-wise accuracy, deep learning methods (BRITS, GRU-D, and GRIN) are better at preserving multivariate and temporal structure, particularly under higher missingness. Our findings offer a practical, goal-conditioned framework that guides researchers in selecting imputation strategies aligned with both the underlying missingness mechanism and the specific analytical goal of long-term self-tracking studies.

Comment
Submitted to IMWUT

Closest papers

Nearest neighbours by meaning across the whole index.

Evaluating Deep Multivariate Imputation Models on Wearable Device Data

cs.LG cs.AIq-bio.QM ·2026-08-25 ·Skye Goodman, Roussel Desmond Nzoyem, Leandro Junges, Peter Kissack, Yasser Qureshi +3 more
similarity 0.74
Abstract

Wearable device data enables continuous health monitoring, but suffers from structured missingness: features sharing a physical sensor drop out together. Deep imputation methods such as BRITS and SAITS have seen limited evaluation on multimodal physiological data under realistic missingness, and existing benchmarks use random-point holdout protocols that incorrectly assume missingness is independent across features and time. Using data from a person with epilepsy recorded on a Garmin smartwatch, we develop an evaluation protocol that mines contiguous missing-run templates from training data, stratifies them by per-feature gap-length quantiles, and injects them as block masks with preserved co-missingness structure. A matched training protocol exposing models to the same missingness distribution reduces BRITS's severe-gap MAE by 43%, demonstrating the potential benefit of the proposed evaluation and training protocol within this single-participant dataset. We further extend BRITS with time-of-day encoding and a circadian harmonic channel. No single model dominates: linear interpolation is optimal for slow-moving features over short gaps; extended BRITS achieves lower MAE on dynamic cardiac features in moderate and severe gaps; and SAITS better preserves the ground-truth distribution by Jensen-Shannon distance despite higher MAE. Ultimately, model rankings strongly depend on evaluation designs. By exposing how traditional evaluation methods obscure true model capabilities, our transferable protocol establishes critical steps towards developing better imputation strategies for future multi-sensor wearable datasets.

0.07

Missingness-Aware Prior-Data Fitted Network for Irregular Clinical Time-Series

cs.LG ·2026-11-01 ·Hadi Mehdizavareh, Gabriele Santangelo, Giovanna Nicora, Pietro Bosoni, Simon Lebech Cichosz +3 more
similarity 0.69
Abstract

Clinical time series are irregularly observed with laboratory measurements recorded at uneven intervals and observation patterns often reflecting patient state, clinical concern, and site-specific practice. Consequently, missingness is not merely a nuisance factor but an informative signal for prediction. We propose a Missingness-Aware Prior-Data Fitted Network (MA-PFN) for irregular clinical time-series prediction. MA-PFN first learns a diffusion-based prior over joint laboratory value and observation-mask trajectories from source-domain electronic health records, capturing both physiological dynamics and measurement processes. Synthetic trajectories sampled from this prior are then transformed into context-query tasks to train a PFN-style conditional predictor. Once trained, the model performs prediction for new admissions in a single forward pass, requiring neither retraining nor parameter adaptation on target datasets. The framework naturally supports both imputation and forecasting through different context-query constructions. We conduct internal validation on a held-out MIMIC-III test set and external validation on eICU, evaluating both imputation and forecasting and assessing cross-domain generalization under shifts in patient populations, clinical practices, and observation mechanisms. MA-PFN achieves the best performance across all evaluated settings, with Overall/Macro nRMSD ranging from (0.193/0.186) for internal imputation to (0.297/0.297) for external forecasting, without target-domain adaptation. These results demonstrate that learning missingness-aware task priors enables accurate and transferable clinical time-series prediction under informative missingness.

0.08

Curriculum-Aware Interpolate-then-Refine: Learned Physiological Time-Series Imputation under Realistic Missingness

cs.LG cs.AI ·2026-08-21 ·Yu-Chao Huang, Haochen Zhang, Nicholas Konz, Tianlong Chen
benchmark similarity 0.65
Abstract

Imputing physiological time series (arterial blood pressure, blood glucose, etc.) is essential for addressing the missingness that pervades clinical data. Yet modern imputation methods perform poorly in this domain: a recent benchmark found that simple linear interpolation outperformed every learned imputer on real-world clinical signals with realistic gaps. We show that this reflects two properties of physiological missingness that generic imputers ignore: gaps may occur when the signal is clinically extreme rather than typical, and gap lengths can easily span orders of magnitude. To this end, we introduce Curriculum-Aware Interpolate-then-Refine (CAIR), a two-stage framework for physiological time-series imputation. Our key motivation is to learn a coarse base curve and then repeatedly correct it toward physiological realism, rather than predict a gap in a single pass. Consequently, CAIR couples a bidirectional-GRU interpolator with a Transformer refiner that corrects its own estimate over three successive passes, trained jointly under a broad, signal-agnostic random-gap curriculum. We evaluate imputers stratified by gap length and missingness mechanism (MCAR, MAR, NMAR) rather than by a single average, and CAIR is the most accurate under every mechanism on continuous glucose monitoring (AI-READI) and arterial pressure in intensive care (MIMIC-III). Its margin over the strongest baseline grows with difficulty, from 9% under MCAR to 19% under value-dependent dropout, where generic learned imputers are weakest. We further show low reconstruction error alone does not recover the burden metrics clinicians act on: interpolants matching CAIR's error fail to preserve those metrics, imputers that recover them are far less accurate, and CAIR alone ranks among the best on both axes.

0.13

ProCTI: Prototype-Refined Global Conditioning for Diffusion-Based Time Series Imputation

cs.LG cs.AI ·2026-09-29 ·Fariza Rashid, Duc Van Le, Rahat Masood, Gustavo Batista, Aruna Seneviratne +1 more
benchmark similarity 0.65
Abstract

Time series imputation has progressed from statistical and deep learning approaches to diffusion-based models, which have shown strong recent performance. Existing diffusion-based methods typically condition the reverse process using local contextual information from the current or neighbouring windows. Meanwhile, global dataset-level structure often remains implicit, limiting performance when local observations are sparse, noisy, or unrepresentative. To address this issue, we propose ProCTI, a diffusion-imputation framework that augments local conditioning with retrieved global dataset-level priors through learned prototypes. A hybrid conditioning mechanism integrates this global context with local signals during reverse diffusion, enabling more accurate reconstruction under varying missingness scenarios. Experiments across multiple benchmark datasets show that ProCTI outperforms strong baselines overall under random missingness, while remaining competitive under attribute-wise missingness. Furthermore, we use a latent-regime data model to characterise the precise conditions under which prototype-derived global conditioning provably improves imputation. We support this with a general theoretical analysis of local-global conditioning.

0.18

OmniSynth: A Meta-Evaluation Framework for Benchmarking the Quality of Missingness-Inclusive Synthetic Health Data

cs.DB ·2026-11-09 ·Annabel Zhu, Océane Doremus, Ariel Guerra-Adames, Marta Avalos-Fernandez, Emmanuel Lagarde +2 more
similarity 0.64
Abstract · Accepted to the BIBM'26 ARRL-Health'26 Workshop

Synthetic data are an emerging solution to the reproducibility crisis in machine learning for health, driven by data privacy restrictions surrounding electronic health records. Yet no consensus exists on how to evaluate synthetic health data quality, existing metrics functionally overlook missingness despite its prevalence in clinical data, and benchmarking frameworks have never been empirically validated. We introduce OmniSynth, a modular Python benchmarking suite that evaluates synthetic tabular data across fidelity, missingness similarity, utility, and privacy - the first framework to explicitly evaluate missingness as a distinct dimension of synthetic data fidelity. OmniSynth further proposes a meta-evaluation procedure that stress-tests evaluation performance under controlled degradation scenarios, providing a systematic characterization of how an evaluation framework behaves across datasets, sample sizes, and variable types. Applying this procedure to OmniSynth in two health datasets (Pima Indians Diabetes; MIMIC-IV-ED), we found that scores responded monotonically to degradation, three of four novel missingness metrics captured induced missing data patterns, and individual metric contributions to the scoring system were empirically justified.

0.24

Characterizing the Performance Gap in Human Activity Recognition for Older Adults

cs.HC cs.LG ·2026-10-02 ·Hossein Khayami, Sungjin Hwang, Eshed Ohn-Bar, David E. Conroy, Amanda Lazar +2 more
publishedbenchmark similarity 0.63
Abstract · 8 pages, 6 figures, to be published in Proceedings of the 2026 ACM International Symposium on Wearable Computers (ISWC '26)

Human activity recognition (HAR) from wrist-worn accelerometers is increasingly used for health and behavioral tracking. Yet, most wearable HAR models are developed and evaluated on datasets dominated by younger adults, leaving it unclear whether benchmark progress generalizes across age groups. In this work, we leverage MyMove, our carefully annotated, free-living older-adult HAR dataset (mean age 71), to evaluate deep-learning architectures and training regimes under both leave-one-subject-out and cross-dataset transfer. We find that improvements on younger-adult benchmarks fail to transfer equally to data collected from older adults, resulting in a persistent and often widening performance gap. However, richer representations, particularly frozen self-supervised features pretrained on the age-diverse UK Biobank dataset, substantially improve performance on data from older adults and consistently narrow the performance gap, at modest cost to younger-adult performance, though disparities remain. These findings suggest that benchmark gains and architectural scaling alone provide an incomplete picture of progress in wearable HAR, and broader advances may require representations that better capture population diversity, alongside personalized adaptation to individual movement patterns and routines.

0.21

A Deep Latent Variable Framework for Jointly Modeling Missingness, Measurement Error, and Heterogeneity

cs.LG stat.ML ·2026-08-30 ·Yasin Khadem Charvadeh, Grace Y. Yi, Mithat Gönen, Pouya Faroughi
similarity 0.63
Abstract · 24 pages, 4 figures

Missing data, measurement error, and population heterogeneity are pervasive challenges in analyzing data arising from modern observational studies and machine learning applications. Although these problems frequently coexist and interact, they are often treated separately in existing works. We propose a unified probabilistic framework that jointly addresses these issues utilizing deep latent variable representation. The proposed method integrates a novel hierarchical tree-routed variational autoencoder with pattern-aware latent representations and calibration-based denoising. The framework accommodates missing data mechanisms, including MCAR, MAR, and MNAR, while simultaneously learning subgroup-specific and globally shared latent structure. The introduced reconvergent routing mechanism enables selective parameters to be shared across related subpopulations, which offers flexibility as well as improved statistical efficiency. Simulation studies demonstrate substantial improvements over existing deep generative imputation approaches under complex heterogeneous missingness and measurement-error settings. The proposed framework provides a principled approach for learning from noisy and incomplete data in modern healthcare and other high-dimensional applications.

0.17

Design Choices for Multimodal Transformer Learning with Missing and Longitudinal Healthcare Data

cs.LG cs.CV ·2026-10-10 ·Rita Cordeiro Mendes, Maria Manuel Pereira, Carlos Santiago, Catarina Barata
similarity 0.62
Abstract

Multimodal learning offers the potential to improve predictions by integrating complementary information from heterogeneous data sources. However, multimodal datasets are frequently incomplete, raising important questions about how models should handle missing information. Although recent approaches increasingly rely on Transformer-based architectures for multimodal fusion, incomplete multimodal data introduces challenges such as missing modalities and intra-modal missingness, which motivate key architectural design choices, such as tokenization granularity. In addition, many datasets are longitudinal, with observations collected across multiple time points. The sequential nature of the Transformer architectures provides a natural framework for modeling such data, but introduces additional considerations, such as how temporal information should be represented. In this study, we systematically investigate these design choices using three different cancer datasets. We compare modality-level and feature-level tokenization and evaluate attention masking and imputation as strategies for handling missing information, both naturally occurring in the datasets and synthetically induced. We further investigate approaches for incorporating temporal information in our training process and how to model it. Experiments are conducted with unimodal and multimodal configurations, as well as different levels of missingness for binary survival classification and multiple time encoding strategies for discrete-time survival prediction. Our results show that while multimodal outperforms unimodal results, missing data heavily impacts predictions and thus effective design choices such as tokenization granularity, and intra-missing handling is essential for reliable prediction.

0.17