CS Paper Radar

Prayer-Gait-Auth: Smartphone IMU-based Behavioral Biometrics from Structured Islamic Prayer Movements

Hassan Hizeh, Anwar B. Alshaibani, Muhammad Mahboob Ur Rahman, Tareq Y. Al-Naffouri

eess.SP ·submitted 2026-08-27 11:41 UTC · v1

Abstract

Islamic prayer is a structured movement activity that offers a distinctive setting for behavioral biometrics: all participants execute the same action sequence, so identity must be inferred from differences in execution. We collected inertial data from 95 participants using their own smartphones during nightly congregational Islamic prayer (Taraweeh). A label-aware pipeline converts long recordings into structurally complete two-rakaah behavioral samples (prayer units). This allows us to design unit-level and complete-session behavioral biometrics protocols. To address arbitrary smartphone orientation in worshippers' pockets, we study two motion representations: rotation-invariant magnitudes with gravity-relative acceleration components, and a metadata-aware Qibla-referenced canonicalization that harmonizes platform conventions, reconstructs device-to-world attitude, corrects Android magnetic north to true north via WMM2025, and expresses acceleration and angular velocity in a common Qibla-left-up frame. Under unit-level protocol, the invariant and Qibla-referenced representations reach learned pairwise Random Forest AUC/EER of 0.9932/4.07% and 0.9923/3.96%; under complete-session holdout, 0.9700/7.62% and 0.9618/7.81%. Qibla-frame directional ablations show the complete six-axis representation is strongest overall, with acceleration retaining most learned-verification performance and vertical motion the strongest single-axis cue. A Qibla-referenced SimCLR experiment further yields participant-template AUC 0.9805-0.9817 and EER 5.81-6.24% across two unit-level runs. Signal-, descriptor-, prayer-component ablation analyses show participant identity is distributed across movement dynamics rather than concentrated in one signal or posture. These results establish structured prayer movement as a measurable cross-session behavioral biometric.

Comment
14 pagees, 3 figures, 9 tables, submitted to a suitable journal for possible publication

Closest papers

Nearest neighbours by meaning across the whole index.

Rotation-Invariant Multi-IMU Activity Recognition under Independent Per-Location Orientation Shifts

cs.AI cs.LG ·2026-08-16 ·Seungyeol Baek, Yoonbyung Chai, Yonghyeon Lee, Sungjoon Choi, Sungho Suh
published similarity 0.63
Abstract · 6 pages, 2 figures. ACM International Symposium on Wearable Computing (ISWC) 2026

Human Activity Recognition (HAR) with self-administered wearables, such as at-home rehabilitation and exercise monitoring, often requires reattaching inertial measurement units (IMUs) across sessions. In multi-IMU settings, this can induce independent orientation offsets across body locations, a deployment shift that conventional scalar HAR models do not structurally handle. Existing remedies rely on rotation augmentation, whose robustness depends on sampled transformations, or calibration and orientationnormalization pipelines requiring additional reference-frame assumptions or explicit procedures. We present Truly Rotation-Invariant HAR (TRI-HAR), a rotation-invariant framework that makes robustness to independent per-location IMU orientation offsets a structural model property. TRI-HAR reshapes accelerometer and gyroscope streams into triaxial vectors, applies a shared SO(3)-equivariant backbone and invariant projection to each IMU location, and fuses the resulting invariant features for activity classification. Across four multi-IMU benchmarks, TRI-HAR preserves macro-F1 under fixed independent per-location SO(3) rotations and outperforms rotation-augmented baselines under this target shift without requiring rotational augmentation.

0.58

CoWear: Towards Collaborative Wearable Inertial Localization with Multiple Smart Devices

cs.RO ·2026-10-14 ·Zhuoyuan She, Zhanpeng Zhang, Yapeng Chen, Jiale Wang, Xin Xie +1 more
dataset similarity 0.62
Abstract · 8 pages, 5 figures

Consumer smart devices observe the same human motion from different body locations, yet existing inertial-localization benchmarks rarely provide synchronized heterogeneous wearables with device-specific motion ground truth. We present CoWear, a dataset and reference framework for collaborative inertial localization using a smartphone, smartwatch, and smart glasses. The dataset contains over 30 participants, over 300 walking sessions, and more than 30 hours and 100 km of aggregate device trajectories, with each device individually tracked by motion capture. To enable collaboration across distinct body motions, we train role-specific estimators to predict the displacement of a common reference device over synchronized temporal windows. Their predictions are transformed to the world frame using gyroscope integration and fused according to learned uncertainty. Experiments using phone, glasses, and watch as reference targets show that multi-device fusion consistently improves both displacement and trajectory rollout accuracy over individual-device estimation. CoWear provides a dataset and reproducible baseline for studying collaborative inertial localization across heterogeneous consumer wearables.

0.26

ArmPoser: Real-Time, Calibration-Free Arm Pose Estimation from Smartwatch IMU

cs.CV cs.HC ·2026-09-08 ·Bishnu Dev, Vasco Xu, Xi-Aan Loh, Chenfeng Gao, Henry Hoffmann +1 more
published similarity 0.57
Abstract

Arm pose estimation enables applications in fitness, extended reality input, rehabilitation, and life logging. Prior smartwatch-based approaches rely on calibration poses and preprocessing pipelines that transform raw IMU measurements into standardized training formats. These steps hinder deployment in everyday settings and introduce errors due to imperfect calibration and sensor drift. We present ArmPoser, a calibration-free arm pose estimation system using a single smartwatch IMU. Our central contribution is training models directly in the reference frame native to consumer smartwatches, aligning learning with how IMU data is produced by deployed devices. By operating on device-native axes, ArmPoser removes the need for coordinate transformations, explicit alignment, and bone-offset calibration used in prior work. We further augment training with physically grounded variations in watch placement and arm morphology to account for user-specific variability. ArmPoser also includes a wear-configuration module that infers anterior or posterior forearm placement and crown orientation. We evaluate pose estimation on public benchmarks and on a 10-participant, 30-activity study using watchOS and Android smartwatches, where ArmPoser matches or exceeds calibrated baselines without any user calibration.

0.28

GaitFM: A Cross-Modal Foundation Model for Wearable Gait Assessment

cs.CV ·2026-11-01 ·Yize Cai, Zhiqing Hong
similarity 0.56
Abstract · 18 pages, 4 figures

Gait assessment supports the diagnosis, monitoring, and prognosis of diverse movement-related conditions, such as neurological and musculoskeletal disorders. Recent advances in deep learning using everyday wearable inertial measurement units (IMUs) offer an accessible and low-cost approach to automated gait assessment. However, IMU measurements vary substantially across individuals, body locations, and device configurations, while existing deep learning models are typically developed using small, homogeneous datasets for specific clinical tasks, limiting their robustness and generalizability in diverse real-world contexts. Here we present GaitFM, a cross-modal foundation model for gait assessment using IMU sensors. GaitFM improves the generalizability of gait assessment by transferring knowledge from large vision models and pretraining on unlabeled IMU sensor data. We pretrain GaitFM on a large curated dataset comprising about 4,000 participants and 1.23 million gait windows across diverse clinical and daily conditions, sensor modalities, and body locations. GaitFM demonstrates strong performance across 18 gait-related tasks, including 3 gait parameter estimation tasks, 14 disease and gait abnormality detection tasks, and 1 clinical outcome prediction task. Furthermore, GaitFM generalizes across different sensor configurations and body locations, including those commonly used in clinical settings and everyday wearable devices. These findings demonstrate the effectiveness of transferring visual knowledge in improving sensor-based gait assessment performance, offering a new promising pathway for addressing data scarcity in the sensor and medical domains.

0.13

Foundation models for movement data: Are they ready for prime-time?

eess.SP cs.LG ·2026-08-13 ·Alexander Bräuer, Benjamin Cauchi, Nils Strodthoff
code/data similarity 0.55
Abstract · 14 pages, 6 figures, 8 tables, code is available at https://github.com/AI4HealthUOL/movement-fm-benchmarking

Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring, but systematic evidence of their advantages is lacking. We present the first comprehensive evaluation of four open-source accelerometer FMs against supervised baselines covering 19 tasks across the domains of activity recognition including activities of daily living, clinical monitoring, and physiological inference. We find task-dependent performance results: supervised models remain competitive with FMs on human action recognition (HAR), with no consistent advantage for either, while selected FMs lead on fall and stress detection and are the most robust to sensor-placement variation. As frozen feature extractors, FMs are strongest for demographic inference, whereas sleep staging performance remains near chance level for all models. The internal FM representations show strong similarity across layers, highlighting potential for future FM improvements. Linear and frozen probing reveals that UniMTS provides the strongest representations and is the only FM that surpasses the supervised baselines without finetuning. Concept discovery analysis shows all models capture high-intensity activities clearly but struggle with sedentary, complex or ambiguous activities. We provide scenario-based deployment recommendations. Furthermore, we identify FM-derived activity profile inference-moving beyond fixed category classification-as a promising research direction.

0.30

RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohorts

cs.AI cs.CV ·2026-09-08 ·Diwas Lamsal, Juha Carlon, Reinhard Claeys, Maxim Yudayev, Louis Flynn +6 more
publishedbenchmarkhot direction similarity 0.55
Abstract · Accepted to BMVC 2026 (Oral)

Assistive devices for people with mobility impairments, such as powered exoskeletons, rely on accurate locomotion mode recognition to adapt control strategies and provide appropriate assistance during daily activities. However, public benchmarks are typically collected from healthy adults, lack temporally precise labels necessary for detecting mode transitions, or focus on a limited set of tasks. To support development and evaluation under realistic clinical constraints and daily mobility demands, we introduce RevalExo, a functional daily-activity benchmark for inertial and visual locomotion mode recognition. RevalExo is built around a standardized, clinically and ecologically validated daily-activity protocol reflecting the cumulative everyday mobility demands in ageing and clinical populations. The benchmark includes 27 participants across three cohorts: older adults without mobility impairments, stroke survivors, and older adults with probable sarcopenia. The full cohort was recorded with lower-body IMUs, while synchronized egocentric video was collected for a clinically feasible subset of 13 participants. RevalExo provides 10.1 hours of frame-level annotations across 11 locomotion modes, including 5.1 hours of paired inertial--visual recordings. We benchmark three challenges: unimodal and multimodal locomotion mode recognition across multiple horizons, cross-population generalization from older adults without mobility impairments to clinical cohorts, and vision-guided knowledge transfer to IMU-only models. Results confirm consistent gains from fusing inertial and visual inputs but reveal a substantial gap between general recognition ($\sim$93\% F1) and recognition during transitions ($\sim$68\% F1), alongside persistent challenges in cross-population generalization and cross-modal transfer. We release RevalExo to stimulate further research on these open challenges.

0.46

Smartphone-Aided VR Exergames for HIIT: Gamifying Fitness with Real-Time Pose Estimation

cs.HC cs.AI ·2026-11-04 ·Abhiram Kothagundu, Pheelip Pritipal Raipure, Abhijit Chandrakant Patil, Himangshu Sarma, Christian Eichhorn +2 more
hot direction similarity 0.55
Abstract

This paper introduces an innovative virtual reality (VR) exergame system designed to gamify High-Intensity Interval Training (HIIT) workouts through 11 predefined combo moves, including squat-punch combinations, bilateral arm strikes, and diagonal stretch combos. Unlike conventional tracking methods that often rely on wearable motion capture suits or limited headset-based sensors, our system uses a standard smartphone camera placed on a tripod to capture full-body movement. This approach offers a cost-effective and scalable alternative, particularly well-suited to the fast, dynamic motions typical of HIIT routines. The smartphone footage is processed in real time using a pose estimation algorithm, with extracted biomechanical data analyzed by a backend server built on the Model Context Protocol (MCP), Anthropic's open standard for connecting AI models to structured data sources and tools, and a GPT-4o large language model. The system generates personalized assessments of form accuracy, movement efficiency, exercise intensity, and potential injury risks, tailored specifically to high-impact, time-sensitive exercises. A within-subject study involving 20 participants (ages 18-25) compared experiences in VR and Non-VR HIIT sessions. Results indicated significantly higher enjoyment (Mean = 3.5 vs 2.8, p = 0.02), improved immersion/focus (Mean = 3.2 vs 2.8, p = 0.03), and increased likelihood to recommend (Mean = 3.2 vs 2.7, p = 0.04) under the VR condition. Confidence to continue did not differ significantly between conditions (p = 0.15), while perceived intensity remained comparable. The MCP system showed strong agreement with expert evaluation (87.5%, N = 10 sessions, one certified trainer), supporting its reliability as a feedback tool.

0.29

Beyond Gait: Person Identification from Millimeter-Wave Point Clouds Across Activities of Daily Living

cs.CV ·2026-09-08 ·Xilai Wang, Zixiong Han, Saad Rhanmouni, Chenzhe Zhao, Yunze Lu +1 more
benchmark similarity 0.55
Abstract · v2: Revised the activity-identity learning framework, updated experimental comparisons, and improved manuscript presentation

Person identification from millimeter-wave (mmWave) radar point clouds has primarily focused on gait. However, since indoor walking is typically brief and fragmented, gait-based identification is largely constrained to designated passages that support continuous walking. Meanwhile, non-gait activities of daily living (ADLs) are pervasive and also encode discriminative personal signatures. In this study, we evaluate the feasibility of ADL-based identification from sparse mmWave point clouds using mm-ADL, a dataset comprising seven core ADLs collected from 11 subjects under controlled protocols. Moving beyond uniform gait introduces significant activity-dependent variations that confound identity representations. To address this challenge, we systematically benchmark three activity-identity learning paradigms: monolithic learning, joint multi-task learning, and two-stage activity-conditioned routing, under both closed-set identification (ID) and subject-disjoint re-identification (ReID) biometric settings. In parallel, we propose Dual-Stream Static-Dynamic PointNet (DS-SDPNet), an architecture tailored to radar point clouds that captures complementary spatial morphology and motion dynamics. Across seven ADLs, DS-SDPNet achieves 70.2% mean closed-set identification accuracy and outperforms existing baselines on both mm-ADL and mmGait. Moreover, benchmarking the three paradigms without ground-truth activity labels during inference yields up to 68.0% closed-set accuracy and 75.4% ReID mAP, providing a systematic baseline and confirming the feasibility of point-cloud-based biometric identification across diverse daily activities.

0.33