CS Paper Radar

WaveFoG: Wavelet Gated Transformer for Parkinson's Freezing of Gait Detection Using Wearable Accelerometer Signals

Md Shihabul Islam Shovo, Nishi Kanta Paul, Adrita Rahman, Israt Jerin Esha

eess.SP ·submitted 2026-08-26 05:16 UTC · v1
code/data

Abstract

Freezing of gait (FoG) is one of the most debilitating episodic motor symptoms of Parkinson's disease (PD). FoG detection from wrist worn inertial signals poses challenging problems such as extreme data class imbalance (only 12-18% of signal windows are FoG), low frequency postural instabilities alongside diagnostically crucial 3-8 Hz rhythmic tremors, and the need for subject independent generalisation. To address these, this paper presents WaveFoG, a novel wavelet gated Transformer architecture that combines multi scale representations from discrete wavelet transform (DWT) with a dual branch encoder. A 1D CNN captures local gait texture, and a Transformer captures global temporal context. They are fused via a sigmoid gating fusion layer that modulates the encoder output based on the DWT sub-band descriptors. Trained with focal loss and evaluated on the public Kaggle TLVMC FoG Prediction dataset under subject independent grouped ten fold cross validation (SI-CV), WaveFoG achieves a mean F1-score of 0.875 +/- 0.017 and AUPRC of 0.833 +/- 0.020, exceeding single branch baselines (1D CNN, Bi-LSTM, and vanilla Transformer) by up to 5.4 pp on F1. Temporal saliency maps highlight temporal patterns that are consistent with reported characteristics of FoG onset. The source code of this project is available at: https://github.com/Shihabul-Shuvo/WaveFoG

Closest papers

Nearest neighbours by meaning across the whole index.

Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach

cs.CV ·2026-09-09 ·Chandan Biswas, Aryan Singh, Anabik Pal
hot direction similarity 0.62
Abstract · 9 pages , 2 figures

Parkinson's disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control. Automated freezing-of-gait (FOG) detection supports the objective assessment of gait-related motor impairment. Two common approaches are used for FOG prediction: (i) analysing video recordings of the patient's movements and (ii) analysing data collected using inertial measurement unit (IMU) wearable sensors attached to the patient's lower limbs. Video-based approaches may suffer detection errors during continuous turning-in-place tasks because the lower limbs undergo substantial geometric self-occlusion, degrading pose-estimation accuracy. IMU-based approaches are generally less affected by visual occlusion; however, they are difficult to deploy outside clinical or laboratory settings, as the sensors must be attached securely and remain in place throughout the assessment. Motivated by this, we propose a cross-modal subspace distillation framework to mitigate the limitations of unimodal FOG detection by combining IMU accuracy with video-based practicality. We extract invariant latent topologies from a pre-trained kinematic oracle to structurally supervise a non-encoded visual architecture during training. To resolve periods of severe spatial occlusion, a dual-stream visual model probabilistically fuses skeletal graph nodes and continuous spatial pixels, dynamically shifting reliance to uninterrupted pixel boundaries as joint tracking confidence drops. Evaluated against a public, multi-modal sequence dataset of Parkinson's individuals executing continuous $360^\circ$ turns, empirical results demonstrate that applying sensory boundary topologies strictly mitigates tracking evaluation entropy. Our constrained optimisation confirms that highly precise FOG prediction bounds can be achieved over zero-wearable inference environments.

0.25

Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

cs.CV ·2026-09-08 ·Aryan Singh, Chandan Biswas
similarity 0.61
Abstract · 10 pages, 4 figures

Objective assessment of Freezing of Gait (FoG) in Parkinson's disease (PD) relies predominantly on wearable Inertial Measurement Units (IMUs). While IMUs provide optimal kinematic precision, mandatory sensor attachment restricts continuous clinical deployment. Conversely, unobtrusive vision-based alternatives suffer substantial classification errors during turning-in-place tasks, where geometric self-occlusion degrades deterministic skeletal coordinates and obscures the high-frequency precursors required for FoG detection. To resolve these physical observation limits, we propose a supervised cross-modal subspace distillation framework. During optimisation, pre-trained kinematic data from IMU sensors and contextual clinical metadata act as oracles to guide a deployable visual architecture. By incorporating joint velocity and acceleration derivatives, utilising a confidence-based gating mechanism, the visual model mitigates some of the tracking errors during occlusion events. Empirical evaluations confirm this latent alignment transfers the predictive fidelity of hardware sensors directly into the visual representation, yielding $85.5\%$ accuracy, and $82.4\%$ balanced accuracy. All the while maintaining a vision only model at inference.

0.25

Towards Context-Aware Clinical Motion Understanding in Daily Living at Home: Freezing of Gait Detection with Egocentric Vision

cs.AI ·2026-08-13 ·Vayalet Stefanova, Diwas Lamsal, Margot Genbrugge, Maxim Yudayev, Christian Schlenstedt +3 more
published similarity 0.59
Abstract · Accepted to ECCV Workshop 2026 (Human Motion Challenges in Real-World and Clinical Settings)

Understanding motion in daily living requires context beyond kinematics, because similar inertial patterns during activities of daily living (ADLs) can reflect intentional stopping, object interaction, or pathological movement impairment. Egocentric vision provides task-related context that may help disambiguate these cases. We investigate this challenge through freezing of gait (FOG) detection in Parkinson's disease (PD), a symptom strongly influenced by contextual factors during ADLs. Using synchronized egocentric video, wearable IMUs, and expert-annotated FOG labels collected from 13 PD participants in their homes, we evaluate frozen representations from pretrained ego-video and time-series foundation models, alongside an IMU-based TCN trained from scratch, under leave-one-subject-out evaluation. The IMU-based TCN achieved the strongest event-detection performance, reaching 42.3 F1 and 83.0 AUROC, compared with 32.6 F1 and 77.2 AUROC for V-JEPA2 ego-video features. Although ego-video alone did not outperform IMU-based sensing, it showed above-chance discrimination, and qualitative analyses suggest that egocentric vision may capture FOG-relevant information independent of IMUs. Together, these results support the use of pretrained ego-video representations to add contextual information to wearable-sensor-based clinical motion understanding in daily living.

0.20

Practical flow state detection: Entropy-based EEG classification from portable EEG headbands

eess.SP ·2026-09-17 ·Matin Beiramvand, Reijo Koivula, Tarmo Lipping
published similarity 0.56
Abstract

Flow state, characterized by deep engagement and immersion during challenging activities, represents a valuable mental state with significant implications for learning, performance, and rehabilitation outcomes. While flow has been extensively studied behaviorally, objective neurophysiological detection methods suitable for real-world deployment remain limited. Electroencephalography (EEG) offers a promising avenue for flow detection due to its accessibility, portability, and superior temporal resolution; however, the utility of consumer-grade EEG devices for robust, and subject independent flow classification has been insufficiently explored. This study validates entropy-based biomarkers for flow state detection using two wearable EEG headsets, Muse-S and Emotiv Insight, across 45 participants performing adaptive Tetris gameplay. After denoising, we applied the Discrete Wavelet Transform (DWT) to decompose the signals into multiple frequency sub-bands. From each sub-band, entropy-based features, combining channel-wise measures (Slope Entropy, Distribution Entropy, Spectral Entropy) with cross-channel descriptors (Cross Distribution Entropy, Cross Spectral Entropy) were extracted. These features were then used as input to a Random Forest classifier (RF), evaluated with two validation schemes: Random Sampling (RS) and Leave-One-Subject-Out (LOSO). Under random sampling cross-validation, Random Forest classifiers achieved 97% mean accuracy; under the more rigorous leave-one-subject-out (LOSO) scheme, average accuracy reached 75%, demonstrating genuine cross-subject generalizability. Comprehensive multi-classifier validation (SVM-RBF, GentleBoost, k-NN, Fitted Discriminant, Naive Bayes) confirmed that entropy biomarkers are robust across diverse modeling frameworks.

0.28

Lightweight Time-Frequency Vibration Sensing for Consumer Device Condition Monitoring

eess.SP cs.LG ·2026-10-09 ·Po-Heng Chou, Jen-Yu Chiu, Chun-Yu Yeh, Wei-Lung Mao, Walid Saad
benchmark similarity 0.55
Abstract · 6 pages, 3 figures, and 4 tables. Submitted to the 2027 IEEE International Conference on Consumer Electronics (ICCE 2027)

Consumer rotating devices, including washing machines, air conditioners, electric fans, robotic vacuum cleaners, and home fitness equipment, increasingly rely on vibration sensing for intelligent condition monitoring and predictive maintenance. Ensuring reliable operation in these resource-constrained appliances requires efficient, lightweight artificial intelligence (AI) solutions capable of processing non-stationary signals under real-world operational interference. This paper proposes a lightweight AI-assisted vibration sensing framework that employs continuous wavelet transform (CWT) and Hilbert-Huang transform (HHT) to convert one-dimensional (1-D) vibration time-series signals into two-dimensional (2-D) time-frequency representations. These representations are subsequently analyzed using lightweight deep learning architectures, specifically MobileNetV3-Small, ConvNeXt-Tiny, and the You Only Look Once version 11 classification model (YOLOv11-cls). Public bearing benchmark datasets, including Case Western Reserve University (CWRU), Paderborn University (PU), and Intelligent Maintenance Systems (IMS), are utilized as representative rotating components to investigate model generalization. The proposed framework is designed with eventual embedded deployment in consumer electronics in mind. Experimental results demonstrate that CWT combined with YOLOv11-cls achieves high diagnostic accuracy, while MobileNetV3-Small provides an attractive low-latency alternative for computationally constrained edge platforms. Conventional random splitting is also compared with dataset-specific structured isolation. The results highlight the importance of avoiding data leakage and quantify tradeoffs in classification accuracy, parameter count, floating-point operations (FLOPs), model footprint, preprocessing cost, and central processing unit (CPU) inference latency.

0.23

W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition

cs.LG ·2026-10-14 ·Yogesh Prabhu, Loki Natarajan, Jingjing Zou
similarity 0.54
Abstract · 11 pages, 4 figures

A major challenge in wearable device activity recognition is the heterogeneity across datasets in sensor placement, channel count, sampling rate and subjects. Moreover, the motion patterns that distinguish activities often appear as subtle, scale-specific variations within otherwise similar waveforms. As a result, raw signals are often ambiguous, and models trained on them tend to rely on cues specific to a particular sensor setup or participant, which limits both cross-dataset transfer and generalization to unseen participants. Addressing this requires representations that preserve such activity-relevant, scale-specific variation. We introduce W-JEPA, a self-supervised framework that exploits the multiscale structure of inertial motion and leverages a joint-embedding predictive architecture, by organizing windows into a fixed grid of wavelet tokens indexed by scale, sensor axis, and time. These wavelet tokens help expose activity-specific detail within broadly similar raw signals, and serve as the units of masked latent prediction. W-JEPA predicts masked token representations supplied by an exponential-moving-average (EMA) target encoder. Because recovering a masked token requires relating motion at one scale and axis to motion at other scales and axes, the model learns the cross-scale, cross-axis structure of human movement. Across six wearable activity benchmarks, W-JEPA outperforms state-of-the-art methods under random-window splits and remains the strongest when subjects are held out, improving average macro-F1 by 8.7 percentage points over the strongest published baseline. These results indicate that physically grounded multiscale tokenization, combined together with latent predictive learning, provides a promising foundation for transferable representations of heterogeneous wearable inertial data.

0.16

Deep Multimodal Wearable Sensor Fusion for Detection of Body-Focused Repetitive Behaviors

cs.LG ·2026-08-10 ·Samaneh Rezaeimanesh, Mohsen Behradfar, Mohammad Fili, Guiping Hu
similarity 0.51
Abstract

Body-focused repetitive behaviors, such as hair pulling and skin picking, are compulsive motor actions commonly associated with obsessive-compulsive and anxiety disorders. Their early, objective detection remains difficult because the movements are subtle and overlap with ordinary, non-pathological gestures. We developed and evaluated a multimodal deep learning framework to detect and classify these behaviors from wrist-worn sensor data. The data, collected by the Child Mind Institute using the Helios wrist-worn device, combine inertial measurement units, thermopile sensors, and time-of-flight sensors, capturing kinematic, thermal, and proximity information. The framework combined a convolutional neural network with a gated recurrent unit, alongside modality-specific autoencoders and a late-fusion classifier, to exploit temporal and spatial dynamics. It achieved an F1 score of 0.985 and an area under the receiver operating characteristic curve of 0.997 for binary detection, distinguishing these behaviors from other activities, and a macro-averaged F1 score of 0.700 with an area under the curve of 0.963 across a nine-class scheme that distinguished each individual behavior from a single grouped Non-Target class, improving over single-modality baselines. Post-hoc interpretability based on Shapley additive explanations showed that the time-of-flight and inertial modalities dominated discriminative power by capturing spatial proximity and dynamic movement, while hierarchical clustering indicated that misclassifications were driven primarily by the anatomical region of the gesture. These findings demonstrate that multimodal sensor fusion enables accurate, objective, and continuous behavioral monitoring. This work establishes a foundation for real-time, wearable-assisted mental health diagnostics and personalized interventions in biomedical research and clinical care.

0.04

Where Does EEG Help Wearable Freezing of Gait Detection?

cs.LG ·2026-10-31 ·Chuntian Chi, Lifang He, Huajie Shao, Gang Zhou
similarity 0.51
Abstract

Freezing of gait (FoG) detectors built on inertial measurement units (IMUs) are accurate while the legs move, but they become unreliable when the legs are nearly still, which is exactly when akinetic freezing, voluntary stopping, and standing must be told apart. Electroencephalography (EEG) captures motor-planning activity that leg sensors cannot, but EEG is impractical for daily use. We ask where EEG helps: as an input at inference time, or only during pretraining, so that the deployed detector still needs only IMUs. We assemble a pretraining corpus of synchronized EEG and IMU recordings (5 datasets, 184 people, 94 hours) and compare six settings that differ only in the modalities used for pretraining and as model input, each with tuned hyperparameters and five independent pretraining runs. On the BXHC FoG dataset (leave-one-patient-out, 10 patients with FoG), adding EEG as input raises FoG F1 from 0.663 to 0.740 (9 of 10 patients improve), and the gain in ranking performance is confined to the quartile of windows with the least leg movement (AUROC +0.063). Pretraining the IMU encoder jointly with EEG improves an IMU-only detector both within the cohort (FoG F1 0.663 to 0.705) and when it is trained on a small cohort and tested on another (FoG F1 +0.083, all 10 test patients improve). Repeating the study with PD-only and healthy-only pretraining corpora, each with its own hyperparameter search, shows that IMU-based detection is robust to the corpus, whereas the benefit of aligning EEG with IMU requires both. Cross-cohort analysis further shows that detectors trained without annotated voluntary stops classify nearly all stops as freezing. Finally, on PD versus non-PD classification in three external datasets, joint EEG+IMU pretraining improves PD detection from walking EEG over EEG-only pretraining (AUROC 0.750 vs. 0.683), while IMU-based detection does not depend on the pretraining.

0.24