CS Paper Radar

Multisensor Measurement of Train Driver Mental Fatigue: From Simulation to Reality

Esther Bosch, Rebecca Kruschka, David Schackmann, Stephanie Hoyer, Wolfgang Kilian, Stefan Schwanitz, Anneke Hamann

cs.HC ·submitted 2026-08-24 15:11 UTC · v1

Abstract

Increasing automation in rail transport shifts the train driver's role from active control to prolonged supervisory monitoring. This creates conditions for mental fatigue (MF) and reduced vigilance. Despite the safety relevance of this issue, evidence on the feasibility and robustness of physiological indicators of MF under operational rail conditions remains limited. Most prior work relies on simulators or lab studies. The present study investigated multiple subjective, physiological, and behavioral indicators of MF in professional train drivers across two complementary settings: a high-fidelity train simulator (n=14) and a real-world rail environment (n=6). To our knowledge, this is the first study to deploy a full multisensor battery under actual train operating conditions. In both settings, a standardized protocol was used comprising a baseline drive, a one-hour auditory n-back task as an MF induction procedure, and a second drive. Heart rate variability and breathing rate showed consistent and theoretically expected changes across both environments, suggesting reduced physiological arousal following the fatigue induction task. In contrast, EEG-based frontal theta power and parietal alpha and beta power, electrodermal activity, blink duration, and behavioral indicators did not show clear mental fatigue-related patterns. Real-world data collection revealed substantial technical challenges related to vibration, sensor connectivity, and concurrent high-frequency data acquisition. These findings suggest that autonomic indicators, particularly HRV and breathing rate, represent the most promising and ecologically robust measures for operational fatigue monitoring in train drivers. However, neurophysiological measures require further validation under realistic conditions before deployment in driver monitoring systems, and larger samples are needed to confirm these preliminary patterns.

Closest papers

Nearest neighbours by meaning across the whole index.

MultiMental-IAS: A Multimodal Driver Mental State Analysis Dataset for Context-Aware Non-IID Evaluation

cs.HC cs.AI ·2026-11-02 ·Baran Can Gül, Nagendra Pal Singh, Anjana Arvind Naik
benchmark similarity 0.57
Abstract

Robust driver-state modelling requires synchronized physiological, behavioural, and contextual signals, yet existing open resources typically target a single cognitive state, omit continuous vehicle context, or do not define evaluation protocols that expose inter-subject heterogeneity. We present Multimental-IAS, a multimodal driver mental-state dataset collected in a cockpit-in-the-loop simulation built on CARLA. It contains vehicle telemetry with scenario-context channels, four-channel EEG and three-channel PPG from a Muse 2 headband, and cabin-facing video from 23 participants, recorded in 148 trials (11.6 hours) under six induced states: Normal, Distracted, Alerted, Stressed, Relaxed, and Drowsy. We document the acquisition pipeline in detail and provide a benchmark with one protocol for all models: chronological within-subject splits, participant-disjoint cross-subject folds, validation-based model selection, and ablations over modalities, scenario-context channels, and signal normalization. Multimodal fusion reaches a macro-F1 of 0.94 for drivers seen during training. For unseen drivers, fusing driving dynamics with per-window normalized EEG/PPG raises macro-F1 from 0.408 (telemetry alone) to 0.485, consistently across all five folds, while the gap between the two protocols quantifies the inter-driver heterogeneity that personalized models must address. Multimental-IAS thus provides a concrete testbed for non-IID generalization, personalization, and federated learning in driver monitoring.

0.16

ErgoAssist: Cognition-Aware Posture Feedback in Wearable Ergonomic Systems

cs.HC ·2026-08-31 ·Sarmistha Sarna Gomasta, Bhawana Chhaglani, VP Nguyen, Prashant Shenoy
similarity 0.53
Abstract

Prolonged digital device use has made poor posture and musculoskeletal discomfort pervasive among knowl- edge workers. Existing ergonomic wearables rely solely on posture thresholds, frequently interrupting users during high-focus moments and leading to alert fatigue and abandonment. Yet posture and cognitive load are closely coupled, and most systems remain cognitively unaware. We present ErgoAssist, a head-worn ergonomic assistant that detects poor posture using IMU-based head tracking and estimates task-induced cognitive load using a consumer-grade EEG headband for continuous everyday use. In a controlled lab study, ErgoAssist achieves 81% posture classification and 90.2% task induced cognitive load estimation accuracy under leave-one-subject-out evaluation. In a preliminary real-time deployment, cognition-aware alerting reduces alert frequency by 81%, improves perceived usability by 43%, task performance by 25%, and improves posture correction rate by 38%, delivering fewer but better-timed interventions rather than merely suppressing alerts.

0.37

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

cs.CV cs.AI ·2026-10-05 ·Olivia Nocentini, Marta Lagomarsino, Gokhan Solak, Younggeol Cho, Qiyi Tong +4 more
similarity 0.52
Abstract

Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness checks. This study presents a vision-based monitoring system that relies solely on a single front-facing RGB camera and a graph neural network to classify simulated train-driver states into alert, not-alert, and an emergency class comprising acted emergency-like behaviours. To optimize input representations for the model, an ablation study was performed, comparing three feature configurations: skeletal-only, facial-only, and a combination of both. Experimental results show that combining facial and skeletal features yields the highest accuracy (81%) for the three-class model under the light condition, outperforming models that use only facial or skeletal features. Furthermore, the combination of facial and skeletal features achieves 99% accuracy in the alert/not alert classification in light condition. Additionally, we introduced a controlled RGB video dataset containing alert, not alert, and acted emergency-like behaviours recorded under three illumination conditions. These contributions represent a step toward passive and non-contact train-driver state recognition based on facial and upper-body dynamics.

0.22

New perspectives for the fitness fatigue model: how to revisit questions about the science of sports training from the perspective of systems control theory

eess.SY ·2026-09-22 ·Jacky Montmain, Pierre Couturier, Gérard Dray
similarity 0.52
Abstract

The Fitness-Fatigue model (FFM) was initially designed to gain a better physiological understanding of the impact of training loads on sports performance. For almost 50 years, simulations have been compared with the observed response of sports performance to training loads. Understanding the relationship between training load and performance should have answered some fundamental questions for the physical trainer or sports coach: 1/ how to define the best training to achieve a performance without exhausting an athlete or how to achieve a performance in a limited time; 2/ how to assess the athlete's fatigue and fitness reliably to better understand his performance; 3/ how to prevent the risk of injury. But this was not the case. Studies dedicated to the FFM have been limited to improving somewhat on Banister's initial model without really taking the necessary step back to take advantage of the mathematical framework offered by the state representation, the implicit formalism underlying the FFM. The idea behind this research strategy is that having a valid and accurate model makes it easy to address previous questions through simulation: multiple training scenarios can be simulated until the ideal scenario for a given training question is identified. The main drawback to this approach is the combinatorial nature of the exercise. This paper is not discussing the relevance of the model, but how to use it. The state representation makes it possible to study the controllability, observability and diagnosability of a system (i.e, the athlete) and thus to formally answer the three previous practical questions. It can be considered that sports science studies have missed the richness of the FFM model. Artificial learning approaches are increasingly preferred to the FFM model because they are supposed to better capture observation. However, in the light of the state representation, the FFM model could still be extended naturally while remaining mathematically interpretable, offering mathematical tools to estimate the state of the athlete, and to define the most adequate training and prevent the risk of injury. This article does not aim to solve the question of optimal training in practice, for that it would need to be validated by specialists in physiology and sports science, it just proposes to take a fresh look at training issues and to demystify the mathematical formalism adopted by Banister.

0.24

A Mechanomyography-Based Integrated Sensing-Stimulation System for Fatigue-Aware Neuromuscular Therapy

cs.HC ·2026-10-11 ·Xiao Jin, Cong Liu, Zhenhua Yu
similarity 0.52
Abstract · 12 pages, 14 figures

Muscle fatigue limits the effectiveness of functional electrical stimulation (FES), yet fatigue monitoring during active stimulation remains challenging because electromyography (EMG) is severely contaminated by stimulation artifacts. To address this issue, this study proposes an integrated mechanomyography-based sensing framework (MMG-FES) for artifact-resistant fatigue monitoring during stimulation. Fatigue states were first characterized during voluntary movement using established EMG spectral indicators, including median frequency (MF) and mean power frequency (MPF), and then linked to MMG-derived features, including high-frequency energy ratio (HFER) and spectral bandwidth (BW), for fatigue recognition under stimulation conditions. Experimental results showed consistent fatigue-related trends, with EMG spectral features decreasing and MMG features exhibiting coordinated spectral redistribution across repeated contractions. Using these features, the proposed framework achieved fatigue-state recognition accuracies of 0.93 and 0.96 with logistic regression and random forest, respectively. These findings support MMG as a physiologically meaningful and stimulation-compatible modality for fatigue-aware closed-loop neuromuscular stimulation.

0.42

The Effects of Air-Conditioning and Road-Traffic Noise on Perceived, Cognitive, and EEG Responses in a University Classroom

cs.HC ·2026-10-02 ·Yuanzhi Su, Cynthia Hou
similarity 0.51
Abstract · 28 pages,14 figures

Air-conditioning and road-traffic noise are common in classrooms, and their effects are often judged by cognitive performance. However, a sound that leaves performance unchanged may still be perceived differently or alter brain activity. In a within-participant design, this study tested whether perceived, cognitive, and EEG responses are consistent, and whether perceived and EEG responses distinguish conditions that performance does not. Sixteen students completed cognitive tasks in a university classroom under air-conditioning and road-traffic noise, each played back at 55, 60, and 65 dBA. Participants rated acoustic appraisal and perceived workload after each condition, and EEG was recorded during the tasks. The results show that cognitive performance did not differ significantly between conditions in any task. By contrast, noise was rated louder, less pleasant, and more arousing than a no-noise control, and all three ratings varied with sound level; perceived workload was also higher under noise. Task-period EEG power also showed significant differences between sources or levels in specific tasks and scalp regions. Within participants, relative EEG band power covaried mainly with loudness and pleasantness; louder and less pleasant ratings coincided with higher relative theta and lower relative gamma power. Associations with arousal and performance were rare, and none were found for workload. The three response types were thus only partly consistent, and perceived responses and EEG distinguished conditions that performance did not. Non-significant performance differences do not mean the conditions were equivalent for students. Assessments of air-conditioning and road-traffic noise in classrooms should therefore consider perceived responses alongside cognitive performance, with EEG providing complementary information on neural activity during tasks.

0.32

Tracking Human Daily Cognitive Activity from EEG and Biometric Data

cs.HC ·2026-10-02 ·Alina Gutoreva, Zhaniya Omar
published similarity 0.50
Abstract

Understanding human cognitive activity in everyday life remains challenging due to the dynamic, context-dependent, and multimodal nature of cognition. Laboratory-based studies often fail to capture real-world cognitive processes, while single-modality approaches provide only partial insight into cognitive states. Advances in wearable sensing now enable the collection of heterogeneous data streams for a more comprehensive view of daily cognition. This paper presents a multimodal framework for tracking human cognitive activity using electroencephalography (EEG), wearable physiological signals, behavioral context, and self-reported measures. A preliminary pilot study was conducted with observational data from three participants (N = 3) over 280 annotated 10-minute intervals spanning nine activity domains across two weeks. Results reveal consistent temporal patterns, including a discernible mid-day decrease in motivation and energy at 13:00, followed by afternoon recovery. Work and IADLs yielded the highest flow state rates (51% and 50%), while ADLs produced the lowest (15%). Motivation correlated strongly with arousal (r = 0.78) and attention (r = 0.74), whereas perceived stress showed a weaker negative relationship (r = -0.33). A linear regression model predicting motivation from arousal, attention, energy, and stress achieved R2 = 0.76 (MAE = 9.84, RMSE = 12.85). Lag-based analysis indicates that prior energy levels positively predict subsequent motivation, confirming temporal dependencies in cognitive dynamics. These findings demonstrate the feasibility of multimodal cognitive activity analysis in real-world environments and highlight the importance of integrating physiological and behavioral indicators. The proposed framework provides a foundation for future large-scale multimodal systems and applied intelligent solutions.

0.22

Slide to Report: Continuous Reporting Symptom-Specific Cybersickness in VR

cs.HC ·2026-11-05 ·Purnata Saha, Rifatul Islam, Qiliang He, John Quarles
similarity 0.48
Abstract

Cybersickness is often assessed during VR exposure through discrete overall sickness, which cannot capture specific symptoms or their changes over time. Post-exposure questionnaires such as the Simulator Sickness Questionnaire provide symptom-specific measures but cannot be collected during immersion. We investigate whether separating cybersickness into three symptom-specific dimensions -- nausea, oculomotor discomfort, and disorientation -- during immersion provides more informative continuous measurements. We conducted a between-subjects study with 52 participants in a VR-rollercoaster, comparing a three-slider interface with a single-slider interface. Concurrently, participants also completed an auditory Simon task to measure attention. We additionally collected multimodal set of physiological signals, including GSR, ECG, PPG, eye and head tracking. Results show that each slider correlated most strongly with its corresponding SSQ subscale, whereas the single slider correlated with all SSQ subscales. Using three sliders did not significantly affect usability, workload, or attention. We publicly release the multimodal dataset to support future cybersickness research.

0.20