CS Paper Radar

Tracking Human Daily Cognitive Activity from EEG and Biometric Data

Alina Gutoreva, Zhaniya Omar

cs.HC ·submitted 2026-10-02 08:06 UTC · v1
published

Abstract

Understanding human cognitive activity in everyday life remains challenging due to the dynamic, context-dependent, and multimodal nature of cognition. Laboratory-based studies often fail to capture real-world cognitive processes, while single-modality approaches provide only partial insight into cognitive states. Advances in wearable sensing now enable the collection of heterogeneous data streams for a more comprehensive view of daily cognition. This paper presents a multimodal framework for tracking human cognitive activity using electroencephalography (EEG), wearable physiological signals, behavioral context, and self-reported measures. A preliminary pilot study was conducted with observational data from three participants (N = 3) over 280 annotated 10-minute intervals spanning nine activity domains across two weeks. Results reveal consistent temporal patterns, including a discernible mid-day decrease in motivation and energy at 13:00, followed by afternoon recovery. Work and IADLs yielded the highest flow state rates (51% and 50%), while ADLs produced the lowest (15%). Motivation correlated strongly with arousal (r = 0.78) and attention (r = 0.74), whereas perceived stress showed a weaker negative relationship (r = -0.33). A linear regression model predicting motivation from arousal, attention, energy, and stress achieved R2 = 0.76 (MAE = 9.84, RMSE = 12.85). Lag-based analysis indicates that prior energy levels positively predict subsequent motivation, confirming temporal dependencies in cognitive dynamics. These findings demonstrate the feasibility of multimodal cognitive activity analysis in real-world environments and highlight the importance of integrating physiological and behavioral indicators. The proposed framework provides a foundation for future large-scale multimodal systems and applied intelligent solutions.

Closest papers

Nearest neighbours by meaning across the whole index.

ErgoAssist: Cognition-Aware Posture Feedback in Wearable Ergonomic Systems

cs.HC ·2026-08-31 ·Sarmistha Sarna Gomasta, Bhawana Chhaglani, VP Nguyen, Prashant Shenoy
similarity 0.68
Abstract

Prolonged digital device use has made poor posture and musculoskeletal discomfort pervasive among knowl- edge workers. Existing ergonomic wearables rely solely on posture thresholds, frequently interrupting users during high-focus moments and leading to alert fatigue and abandonment. Yet posture and cognitive load are closely coupled, and most systems remain cognitively unaware. We present ErgoAssist, a head-worn ergonomic assistant that detects poor posture using IMU-based head tracking and estimates task-induced cognitive load using a consumer-grade EEG headband for continuous everyday use. In a controlled lab study, ErgoAssist achieves 81% posture classification and 90.2% task induced cognitive load estimation accuracy under leave-one-subject-out evaluation. In a preliminary real-time deployment, cognition-aware alerting reduces alert frequency by 81%, improves perceived usability by 43%, task performance by 25%, and improves posture correction rate by 38%, delivering fewer but better-timed interventions rather than merely suppressing alerts.

0.37

WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data

cs.CL ·2026-09-04 ·Ji Soo Lee, Xilun Chen, Pierce Chuang, Ashish Shenoy, Jason Wei +3 more
benchmarkcode/data similarity 0.61
Abstract

Recent advances in wearable sensing enable continuous monitoring of physiological and behavioral signals, yet existing benchmarks rarely evaluate whether AI systems can reason over a real user's longitudinal wearable record. We introduce WearableQA, a benchmark comprising 4,084 10-option multiple-choice questions constructed from the wearable time series, blood biomarkers, and demographics of 200 real users, each with up to 500 days of daily measurements. WearableQA preserves authentic wearable distributions that include device noise and inter-individual variability. To evaluate distinct reasoning capabilities, we introduce 16 question types organized along two complementary axes: data versus health reasoning, which distinguishes computation over longitudinal measurements from physiological interpretation; and single- versus cross-signal reasoning, which separates reasoning about individual signals from the integration of multiple signals. To construct reliable questions at scale, we adopt a dual-grounding framework that combines literature-grounded physiological findings with statistically validated population-grounded physiological patterns. This enables the capture of meaningful relationships observed in real-world wearable data. Evaluation of 14 proprietary and open-source LLMs demonstrates that WearableQA effectively differentiates model capabilities, with performance ranging from 19.6% to 72.9% against a 10% chance baseline. Moreover, WearableQA remains far from solved: most models achieve accuracies below 60%. Overall, WearableQA provides a realistic and diagnostic benchmark for evaluating LLM reasoning over real-world wearable data.

0.18

Practical flow state detection: Entropy-based EEG classification from portable EEG headbands

eess.SP ·2026-09-17 ·Matin Beiramvand, Reijo Koivula, Tarmo Lipping
published similarity 0.59
Abstract

Flow state, characterized by deep engagement and immersion during challenging activities, represents a valuable mental state with significant implications for learning, performance, and rehabilitation outcomes. While flow has been extensively studied behaviorally, objective neurophysiological detection methods suitable for real-world deployment remain limited. Electroencephalography (EEG) offers a promising avenue for flow detection due to its accessibility, portability, and superior temporal resolution; however, the utility of consumer-grade EEG devices for robust, and subject independent flow classification has been insufficiently explored. This study validates entropy-based biomarkers for flow state detection using two wearable EEG headsets, Muse-S and Emotiv Insight, across 45 participants performing adaptive Tetris gameplay. After denoising, we applied the Discrete Wavelet Transform (DWT) to decompose the signals into multiple frequency sub-bands. From each sub-band, entropy-based features, combining channel-wise measures (Slope Entropy, Distribution Entropy, Spectral Entropy) with cross-channel descriptors (Cross Distribution Entropy, Cross Spectral Entropy) were extracted. These features were then used as input to a Random Forest classifier (RF), evaluated with two validation schemes: Random Sampling (RS) and Leave-One-Subject-Out (LOSO). Under random sampling cross-validation, Random Forest classifiers achieved 97% mean accuracy; under the more rigorous leave-one-subject-out (LOSO) scheme, average accuracy reached 75%, demonstrating genuine cross-subject generalizability. Comprehensive multi-classifier validation (SVM-RBF, GentleBoost, k-NN, Fitted Discriminant, Naive Bayes) confirmed that entropy biomarkers are robust across diverse modeling frameworks.

0.28

BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker

cs.AI cs.IR ·2026-09-03 ·Seyed Mahmoud Sajjadi Mohammadabadi
benchmark similarity 0.59
Abstract

Cardiac, neural, behavioral, and speech measurements from wearable and mobile devices provide partial, noise-sensitive views of physiological state. BioSync combines these measurements into the \textbf{BioSync Index (BSI)}, a continuous composite digital biomarker defined under the BEST framework. The model applies multi-head self-attention to modality tokens and adds a linear branch whose hypothesis class includes standard feature concatenation. This architecture is motivated by latent-variable measurement theory and by the possibility that joint observations contain information unavailable from individual modalities. We evaluated BioSync on two literature-informed synthetic cohorts: a four-modality cognitive-decline cohort using HRV, EEG, actigraphy, and speech, and a metabolic-autonomic cohort structured around the public AI-READI wearable schema. In the cognitive cohort, BioSync and concatenation obtained AUCs of 0.928 and 0.926, respectively. In the metabolic cohort, BioSync obtained accuracy/F1 of 0.764/0.766, compared with 0.756/0.758 for concatenation. The BSI correlated with latent severity in both cohorts ($r=0.91$ and $r=0.68$). A pure-attention ablation obtained cognitive-cohort AUC 0.911, locating the increase to 0.928 in the combined wide-and-deep architecture. With matched modality-dropout training, BioSync led concatenation at five of six cognitive-cohort corruption rates and at the highest metabolic-cohort rate. Its cognitive-cohort AUC was also higher than five published digital-biomarker reference values, although differences in datasets and tasks preclude a controlled benchmark claim. Comparison with single-modality, early-fusion, and late-fusion designs across six prespecified criteria identifies the model's computational properties; validation on real cohorts remains necessary.

0.17

BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing

cs.CL ·2026-08-27 ·Yu Yvonne Wu, Arvind Pillai, Yuliang Chen, Yuwei Zhang, Sudarshan Regmi +5 more
top venuebenchmark similarity 0.58
Abstract · Accepted to EMNLP 2026 Main Conference

Mental health assessment relies on episodic self-report scales, which convert subjective states such as stress into numerical scores but provide only sparse snapshots of wellbeing. Wearable devices offer longitudinal behavioral and physiological signals for continuous, low-burden monitoring. Recent LLM-driven personal-health agents enable natural language queries over wearable signals, but mainly handle short-term, retrieval-based lookups (e.g., highest step count over a week). They do not evaluate whether agents can reason over long-term signals to predict wellbeing scores paired with evidence-grounded rationales. To address this gap, we introduce BALMS, the first systematic benchmark of LLM-based agentic systems for longitudinal mental health sensing. BALMS spans 3 real-world longitudinal datasets, 2 task families (closed-form wellbeing-score prediction and rationale generation auto-graded by an LLM-as-Judge), 3 agentic paradigms evaluated across 5 open- and closed-source LLM backbones. We find that zero-shot agents rarely outperform a simple mean baseline, except with stronger backbones or compact, semantically meaningful features. Chain-of-thought prompting improves reasoning-oriented backbones, but does not guarantee temporal grounding or numerical correctness. Together with more analysis on efficiency and temporal scaling, BALMS highlights the need for longitudinal mental health agents that selectively retrieve history, ground temporal evidence, and reason over interpretable behavioral features.

0.31

E3Sense: Head-Confined Multimodal Sensing of Learner Engagement

cs.HC ·2026-09-22 ·Sidharth Anupkrishnan, Itir Sayar, Jeongah Lee, Sri Harsha Musunuri, Guan-Ming Su +3 more
similarity 0.58
Abstract

Engagement-aware learning systems could provide hints or adjust pacing when learners struggle. Prior engagement sensing work distributes sensors across or outside the body rather than consolidating them at one site, or reduces engagement to shared affect or a single dimension (from behavioral, emotional, and cognitive engagement). We introduce E3Sense, a head-worn platform that co-locates electroencephalography, eye tracking, and electrodermal activity to personalize engagement measurement. During a lab study we collected 450 ratings of engagement levels on a five-level ordinal scale while participants watched educational videos. For fifteen held-out participants, E3Sense achieved a within-one-level prediction score of 75.0%, compared with 63.0% for always predicting the most common rating. In an exploratory analysis of 18 participants from the same study who defined engagement, conditioning on learners' definitions raised the same measure by 6.9 points, from 64.6% to 71.5%. Our work provides a proof-of-concept of a head-site, personalized multimodal sensing of engagement for adaptive educational interfaces.

0.21

Preference vs. Performance: EEG-Based Classification of Learner Engagement in Multimodal Instruction

cs.HC cs.CY ·2026-10-04 ·Sri Jahnavi Adusumilli, Deepak Giri, Pallavi Vaswani, Pallavi Singh, Megha Moncy +2 more
published similarity 0.57
Abstract · Presented at The 26th IEEE International Conference on Advanced Learning Technologies (ICALT) 2026, July 6-9, 2026 at Hung Yen, Vietnam

Effective adaptive instructional systems require robust measures of learner engagement that go beyond static user profiles. This study employs Multimodal Learning Analytics (MMLA) to investigate the relationship between self-reported instructional modality preferences and objective neurophysiological markers of engagement. Thirty-seven participants engaged with learning content delivered via varying modalities (visual, auditory, reading/writing, kinesthetic). We captured real-time neural activity using two EEG devices: the Emotiv EpocX (14 channels, 128 Hz) and OpenBCI (16 channels, 125 Hz). Preferences were assessed using the VARK questionnaire. Consistent with literature challenging the "meshing hypothesis," aligning instructional modality with stated preferences did not significantly predict performance gains. However, spectral analysis of EEG data revealed divergent engagement patterns: when content aligned with preferences, distinct neural activity patterns emerged in theta and alpha frequency bands-markers associated with attention and cognitive processing. These signals were used to train a binary logistic regression classifier, achieving a mean accuracy of 83.21% with OpenBCI and 56.27% with Emotiv EpocX. These findings suggest that while self-reported preferences may not dictate learning outcomes, they significantly influence neurophysiological engagement, offering a viable, non-invasive input for adaptive educational algorithms.

0.30

MAGE: Towards Generalizable Multi-timescale EEG Representations

cs.LG ·2026-09-25 ·Tuan-Kiet Doan, Van-Chien Nguyen, Trung-Hieu Tran, Quang-Hung Pham, Ngoc-Son Vu +5 more
similarity 0.57
Abstract

Electroencephalography (EEG) data plays an important role in understanding human brain activity, with various major applications. While current approaches, which largely build on EEG foundation models, have demonstrated strong performance across datasets and tasks, they typically rely on a fixed temporal scale. This design choice limits their ability to capture characteristics of neural dynamic behavior, often spanning across multiple timescales, which are naturally captured in EEG recordings. To address this limitation, we propose MAGE (\textbf{Multi-timescale Adaptive Generalization for EEG}), a foundation model that dynamically adapts to capture and integrate information across different timescales. Specifically, MAGE combines two key mechanisms: (i) a novel multi-timescale attention mechanism, capable of learning representations across multiple temporal scales and (ii) a trainable aggregation module, that dynamically identifies and adapts to the most informative timescale of the input signal. Experimental results across seven datasets demonstrate that MAGE consistently outperforms existing EEG foundation models while using substantially fewer parameters. Moreover, our results support the hypothesis that different downstream tasks benefit from distinct temporal scales. All source code will be released.

0.33