CS Paper Radar

Calmables: Demonstrating Closed-Loop Infrared Earables for Thermal Biofeedback and Relaxation Support

Valeria Zitz, Michael Küttner, Jonas Hummel, Taku Inoue, Tobias Rödiger, Michael Beigl

cs.HC ·submitted 2026-09-16 14:26 UTC · v1
published

Abstract

We present Calmables, a walk-up demo of a closed-loop infrared earable that uses smart-ring heart rate to create subtle, ear-localized warming cues. Building on work on thermal comfort and in-ear infrared stimulation, Calmables explores warmth at the ear as a biosignal-adaptive cue for brief recovery moments following acute activation. A smartphone first establishes an individual resting baseline and derives a personalized heart-rate threshold, while the earable controller independently enforces an over-temperature cut-off and communication fail-safes. During the guided demo flow, attendees complete a brief rapid-breathing activation phase until their heart rate reaches the personalized threshold. This triggers an ear-localized warming cue followed by a short relaxation phase, while physiological changes are displayed on a live dashboard. Attendees can also manually explore different infrared stimulation intensities. To contextualize the demo, we report preliminary placebo-controlled UX ratings from 18 participants: participants rated the active prototype higher on perceived relaxation and perceived recovery support than an identical-looking placebo. Together, the demo illustrates how infrared earables can make physiological feedback tangible through subtle, biosignal-adaptive thermal cues.

DOI
10.1145/3798063.3837278

Closest papers

Nearest neighbours by meaning across the whole index.

EarStreAM: A Closed-Loop Earable System for Personalized Stress-Adaptive Meditation

cs.HC ·2026-09-16 ·Jonas Hummel, Luisa Faust, Elias Müller, Eva Bertog, Valeria Zitz +5 more
similarity 0.67
Abstract

We present EarStreAM, a closed-loop earable system for stress-adaptive meditation that integrates in-ear physiological sensing with personalized, real-time intervention. Leveraging OpenEarable 2.0's multimodal sensing, EarStreAM continuously monitors physiological signals and detects elevated stress from heart rate and heart rate variability. Upon detection, the system initiates a personalized guided meditation generated by an LLM and adapted in real time to the user's stress state. The demo offers a hands-on experience of stress-adaptive meditation in two modes: a biosignal-adaptive meditation with optional stress induction to illustrate closed-loop adaptation, and a meditation-only mode focusing on EarStreAM's generative personalization capabilities. The demo highlights how in-ear sensing, closed-loop adaptation, and personalized generative meditation can be integrated into an earable system for real-time stress support in demanding office work contexts.

0.52

Tracking Is Not Sensing: Artifact-Aware Thermal Video Respiration Estimation in Head-Free Marmosets

cs.CV ·2026-10-24 ·Penghao Wang, Sen Yang, Fenghua Xie, He Wang, Xindong Song
published similarity 0.63
Abstract · WACV 2027

Continuous physiological monitoring is essential for linking behavior, internal state, and neural activity in neuroscience and translational research. In common marmosets, a key nonhuman primate model for social neuroscience, respiratory rate provides a basic readout of arousal, stress, and physiological regulation. Contact sensors can provide accurate measurements, but they add preparation burden and may interfere with head-free behavioral protocols. Thermal video offers a noncontact alternative by capturing breathing-related temperature changes around the nose and mouth. However, in head-free marmosets, these cues are weak, localized, and easily corrupted by head motion, pose changes, and fur. Here we show that this setting exposes a broader challenge in video-based physiological sensing: visually reliable tracking does not necessarily imply physiologically valid measurement. Using synchronized thermal video and contact respiration recordings, we show that marmoset respiration is recoverable from thermal video but strongly ROI-sensitive. Under head-free motion, visually plausible nasal tracking can still produce traces inconsistent with contact respiration, demonstrating that tracking is not sensing. We therefore estimate respiratory rate from learned temporal signals extracted from thermal clips and introduce Selective Temporal Attenuation Regularization (STAR). STAR selectively attenuates high-motion thermal discontinuities through local temporal imputation during training, regularizing models toward respiration-consistent dynamics while leaving inference unchanged on raw video. Across multiple deep-learning backbones, STAR improves head-free estimation, reaching 2.23 bpm MAE compared with 20.76 bpm for tracked ROI analysis.

0.29

TherMosaic: Accelerating Perceived Thermal Transitions Through Spatiotemporal Thermal Feedback

cs.HC ·2026-09-04 ·Zining Zhang, Jiasheng Li, Myungin Lee, Zeyu Yan, Jin Ryong Kim +1 more
top venuehighly cited similarity 0.60
Abstract

Thermal feedback can enrich immersive interaction, but thermoelectric devices often change temperature too slowly to match interactive timing. We present TherMosaic, a spatiotemporal thermal feedback approach that accelerates perceived temperature transitions by leveraging two perceptual mechanisms: spatial summation and thermal adaptation. Focusing on the fingertip, we first investigate this approach using a custom 2*2 array of independently controlled Peltier modules. Across three controlled perceptual studies, we show that distributed thermal stimulation can preserve stable hot and cold percepts despite local deviations, that adaptation helps maintain these percepts during changing stimulation, and that combining these effects reduces perceived transition time by about 30%-40% for transitions originating from hot or cold states. We then translate the same design principles into a standalone wearable implementation of TherMosaic and evaluate it in virtual reality. Our results show that this approach reduces perceived thermal lag and improves temporal alignment between thermal and visual events in interactive use.

0.69

Finger-to-Ear ECG: Systematic Evaluation of an Earbud-Based Cardiac Monitoring Approach

cs.HC ·2026-09-21 ·Philipp Lepold, Paula Breitling, Jonas Hummel, Tobias Röddiger, Michael Beigl
published similarity 0.57
Abstract

Ear-ECG enables unobtrusive cardiac monitoring, but existing approaches often struggle with low signal amplitudes and limited morphology preservation. We evaluate a finger-to-ear ECG paradigm that combines an in-ear electrode with a rear housing finger-contact electrode in a speaker-equipped earbud. A study with 30 participants investigated four finger-to-ear electrode geometries against chest-reference ECG and additionally assessed robustness under music playback, talking, and walking disturbances. Left-finger configurations achieved R peak detection F1-scores >99% with high agreement of key ECG morphology features. In contrast, right finger configurations as well as walking led to severe signal degradation. The results reveal a trade-off: while cross-body setups provided the highest signal fidelity, users preferred same-side contacts for comfort reasons. This establishes finger-to-ear ECG as a robust, morphology-aware paradigm for opportunistic sensing in earables.

0.38

Comparative Analysis of State-of-the-Art Foundation Models for Sleep Analysis Under Channel Reduction

eess.SP cs.LG ·2026-08-14 ·Hassan Mehdi, Riku Klen, Ayse Kosal Bulbul, Suzanne Timmons, Abdulhamit Subasi +3 more
similarity 0.54
Abstract

Automatic sleep staging from polysomnography (PSG) is a well-studied task, but PSG itself is expensive, clinic-based, and burdensome to manually score, which limits its use for long-term or at-home monitoring. Most existing sleep-staging foundation models are evaluated using the full PSG montage. We instead ask how much of that montage is actually necessary. We evaluate six sleep staging models on the Multi-Ethnic Study of Atherosclerosis (MESA) PSG dataset across three signal conditions: electroencephalography (EEG), electrocardiography (ECG), and their combination (EEG+ECG). This is motivated by edge-cloud deployment, where EEG requires a clinic-grade scalp electrode, whereas ECG is already captured by consumer wearables. We test state-of-the-art foundation models such as SleepFM with an encoder trained from scratch on MESA, alongside BIOT, MOMENT, LaBraM, a base-scale Vision Transformer (ViT-B) reimplementation of SensorLM trained from scratch, and YASA, spanning EEG-pretrained, general-time-series, from-scratch, and classical non-learned approaches. No model architecture is modified from its original form; SensorLM's encoder is reimplemented only in PyTorch. For EEG-only staging, BIOT achieves the best result with a macro~F1 of 0.7237, followed by LaBraM (0.6835) and SleepFM from scratch (0.6582). Across the five models capable of ECG-only staging, switching from EEG to ECG costs between 0.2798 (MOMENT) and 0.4151 (BIOT) macro~F1, averaging 0.3531, while cutting the raw channel data rate to a third. Adding ECG to EEG provides no gain for most models. These results show that EEG carries most of the sleep-staging signal, quantify the consistent accuracy cost of the wearable-compatible alternative, and demonstrate that sleep-relevant pretraining transfers well to MESA.

0.04

Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Staging

cs.CV cs.AI ·2026-09-03 ·Kunmin Jang, You Rim Choi, Hun Heo, Heonjun Lee, Suahn Bae +3 more
similarity 0.54
Abstract

Near-infrared (NIR) video is a promising modality for contactless sleep monitoring, but recent video-based sleep staging methods often use it as a route to reconstructed respiratory/cardiac proxies or cross-modal physiological representations. We study video-only sleep staging under labels defined by polysomnography (PSG), where the model infers sleep stages from NIR video alone without explicit physiological proxy reconstruction or auxiliary physiological signal supervision. This tests whether NIR video itself can provide informative sleep-stage evidence, rather than only serving as an input for recovering physiological proxies. We propose ViNUSS (Video-Native Unmediated Sleep Staging), a framework that combines subject-relative micro-motion learning with full-night sleep dynamics modeling. Spatially anchored pre-spatial micro-motion encoding preserves localized temporal variation together with its spatial context. Within-subject stage contrast learns stage cues with respect to each subject's night-specific baseline. Two-scale sleep dynamics modeling captures within-epoch motion evolution and organizes epoch-level evidence into a coherent full-night sleep-stage trajectory. On 475 overnight NIR recordings (~3,250 hours), ViNUSS achieves 0.80 accuracy and 0.78 macro-F1 for four-class sleep staging. Interpretability analysis suggests attention to thoraco-abdominal periodic motion and gross body movements associated with arousals and position changes. These results support NIR video as an independently informative and complementary modality for PSG-defined sleep-stage estimation

0.19

Sensed but Not Told: Hidden Physiological Adaptation Shapes LLM Persuasion

cs.HC ·2026-11-06 ·Xiaoyan Wei, Yutong Qu, Yutong Li, Haiyi Li, Wei Emma Zhang +1 more
similarity 0.54
Abstract · 15 pages, 5 figures

Wearable sensors, including those embedded in VR headsets, can provide LLM-based chatbots with physiological signals that users do not explicitly communicate. We tested whether such hidden input changes persuasion. In a $2\times2$ within-subjects study ($N=24$), a chatbot argued against participants' self-selected opinions with or without turn-level heart-rate and pupil-diameter features; sensing was disclosed halfway through the study. Before disclosure, sensing increased perceived persuasiveness by 1.42 points. Across the study, sensing was associated with a 0.57-point greater shift toward the chatbot's position and 3.20 times the odds of any movement toward it. Persuasiveness ratings were lower after disclosure, although disclosure was confounded with session order. Dialogue logs suggested a more declarative interaction style when sensing was on: chatbot replies contained question marks less often, and conversations contained fewer turns. These findings motivate making biosignal-driven adaptation inspectable and providing a genuinely non-sensed mode.

0.30

Cross-Dataset Transfer and Reliability of Explainable Artificial Intelligence for RhythmFormer Remote Photoplethysmography

cs.CV cs.AIeess.IV ·2026-09-03 ·Louis Chen, Torbjörn E. M. Nordling
similarity 0.54
Abstract · 92 pages, 38 figures, incl. supplementary

Background. Remote photoplethysmography estimates the cardiovascular pulse from facial video, and its explanations have rested on inspecting heatmaps rather than on quantitative evidence about where a model reads it. We quantified the explanations and asked whether such explanations transfer between datasets and track model performance. Method. We trained eight condition-specific RhythmFormer models on NCKU-rPPG, recorded under three illumination levels, speaking, rotation, and cycling, estimated one heart rate per 5.12-second clip, and set them beside a UBFC-rPPG reproduction. Raw attention, rollout, attention flow, and Beyond Intuition were assessed by skin coverage and the Salience-guided Faithfulness Coefficient (SaCo). Results. Beyond Intuition ranked highest on both datasets, at median coverage 0.789 and SaCo 0.837 on Static level 3 against 0.826 and 0.917 on UBFC-rPPG; lower ranks differed. Within one participant of one condition, neither measure was related to a clip's heart-rate error, waveform correlation, or signal-to-noise ratio on either dataset: 186 of the 252 coefficients fell below $|ρ|=0.10$ and 28 reached $p<0.05$ against the 13 expected by chance. Across the eight scenarios only Beyond Intuition's coverage followed the three performance measures, at $ρ=-0.43$, $+0.57$, and $+0.43$, while the attention-only methods' SaCo ran opposite to each. It failed at 40 lux alone, its median coverage falling to 0.180 and its median SaCo to $-0.178$, whereas motion degraded the estimates far more without such a drop. Conclusions. Skin coverage and SaCo carry information complementary to the performance measures rather than a proxy for them: attributing to the skin does not guarantee an accurate estimate. What an attribution reveals about a condition is where the model looks rather than how faithfully its map is ordered.

0.27