CS Paper Radar

Measurement-Guided Conversion of Laboratory Eye-Tracking Data for VR Authentication

Md Arif Shahriar, Mehedi Hasan Raju, Oleg V. Komogortsev

cs.HC ·submitted 2026-10-21 16:57 UTC · v1

Abstract

Eye-movement authentication in virtual reality (VR) needs longitudinal training data, yet most such datasets come from lab trackers. We convert lab recordings to a VR headset's signal quality while keeping their eye movement, using only unpaired VR recordings of other people. Measurements show that the headset's added noise dominates above 7.8 Hz and that its quality is consistent within a person. A parametric device model re-creates the headset's sampling, a person-consistent calibration error and spectrally shaped noise, and a frequency-locked diffusion renderer re-textures that high-frequency noise. Converted GazeBase recordings match GazeBaseVR in noise level and accuracy, keep their source's saccade dynamics, and are harder to tell from real VR data than two prior conversions. An authenticator trained only on converted data verifies unseen VR users at a 5.9% equal error rate with 45 s of gaze, close to real VR training (5.8%); with 5 s, a gap remains.

Comment
19 pages, 5 figures, 6 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Eye Tracking Signal Quality Evaluation: Meta Quest Pro vs HTC VIVE Pro Eye vs HTC VIVE Focus Vision

cs.HC ·2026-10-23 ·Aleksandr Chernysh, Mehedi Hasan Raju, Kamrul Hasan, Md Arif Shahriar, Proloy Karmakar +2 more
similarity 0.65
Abstract · 14 pages, 6 figures; supplementary material (16 pages) included. Submitted to ETRA 2027. Data: https://hdl.handle.net/10877/25342 ; code: ht…

Gaze research in virtual reality needs eye trackers of known error. Thirty participants completed the same protocol on the Meta Quest Pro (QP), HTC VIVE Pro Eye (PE) and HTC VIVE Focus Vision (FV); to our knowledge, this is the first evaluation of the FV eye tracker. In a random-saccade task, median participant mean error was 1.04° on QP, 1.50° on PE and 2.41° on FV, which remained least accurate after linear recalibration. In a later block with a darker background, PE error rose by 0.70°. FV samples were positively correlated: dispersion was 9.8 times the sample-to-sample root mean square. The device clocks showed losses that mean error hides. QP paused for up to 6.04 s, and FV skipped single samples. During instructed eye closures, QP flagged every sample valid while gaze moved 9.74°. Evaluations should report repeated timestamps, loss composition on the device clock and validity during eye closures.

0.34

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

cs.HC cs.CV ·2026-09-03 ·Kamrul Hasan, Mehedi Hasan Raju, Oleg V. Komogortsev
similarity 0.62
Abstract · 20 pages, 3 tables, 3 figures

Eye movement biometrics (EMB) is an emerging behavioral modality for user authentication, particularly in virtual- and augmented-reality systems, where gaze dynamics contain distinctive subject-specific features. However, robust EMB systems require diverse, high-quality gaze recordings that are expensive to collect and often unavailable at the scale needed for model development. Generative models can mitigate data scarcity, but existing methods either synthesize generic gaze behavior or personalize signals primarily by identity, without jointly representing the user's task and subjective state. Consequently, generated signals may appear visually realistic while failing to retain the behavioral properties required for biometric applications. To address this limitation, we propose EyeMakeYou, a multi-conditional denoising diffusion framework for subject-specific, high-frequency gaze synthesis. EyeMakeYou generates 5-s, 1000-Hz bivariate gaze-velocity sequences from an identity-removed reference trajectory and conditions the denoising process on an identity embedding, a task embedding, and self-reported ratings of overall difficulty, mental tiredness, and eye tiredness. Its objective combines diffusion noise prediction and identity preservation with multi-resolution spectral, drift-consistency, and event-weighted local-smoothness losses. Experiments on GazeBase show that EyeMakeYou achieves higher median spatial accuracy and greater real--synthetic similarity in the embedding feature space than the existing generative approaches, while retaining selected task-dependent associations between subjective reports and oculomotor features. These findings support conditional diffusion as a practical approach for augmenting gaze datasets for biometric and interactive applications.

0.48

From Laboratory to Road: Evaluating Wearable Gaze Accuracy for Driving

cs.CV ·2026-10-06 ·William Engel, Fabian Flohr
similarity 0.62
Abstract · Peer-reviewed and accepted as an Extended Abstract at the German Conference on Pattern Recognition (GCPR 2026). Presented as a poster at GCP…

Bird's-eye-view (BEV) representations have become a widely used interface between perception and planning in autonomous driving, but they encode what is in a scene, not what is behaviorally relevant to a human driver. Gaze offers a compelling behavioral signal for this gap, yet wearable eye trackers are routinely deployed as if their spatial output were ground truth, despite known sensitivity to head motion, illumination, and calibration drift. We present, to our knowledge, the first unified framework for quantifying wearable gaze accuracy under real driving conditions. Our on-road study contains 41 validated scenes in which one driver fixated a vehicle's license plate. Gaze error is measured as the angular difference between the plate center and the gaze direction estimated by the glasses. Separate indoor studies with the same driver and device systematically analyze how distance, illumination, head motion, target motion, and gaze eccentricity affect both systematic bias and gaze precision. The mean on-road error was 4.58 degrees. Applying an offset estimated from the indoor recordings reduced it to 1.10 degrees and improved all 41 scenes. Because this offset varied between sessions, reliable BEV supervision may require online recalibration and condition-dependent estimates of gaze uncertainty.

0.15

EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment

cs.CV eess.SP ·2026-08-19 ·Berken Utku Demirel, Christian Holz
top venuecode/data similarity 0.61
Abstract · Accepted to the European Conference on Computer Vision (ECCV) 2026

Egocentric vision systems capture human behavior from visible cues, but overlook physiological indicators of autonomic states such as stress, engagement, and attention. Heart rate variability (HRV) is a widely used noninvasive marker of autonomic regulation under stress. HRV reflects small timing differences between successive heartbeats and has so far been out of reach for egocentric platforms, where motion and noise in gaze video mask exactly this fine-grained timing. We propose EgoHRV, a method that estimates HRV as well as heart rate (HR) from the gaze cameras that are already integrated into egocentric headsets. Our pipeline combines a 3D backbone with a novel low--high decomposition module that extracts the blood volume pulse (BVP) signal from gaze video. Our cross-domain pretraining aligns the frequency-domain representations of contact-based and camera-derived signals. This alignment gives EgoHRV the temporal precision to recover HRV from the subtle fluctuations in gaze video. EgoHRV achieves state-of-the-art accuracy for HR and HRV estimation from egocentric video, and its uncertainty-aware design improves downstream behavioral modeling. Integrating our HRV estimates and confidence measures into EgoExo4D's proficiency estimator raises accuracy by 17.8%. Beyond skill, continuous HRV estimation also opens egocentric systems to stress- and arousal-aware estimation tasks. Code: https://github.com/eth-siplab/EgoHRV

0.48

How Well Does Webcam Eye Tracking Work "in the Wild"? A Large-Scale Validation of Chiasm and a Comparison with WebGazer

cs.CV ·2026-11-03 ·Artem V. Belopolsky, Florian Perdreau
code/data similarity 0.61
Abstract · 37 pages, 21 figures, 2 tables

Webcam eye tracking can greatly accelerate data collection in basic and applied research by reaching large, diverse samples of participants online. However, its spatial performance is considered well below that of hardware-based systems, limiting its use. We evaluated the first-generation Chiasm webcam eye tracker in a large online study ($N = 505$) spanning diverse participants, devices, and recording conditions. Chiasm achieved a mean spatial accuracy of 2.39 cm ($\approx 2.28^\circ$ at 60 cm), spatial precision (SD) of 1.05 cm ($\approx 1.00^\circ$ at 60 cm), and sample-to-sample precision (RMS-S2S) of 1.29 cm ($\approx 1.23^\circ$ at 60 cm). For the 91% of participants who met a 3 cm calibration criterion, spatial accuracy was 2.15 cm ($\approx 2.05^\circ$ at 60 cm). After three minutes of a task that encouraged head movement, spatial accuracy declined by 0.59 cm, while the gaze center at each target shifted by a mean distance of only 0.37 cm. On the validation block, the offset was 0.30 cm larger for men than for women. Age, region of residence, face luminance, and Michelson contrast showed no reliable relationship with spatial accuracy. A higher eye aspect ratio, a more open eye, was associated with a smaller offset. Wearing glasses decreased spatial accuracy on every validation block. In a comparison between a random subsample ($N = 101$) and a separate sample tested with the open-source tracker WebGazer ($N = 101$) using an identical protocol, Chiasm showed better spatial accuracy (2.18 vs. 4.51 cm) and spatial precision (SD; 1.01 vs. 1.55 cm). WebGazer showed better sample-to-sample precision (RMS-S2S; 0.79 vs. 1.26 cm), which likely reflects conservative, over-smoothed estimates rather than superior stability. These results suggest that Chiasm is narrowing the gap between webcam and hardware-based eye tracking, making large-scale gaze research "in the wild" a reality.

0.34

GAZEleak: Passcode Inference Against Eye-tracking XR Devices Through External Observation

cs.CR ·2026-09-28 ·Hwanjo Heo, Junhee Lee, Jinwoo Kim
similarity 0.60
Abstract · The vendor requests more time to review our responsible disclosure

Mixed-reality headsets such as Apple Vision Pro replace the touch screen with gaze-as-pointer interaction: the wearer looks at a target and confirms with an air pinch. Because the display is inside the headset and the eye tracker is walled off from third-party software, such input is widely assumed to be unobservable to bystanders---a built-in defense against the shoulder-surfing that plagues phones and laptops. We present GAZEleak, a side-channel attack that recovers gaze-driven input from external video of head motion alone, under a strictly local, physical-observer threat model: the adversary only films the wearer from across the room and installs no software on the device. The attack exploits the centrally coupled eye-head motor program: gaze shifts recruit small, target-dependent head reorientations that project into sub-degree pose changes recoverable from commodity video. GAZEleak implements a measurement-based, sparse-optical-flow inference pipeline for users' 6-digit device passcodes. On a preliminary front-view dataset from three author-subjects who were aware of the attack hypothesis, GAZEleak places the true code within the top ten guesses for 56% (10 of 18) of test codes under a cross-person protocol with no labeled victim data, and for every code of the most exposed subject. The performance is subject-dependent: no passcode from the least exposed subject reaches the top ten, although its median guessed passcode rank is 12,786 rather than 500,000 expected from an uninformative ordering. These results provide preliminary evidence that gaze-coupled head motion can expose passcode information under controlled conditions, while motivating broader evaluation across users, behaviors, and capture settings.

0.26

Gaze Under Strain: How Oculomotor Behavior Tracks Cybersickness Progression in VR

cs.HC ·2026-10-23 ·Nevzat Umut Demirseren, Mehedi Hasan Raju, Oleg Komogortsev, Isayas Berhe Adhanom
published similarity 0.60
Abstract · Accepted for publication at ACM VRST 2026. 10 pages, 4 figures

Cybersickness remains a major barrier to comfortable, accessible virtual reality (VR). Arising from mismatches between visual and vestibular signals, it places sustained demands on gaze stabilization and visual processing. Because gaze is the mechanism through which users actively sample the virtual environment, cybersickness-induced disruptions may alter both what users perceive and how discomfort itself emerges. Yet, how eye-movement behavior evolves alongside discomfort during prolonged VR exposure remains poorly understood. We present a behavioral analysis of eye-tracking data from 19 participants navigating a realistic virtual environment over a 20-minute session, with discomfort rated repeatedly throughout the experiment. Linear mixed-effects models examined gaze constructs spanning fixation stability, visual exploration, and gaze allocation as functions of discomfort, exposure duration, and their interaction. Our results show that fixation stability degraded progressively with increasing discomfort, with the effect strengthening over time. Visual exploration showed no marginal discomfort effect but exhibited significant discomfort-by-time interactions, indicating that saccadic behavior adapts dynamically rather than responding uniformly to discomfort. Gaze allocation was not associated with discomfort but shifted systematically with time. These findings show that cybersickness does not uniformly disrupt gaze. Instead, different aspects of eye-movement behavior respond differently and change in ways that only become visible when discomfort is tracked repeatedly over time. Understanding how gaze evolves during cybersickness progression provides the behavioral grounding needed to better interpret how discomfort shapes the user's visual experience of immersive environments and to design more sensitive detection approaches.

0.32

How Early Can You Tell? Early Eye Gaze Dynamics and Cybersickness Progression in Virtual Reality

cs.HC ·2026-09-21 ·Nevzat Umut Demirseren, Isayas Berhe Adhanom
similarity 0.60
Abstract · 6 pages, 3 figures

Cybersickness remains one of the primary barriers to prolonged and comfortable virtual reality (VR) use, yet the temporal development of cybersickness remains poorly understood because its onset and progression vary substantially across individuals. Eye tracking provides a continuous and unobtrusive measure of user behavior, making it well suited for investigating how users respond throughout VR exposure. However, existing work has mainly focused on aggregate gaze measures or post-exposure assessments, leaving the relationship between early eye-movement dynamics and discomfort progression underexplored. In this paper, we investigate whether early eye-movement dynamics characterize the subsequent progression of cybersickness. Using trajectories of fixation duration, fixation dispersion, saccade amplitude, saccade velocity, and gaze eccentricity computed over the first one to five minutes of VR exposure, we evaluate their association with subsequent discomfort progression and compare early gaze dynamics between participants with low and high post-exposure cybersickness severity. Our results show that early fixation dispersion is consistently associated with subsequent discomfort progression, whereas no significant differences are observed between cybersickness severity groups. These findings suggest that early fixation dispersion can characterize the progression of discomfort rather than the final cybersickness severity. Overall, this work provides new insight into the temporal relationship between early eye-movement behavior and cybersickness progression, contributing to the understanding of gaze dynamics during immersive experiences.

0.19