CS Paper Radar

How Well Does Webcam Eye Tracking Work "in the Wild"? A Large-Scale Validation of Chiasm and a Comparison with WebGazer

Artem V. Belopolsky, Florian Perdreau

cs.CV ·submitted 2026-11-03 14:10 UTC · v1
code/data

Abstract

Webcam eye tracking can greatly accelerate data collection in basic and applied research by reaching large, diverse samples of participants online. However, its spatial performance is considered well below that of hardware-based systems, limiting its use. We evaluated the first-generation Chiasm webcam eye tracker in a large online study ($N = 505$) spanning diverse participants, devices, and recording conditions. Chiasm achieved a mean spatial accuracy of 2.39 cm ($\approx 2.28^\circ$ at 60 cm), spatial precision (SD) of 1.05 cm ($\approx 1.00^\circ$ at 60 cm), and sample-to-sample precision (RMS-S2S) of 1.29 cm ($\approx 1.23^\circ$ at 60 cm). For the 91% of participants who met a 3 cm calibration criterion, spatial accuracy was 2.15 cm ($\approx 2.05^\circ$ at 60 cm). After three minutes of a task that encouraged head movement, spatial accuracy declined by 0.59 cm, while the gaze center at each target shifted by a mean distance of only 0.37 cm. On the validation block, the offset was 0.30 cm larger for men than for women. Age, region of residence, face luminance, and Michelson contrast showed no reliable relationship with spatial accuracy. A higher eye aspect ratio, a more open eye, was associated with a smaller offset. Wearing glasses decreased spatial accuracy on every validation block. In a comparison between a random subsample ($N = 101$) and a separate sample tested with the open-source tracker WebGazer ($N = 101$) using an identical protocol, Chiasm showed better spatial accuracy (2.18 vs. 4.51 cm) and spatial precision (SD; 1.01 vs. 1.55 cm). WebGazer showed better sample-to-sample precision (RMS-S2S; 0.79 vs. 1.26 cm), which likely reflects conservative, over-smoothed estimates rather than superior stability. These results suggest that Chiasm is narrowing the gap between webcam and hardware-based eye tracking, making large-scale gaze research "in the wild" a reality.

Comment
37 pages, 21 figures, 2 tables

Closest papers

Nearest neighbours by meaning across the whole index.

A Study on Performance Enhancement of a Webcam-Based Real-Time Eye-Tracking System

cs.CV ·2026-11-16 ·Minuk Jung, Kyeonghun Kim, Sooyeon Yoon
similarity 0.68
Abstract · 9 pages, 5 figures, 5 tables

This study proposes a real-time gaze-tracking system that uses a standard RGB webcam to estimate screen coordinates. The system combines ETH-XGaze-based gaze estimation with nine-point calibration and polynomial ridge regression. To reduce errors caused by changes in head position, it also applies a conditional residual correction derived from head and pose features extracted with RTMPose. Whether this correction is used depends on the reliability of the detected features and the characteristics of the calibration data. In a preliminary experiment, one participant completed trials at 12 screen targets. The resulting mean screen-coordinate error was 204.24 pixels, which was 35.83% lower than that of xgaze-js and 57.69% lower than that of gaze_tracker. The system produced valid gaze estimates for all 12 targets. These preliminary findings demonstrate the feasibility of combining user-specific calibration with conditional pose-based correction for webcam gaze tracking. Because the evaluation involved only one participant, further experiments with more participants and a wider range of postures are required.

0.15

Low Cost Eye Tracking for Vision Screening

cs.RO ·2026-09-25 ·Maissa Abir Smaili, Yaman Ismaiel, Zafer Iscan
similarity 0.67
Abstract · 5 pages, 7 figures

This engineering study assesses gaze-assisted data acquisition during visual screening with a Gaze Quest implementation via webcam and GC308 near infrared camera with an Orlosky eye tracking pipeline. Ten subjects performed under both acquisition conditions. Accuracy of Tumbling E orientation, reported application logMAR value,and response latency were determined from keyboard responses and hence are behavioral outputs as opposed toeye tracker screening results. Frame-to-frame change in theangle between successive normalized gaze vectors (28.2degrees) served as the GC308 eye tracker derived diagnostic with an effective sampling rate of roughly 8 FPS. No screen target calibration or gaze to screen translation was done on the GC308 eye tracker output data for the current analysis and hence, these data represent acquisition stability and not gaze accuracy in relation to the target. The webcam pipeline relied on 25-point screen calibration. Because the display resolution and pixel pitch could not be retained in the records of the study, the reported application logMAR values cannot be viewed as measures of visual acuity in any way.

0.20

From Laboratory to Road: Evaluating Wearable Gaze Accuracy for Driving

cs.CV ·2026-10-06 ·William Engel, Fabian Flohr
similarity 0.63
Abstract · Peer-reviewed and accepted as an Extended Abstract at the German Conference on Pattern Recognition (GCPR 2026). Presented as a poster at GCP…

Bird's-eye-view (BEV) representations have become a widely used interface between perception and planning in autonomous driving, but they encode what is in a scene, not what is behaviorally relevant to a human driver. Gaze offers a compelling behavioral signal for this gap, yet wearable eye trackers are routinely deployed as if their spatial output were ground truth, despite known sensitivity to head motion, illumination, and calibration drift. We present, to our knowledge, the first unified framework for quantifying wearable gaze accuracy under real driving conditions. Our on-road study contains 41 validated scenes in which one driver fixated a vehicle's license plate. Gaze error is measured as the angular difference between the plate center and the gaze direction estimated by the glasses. Separate indoor studies with the same driver and device systematically analyze how distance, illumination, head motion, target motion, and gaze eccentricity affect both systematic bias and gaze precision. The mean on-road error was 4.58 degrees. Applying an offset estimated from the indoor recordings reduced it to 1.10 degrees and improved all 41 scenes. Because this offset varied between sessions, reliable BEV supervision may require online recalibration and condition-dependent estimates of gaze uncertainty.

0.15

Drift Calibration in Geometric Eye Tracking Systems

cs.CV ·2026-08-30 ·Jiaqi Liu, Zixuan Wang, Yuhong Zhang, Dingkang Liang, Jane Hanqi Li +2 more
benchmarkdataset similarity 0.61
Abstract · 11 pages, 6 figures, 3 tables

Geometric eye trackers can provide the spatial accuracy required for gaze-based interaction and multimodal studies, but their measurements remain sensitive to residual session-specific calibration error. Research on correcting this error is difficult to compare because methods are typically evaluated with different devices, target layouts, and error definitions. We present a calibration-focused dataset containing 163 trials from 12 participants, with separate 18-point fitting and 32-point test grids, and use it to evaluate global, local, and composite correction functions under a common spatial-extrapolation protocol. We further introduce a lightweight neural refiner that combines ranked predictions from complementary calibrators. On this controlled dataset, post-vendor correction reduces the mean angular error from $1.53^\circ$ to $1.03^\circ$ with the strongest classical composite and to $0.96^\circ$ with the refiner. In a closed-loop gaze task, lower residual error is associated with higher performance across four online correction conditions. These results provide a reproducible data-quality benchmark for using gaze as a behavioral signal in interactive modeling.

0.21

Eye Tracking Signal Quality Evaluation: Meta Quest Pro vs HTC VIVE Pro Eye vs HTC VIVE Focus Vision

cs.HC ·2026-10-23 ·Aleksandr Chernysh, Mehedi Hasan Raju, Kamrul Hasan, Md Arif Shahriar, Proloy Karmakar +2 more
similarity 0.61
Abstract · 14 pages, 6 figures; supplementary material (16 pages) included. Submitted to ETRA 2027. Data: https://hdl.handle.net/10877/25342 ; code: ht…

Gaze research in virtual reality needs eye trackers of known error. Thirty participants completed the same protocol on the Meta Quest Pro (QP), HTC VIVE Pro Eye (PE) and HTC VIVE Focus Vision (FV); to our knowledge, this is the first evaluation of the FV eye tracker. In a random-saccade task, median participant mean error was 1.04° on QP, 1.50° on PE and 2.41° on FV, which remained least accurate after linear recalibration. In a later block with a darker background, PE error rose by 0.70°. FV samples were positively correlated: dispersion was 9.8 times the sample-to-sample root mean square. The device clocks showed losses that mean error hides. QP paused for up to 6.04 s, and FV skipped single samples. During instructed eye closures, QP flagged every sample valid while gaze moved 9.74°. Evaluations should report repeated timestamps, loss composition on the device clock and validity during eye closures.

0.34

Measurement-Guided Conversion of Laboratory Eye-Tracking Data for VR Authentication

cs.HC ·2026-10-21 ·Md Arif Shahriar, Mehedi Hasan Raju, Oleg V. Komogortsev
similarity 0.61
Abstract · 19 pages, 5 figures, 6 tables

Eye-movement authentication in virtual reality (VR) needs longitudinal training data, yet most such datasets come from lab trackers. We convert lab recordings to a VR headset's signal quality while keeping their eye movement, using only unpaired VR recordings of other people. Measurements show that the headset's added noise dominates above 7.8 Hz and that its quality is consistent within a person. A parametric device model re-creates the headset's sampling, a person-consistent calibration error and spectrally shaped noise, and a frequency-locked diffusion renderer re-textures that high-frequency noise. Converted GazeBase recordings match GazeBaseVR in noise level and accuracy, keep their source's saccade dynamics, and are harder to tell from real VR data than two prior conversions. An authenticator trained only on converted data verifies unseen VR users at a 5.9% equal error rate with 45 s of gaze, close to real VR training (5.8%); with 5 s, a gap remains.

0.31

An Eye-Tracking Dataset for Viewing Distance Categories in Real-World Scenarios

cs.HC ·2026-08-29 ·Dohwa Kim, Yejin Choi, Seungbok Lee, Chi Yoon Jeong, Eunji Park
dataset similarity 0.60
Abstract · 22 pages, 6 figures, Manuscript submitted to Scientific Data

Estimating viewing distance from gaze behavior is essential for understanding user intent and enabling distance-aware interactive systems. However, most existing eye-tracking datasets have been collected in constrained settings, such as laboratory environments or static tasks. Consequently, they only partially capture viewing behaviors in real-world situations where viewing distance changes with natural head and body movements. We introduce GazeDepth, an eye-tracking dataset collected from 19 participants using a wearable tracker during tasks reflecting real-world scenarios. GazeDepth includes fixed-distance viewing scenarios with constant observer-target distances at near (33 cm), middle (50 cm), and far (300 cm), as well as variable-distance viewing scenarios in which participants shift gaze among targets at different depths in indoor and outdoor environments. The dataset provides synchronized gaze data, pupil size, 3D eye-vectors, and head-motion signals, along with distance labels. Statistical analyses showed that distance-related gaze features, such as vergence angle and estimated viewing distance, differed consistently across viewing-distance categories. In addition, classification models trained on GazeDepth further demonstrated that the dataset captures gaze characteristics that distinguish the three viewing-distance categories, supporting gaze-based distance inference and distance-aware interaction in realistic scenarios.

0.26

Measuring Browser Webcam Gaze Honestly: A Capture-Clock Methodology and Open Reference Implementation

cs.HC cs.CVeess.SP ·2026-08-12 ·Chi-Sheng Chen, Gabriel A. Brat
publishedbenchmarktheory similarity 0.58
Abstract · Accepted at DEMI 2026 (MICCAI 2026 Workshop on Data Engineering in Medical Imaging). Final version to appear in Springer LNCS

Browser-based webcam gaze trackers are increasingly used for crowd-scale data collection and in clinical settings where lab eye trackers are impractical, but the reported latency numbers may not represent real world functionality. The common practice of timestamping each gaze sample when it is emitted, rather than when its source frame was captured, makes the measured inference latency read about $0\,$ms no matter how slow the engine really is. We show how to measure it honestly, recovering a per-frame capture clock from the browser's \texttt{re\-quest\-Video\-Frame\-Call\-back} (rVFC) API (\texttt{captureTime} where the browser exposes it for local camera streams, else \texttt{presentationTime}, in which case every recovered latency is a verifiable lower bound): exact source-frame pairing through a per-frame queue for engines that expose their inference pipeline, and a further lower bound for engines that do not, such as WebGazer. We release an open TypeScript implementation and benchmark harness, demonstrated on two interchangeable engines: WebGazer and a new FaceMesh+KRR pipeline.

0.18