CS Paper Radar

From MNH to the Friedman--Komogortsev Method---which changes improve eye-movement classification?

Lee Friedman, Mehedi Hasan Raju, Oleg Komogortsev

cs.HC q-bio.NC ·submitted 2026-11-08 17:51 UTC · v1

Abstract

The Friedman-Komogortsev Method (FKM) is a rule-based classifier of fixations, saccades, and post-saccadic oscillations in 1000-Hz recordings, developed from the modified Nyström-Holmqvist algorithm (MNH) and used in several recent studies. FKM changes MNH in many ways at once: it centres MNH's Savitzky-Golay filter, adds a position-based test for whether an apparent post-saccadic oscillation continues the saccade, adds rejection tests, and changes several thresholds. We asked which of these changes alter agreement with human classification. Both algorithms were scored against twenty 26-s GazeBase reading recordings hand-classified by three trained raters, and each change was reverted in turn. FKM agreed better than MNH as MNH was used: saccade Cohen's kappa rose on all 20 recordings (median +0.034), and saccade boundaries moved from 2-3 ms late to the raters' sample. One change produced this: centring the filter, which removes a three-sample delay. Reinstating the delay returned FKM's saccade kappa to MNH's value, and centring MNH's filter alone made MNH match FKM on saccades and exceed it on post-saccadic events. The position-based test changed how saccades with several velocity peaks were divided, splitting 8% of rater-labelled "wavy" saccades into a saccade and a spurious oscillation against 39% for delay-corrected MNH. FKM's higher post-saccadic velocity floor traded recall for precision. The remaining changes had no measurable effect on these recordings. FKM's improvement over MNH is therefore a filter-alignment correction that MNH users can apply directly, plus a segmentation rule for multi-peak saccades.

Comment
The details about the classification is described in the supplementary materials

Closest papers

Nearest neighbours by meaning across the whole index.

EyeTAG: Eye Trajectory-Aware Gaze Estimation

cs.CV cs.LG ·2026-10-01 ·Jungmin Lee, Niamat Ullah, Yoseob Han
publishedcode/data similarity 0.53
Abstract · Accepted to BMVC 2026

Gaze estimation under natural head-eye motion underpins applications from driver monitoring to human-computer interaction. Single-frame methods predict each frame independently, so consecutive outputs fluctuate as jitter. Multi-frame methods reduce this, but they learn motion implicitly inside appearance features, so the gaze trajectory is never an explicit variable. We propose EyeTAG (Eye Trajectory-Aware Gaze Estimation), a causal multi-frame framework built around an explicit first-order gaze prior: at each step it differentiates its own recent predictions and feeds the resulting trajectory back as a compact kinematic token. Because differencing is translation-invariant in gaze space, this token carries subject-invariant motion rather than personal gaze offsets. Face and eye streams supply visual evidence, fused by cross-attention and a causal Transformer decoder. EyeTAG reduces the mean angular error by about 1.0$^\circ$ on Gaze360 and performs on par with the strongest baseline on EVE (2.56$^\circ$ vs. 2.58$^\circ$). Within-model ablations, which keep the encoder and the rest of the architecture fixed and vary only the gaze history, show that the differential formulation, rather than temporal context alone, removes the systematic saccade bias that persists even with an absolute gaze-history prior. Our code is available at https://github.com/peter8366/EyeTAG.

0.38

Adapting Appearance-Based Gaze Estimation to Narrow-Range, Long-Duration Screen Viewing

eess.IV ·2026-10-08 ·Jordan Prescott, Kleanthis Avramidis, Shrikanth Narayanan
benchmark similarity 0.52
Abstract

Appearance-based gaze estimation offers a low-cost alternative to infrared eye tracking for screen-based behavioral and clinical applications, however existing models are typically developed for wide ranges of gaze angle and head pose. Prolonged screen viewing presents a distinct regime in which gaze remains near the screen center, head motion is limited, and calibration drift accumulates over time. In this work, we benchmark six published estimators along with a proposed differential-gaze model on 140 long-duration facial video recordings with synchronized eye tracking under subject-disjoint evaluation and a common budget of calibration frames. Differential estimation was the only static method that significantly improved upon a baseline predictor of each recording's mean gaze, and was further boosted by addition of temporal context. It also yielded the strongest agreement with reference fixations and saccades, demonstrating that low angular error alone could not validate eye movement reconstruction. These findings establish differential estimation as a promising foundation for reliable gaze tracking in long-duration, narrow-range settings.

0.07

Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

cs.CV cs.AIcs.CLcs.HC+1 ·2026-08-17 ·Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani, Ulas Bagci, Alessandro Bruno
published similarity 0.52
Abstract · Paper accepted at 3rd HCV workshop at ECCV 2026. 12 pages main text, 16 pages supp

Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language models (MLLMs), given the same foveated input, search as humans do bears on their use as models of human vision and on attention-alignment scores. We compare three general-purpose MLLMs with human eye-movement scanpaths on goal-directed search (COCO-Search18), driving each model fixation by fixation through an identical, human-matched foveated view and assessing it along three axes: the decision of target presence, the efficiency of reaching the target, and the gaze process itself. The axes dissociate. On the decision and on target acquisition the models match or exceed humans, detecting present targets near ceiling and reaching them on the first saccade more often than people do. The gaze process is not human. Under the human-matched condition, all three share one signature: low-entropy, large-amplitude, self-consistent scanpaths that agree with themselves far more closely than two humans agree with each other. That is consistent with a single-pass, non-serial architecture rather than a limit of acuity. Matched retinal input reproduces where humans look but not how the looking unfolds in time, and no degradation regime recovers human-like search at human-like success. The gap sits on a process axis that answer-alignment and saliency metrics do not measure. Because they miss it, such metrics cannot certify human-like vision, and zero-shot models suit outcome and spatial questions but not temporal, process-level ones.

0.61

Diffusion models for eye-gaze trajectory generation using position and velocity representations

cs.CV cs.AIcs.NE ·2026-09-01 ·Laxman Basnet, Alexander Szorkovszky, Pedro G. Lind, Anis Yazidi, Shailendra Bhandari
similarity 0.51
Abstract · 13 pages, 9 figures

Eye-tracking data are expensive to collect, requiring specialized hardware and controlled laboratory conditions, and difficult to share due to privacy regulations, which together limit the quantity and diversity of gaze data available for research. We investigate unconditional gaze generation using diffusion models in position and component-wise velocity representations. The models are trained and evaluated on eight-second visual-search trajectories from 28 participants, using a split of 23 training participants and five held-out validation participants, with three training seeds. Evaluation includes kinematic distributions, trajectory geometry, event statistics, and a temporal Wasserstein GAN with gradient penalty as a learned comparator. Across eight position-derived features, mean Jensen-Shannon divergence is $0.016 \pm 0.004$ for the position model and $0.037 \pm 0.002$ for the velocity model, with standard deviations calculated across training seeds. These scores do not establish that representation choice caused the difference. A separate comparison using the same evaluation method shows that the ordering of the models varies across training seeds. The position model also produces smaller feature discrepancies than a kinematic Markov baseline. Differences in saccade counts between real and generated data depend strongly on the velocity threshold used to detect events. The results provide quantitative reference measurements for unconditional gaze generation on this visual-search task and show how evaluation choices affect conclusions about generated gaze.

0.24

RadAI: Gaze-Intention Fusion Pipeline for Attention-Guided Educational Videos in Chest X-Ray Interpretation

cs.CV ·2026-10-24 ·Kavish Mehta, Yuvan Siddharth Katamaneni, Akash Awasthi
publishedhot direction similarity 0.51
Abstract · 5 pages, 2 figures, 1 table, accepted to 2026 MIT IEEE URTC conference

Chest radiograph interpretation errors often arise from failures in visual search: although trainees may correctly identify an abnormality once pointed out, they frequently fail to fixate on the relevant region, while expert search strategies (where radiologists look, in what sequence, and for how long) remain largely implicit. Eye movement modeling examples (EMME), which replay a recorded expert's gaze over the image, have been shown to improve novice detection of findings on chest radiographs, but producing one requires an eye-tracking session on that specific case, so teaching sets are limited to recorded sessions by experts. In this work, RadAI is presented, the first end-to-end framework for transforming predicted radiologist gaze into narrated instructional videos, enabling scalable gaze-guided training without collecting new eye-tracking data. Given only a chest X-ray and its report, RadAI predicts an expert fixation sequence, associates each interval of that sequence with the diagnostic finding it pursues, extracts the corresponding image region, and renders the result as an EMME-style video in which each highlighted finding is narrated with synthesized speech. RadAI is evaluated on 97 cases from the EGD-CXR dataset, assessing whether the highlighted regions correspond to annotated abnormality locations. We position this work as a framework for scalable generation of educational content for residents and medical students in the field of radiology.

0.34

Automated screening of Parkinson's Disease using Smooth Pursuit Eye Movements

eess.SP cs.LGq-bio.QM ·2026-10-23 ·J. Camilo Puerta-Acevedo, Maria F. Alcala-Durand, Julián D. Arias-Londoño, Elisa Luque-Buzo, Francisco Grandas-Pérez +1 more
similarity 0.51
Abstract · 23 pages, 8 figures, including supplementary material

Smooth pursuit eye movements are frequently altered in Parkinson's disease, but previous studies have relied mainly on conventional parameters that describe the relationship between gaze and target. This study investigates whether complexity and nonlinear dynamics measures of the gaze position sequences can support the automatic screening of Parkinson's disease. Gaze position sequences were recorded with a video eye tracker in 41 participants with early Parkinson's disease and 47 healthy controls during 12 smooth pursuit tasks. Four experimental frameworks and four embedding delay strategies were compared. The selected experimental setting combined baseline wander removal with a fixed embedding delay. After feature selection, a support vector machine was trained for each task and axis and their outputs were combined in a mixture of experts. The pipeline was developed in 70 participants and evaluated on an external test set of 18 participants. On the external test set, the pipeline obtained an area under the receiver operating characteristic curve of 0.86. The most informative features described less persistent and more irregular gaze position sequences in Parkinson's disease, mainly along the horizontal axis. These results support complexity and nonlinear dynamics measures of smooth pursuit as candidate markers for Parkinson's disease screening, pending validation in larger independent cohorts.

0.24

How Well Does Webcam Eye Tracking Work "in the Wild"? A Large-Scale Validation of Chiasm and a Comparison with WebGazer

cs.CV ·2026-11-03 ·Artem V. Belopolsky, Florian Perdreau
code/data similarity 0.50
Abstract · 37 pages, 21 figures, 2 tables

Webcam eye tracking can greatly accelerate data collection in basic and applied research by reaching large, diverse samples of participants online. However, its spatial performance is considered well below that of hardware-based systems, limiting its use. We evaluated the first-generation Chiasm webcam eye tracker in a large online study ($N = 505$) spanning diverse participants, devices, and recording conditions. Chiasm achieved a mean spatial accuracy of 2.39 cm ($\approx 2.28^\circ$ at 60 cm), spatial precision (SD) of 1.05 cm ($\approx 1.00^\circ$ at 60 cm), and sample-to-sample precision (RMS-S2S) of 1.29 cm ($\approx 1.23^\circ$ at 60 cm). For the 91% of participants who met a 3 cm calibration criterion, spatial accuracy was 2.15 cm ($\approx 2.05^\circ$ at 60 cm). After three minutes of a task that encouraged head movement, spatial accuracy declined by 0.59 cm, while the gaze center at each target shifted by a mean distance of only 0.37 cm. On the validation block, the offset was 0.30 cm larger for men than for women. Age, region of residence, face luminance, and Michelson contrast showed no reliable relationship with spatial accuracy. A higher eye aspect ratio, a more open eye, was associated with a smaller offset. Wearing glasses decreased spatial accuracy on every validation block. In a comparison between a random subsample ($N = 101$) and a separate sample tested with the open-source tracker WebGazer ($N = 101$) using an identical protocol, Chiasm showed better spatial accuracy (2.18 vs. 4.51 cm) and spatial precision (SD; 1.01 vs. 1.55 cm). WebGazer showed better sample-to-sample precision (RMS-S2S; 0.79 vs. 1.26 cm), which likely reflects conservative, over-smoothed estimates rather than superior stability. These results suggest that Chiasm is narrowing the gap between webcam and hardware-based eye tracking, making large-scale gaze research "in the wild" a reality.

0.34

From Laboratory to Road: Evaluating Wearable Gaze Accuracy for Driving

cs.CV ·2026-10-06 ·William Engel, Fabian Flohr
similarity 0.50
Abstract · Peer-reviewed and accepted as an Extended Abstract at the German Conference on Pattern Recognition (GCPR 2026). Presented as a poster at GCP…

Bird's-eye-view (BEV) representations have become a widely used interface between perception and planning in autonomous driving, but they encode what is in a scene, not what is behaviorally relevant to a human driver. Gaze offers a compelling behavioral signal for this gap, yet wearable eye trackers are routinely deployed as if their spatial output were ground truth, despite known sensitivity to head motion, illumination, and calibration drift. We present, to our knowledge, the first unified framework for quantifying wearable gaze accuracy under real driving conditions. Our on-road study contains 41 validated scenes in which one driver fixated a vehicle's license plate. Gaze error is measured as the angular difference between the plate center and the gaze direction estimated by the glasses. Separate indoor studies with the same driver and device systematically analyze how distance, illumination, head motion, target motion, and gaze eccentricity affect both systematic bias and gaze precision. The mean on-road error was 4.58 degrees. Applying an offset estimated from the indoor recordings reduced it to 1.10 degrees and improved all 41 scenes. Because this offset varied between sessions, reliable BEV supervision may require online recalibration and condition-dependent estimates of gaze uncertainty.

0.15