CS Paper Radar

Looking Around by Looking Around: Omnidirectional Gaze-based VR Viewport Control

Hock Siang Lee, Jinghui Hu, Florian Weidner, Haopeng Wang, Hans Gellersen

cs.HC ·submitted 2026-08-30 20:14 UTC · v1
published

Abstract

Traditional VR viewport control primarily relies on head and torso movement, which can be effortful and limiting in both constrained and extended-use settings. We introduce Looking Around by Looking Around (LALA), a gaze-based VR pitch-and-yaw viewport control technique designed for natural and effortless omnidirectional exploration via eye movements, without requiring or obstructing movement of the head, hand, or body, offering a low-effort and highly accessible interaction method. Because gaze is primarily used for perception and exhibits oculomotor and perceptual asymmetries, using it directly for control is difficult. To address this, we designed an asymmetric omnidirectional control profile for the eye, then built on it to exploit tendencies for eyes to stay within comfortable regions for viewport control. We evaluated LALA in a user study (N=18) featuring two contrasting tasks: alignment towards known directions and open-ended visual search towards unknown directions. LALA was strongly preferred over the traditional baseline, achieving competitive performance while enabling fully hands-free interaction with minimal physical movement.

Closest papers

Nearest neighbours by meaning across the whole index.

Passthrough Rigidity: The Behavioral and Visuomotor Costs of Mediated Perception

cs.HC ·2026-09-21 ·Markus D. Solbach, Mohit Goyal, Sakar Khattar, Jayant Varma, Bjorn Vlaskamp +2 more
publishedcode/data similarity 0.70
Abstract · 10 pages, 16 Figures, ISMAR

Broad public adoption of head-mounted displays using video passthrough remains elusive despite significant market investment. A precise understanding of why users experience persistent discomfort even as hardware factors such as resolution and latency have dramatically improved remains an open issue. This paper investigates the impact of viewing the world through video passthrough systems on human behavioral and physiological patterns through a large-scale multimodal study. We developed a novel protocol to capture synchronized oculomotor, kinematic, and physiological data during a block assembly task requiring complex hand-eye coordination. Using a within-subject design (N=110), we evaluated both natural and passthrough viewing conditions. Our results reveal a four-fold suppression of rotational head velocity and a pronounced decoupling of head-gaze coordination. This suggests motor caution being employed as an adaptive strategy - which we term "Passthrough Rigidity". This phenomenon appears to shift the information-gathering burden to the oculomotor system, resulting in significantly longer fixation durations and restricted visual search patterns. These kinematic shifts directly correlate with poorer task performance and measurable physiological cost, evidenced by a significant reduction in blink duration and increased reports of ocular strain and cognitive load. We conclude that current passthrough implementations induce a measurable shift from flexible exploration to motor caution, where task performance is preserved at the cost of user comfort and biomechanical efficiency. These findings provide a novel quantitative framework for evaluating and improving future XR devices, establishing that resolving "comfort" for passthrough requires addressing the deep-seated biomechanical compensations caused by mediated perception. Data available at https://data.nvision.eecs.yorku.ca/Passthrough

0.29

Steering Versus Teleporting in Mobile Virtual Reality

cs.HC ·2026-09-24 ·Kristen Grinyer, Daniel Zielasko, Robert J. Teather
published similarity 0.68
Abstract · to appear in VRST 2026

Mobile virtual reality (MVR) provides low-cost access to extended reality (XR), but its limited input restricts use of common locomotion techniques such as head-decoupled and velocity-controlled steering. Using a low-cost controller with an audio-based button, we compared gaze- and controller-directed steering and teleportation in MVR. We included a controller pitch-based speed-control technique enabling continuous head-decoupled steering. Performance and participant feedback indicate that gaze was better suited to teleportation, whereas controller pointing better supports steering in primed search. We compare with similar techniques in standard VR and derive design considerations for low-cost, narrow-FOV hardware, demonstrating the potential to support varied travel techniques and velocity control in low-fidelity XR.

0.36

GazeTune: Facilitating Precise Gaze-Driven Interactions with Cascaded Touch Input

cs.HC ·2026-09-01 ·Jina Kim, Eric J. Gonzalez, Yang Zhang, Sang Ho Yoon
top venuehot direction similarity 0.66
Abstract · 13 pages, 8 Figures, Accepted to UIST'26

Eye gaze has become an essential input for spatial computing, but its coarse targeting and saccadic nature limit precision and complicate continuous interactions such as dragging, especially under user motion. Gaze+pinch has also become standard in XR for its convenience, yet mid-air gestures remain imprecise, fatiguing, and socially unacceptable. These limitations underscore the need for an approach that preserves the speed of gaze while enabling stable, fine control. We present GazeTune, a cascaded multimodal interaction technique combining gaze and touch to refine gaze-based selection and manipulation. Touch serves as a refinement channel within gaze pointing, allowing precise cursor and target control. Our work investigates how gaze-and-touch enhances dragging and mitigates Motion-Induced instability. In a study (N=20), we compared GazeTune against gaze-only and gaze-pinch methods in 2D dragging. Results show that GazeTune achieves significantly lower error with comparable execution time, validating its effectiveness and balanced trade-off between time and accuracy.

0.47

Gaze Under Strain: How Oculomotor Behavior Tracks Cybersickness Progression in VR

cs.HC ·2026-10-23 ·Nevzat Umut Demirseren, Mehedi Hasan Raju, Oleg Komogortsev, Isayas Berhe Adhanom
published similarity 0.65
Abstract · Accepted for publication at ACM VRST 2026. 10 pages, 4 figures

Cybersickness remains a major barrier to comfortable, accessible virtual reality (VR). Arising from mismatches between visual and vestibular signals, it places sustained demands on gaze stabilization and visual processing. Because gaze is the mechanism through which users actively sample the virtual environment, cybersickness-induced disruptions may alter both what users perceive and how discomfort itself emerges. Yet, how eye-movement behavior evolves alongside discomfort during prolonged VR exposure remains poorly understood. We present a behavioral analysis of eye-tracking data from 19 participants navigating a realistic virtual environment over a 20-minute session, with discomfort rated repeatedly throughout the experiment. Linear mixed-effects models examined gaze constructs spanning fixation stability, visual exploration, and gaze allocation as functions of discomfort, exposure duration, and their interaction. Our results show that fixation stability degraded progressively with increasing discomfort, with the effect strengthening over time. Visual exploration showed no marginal discomfort effect but exhibited significant discomfort-by-time interactions, indicating that saccadic behavior adapts dynamically rather than responding uniformly to discomfort. Gaze allocation was not associated with discomfort but shifted systematically with time. These findings show that cybersickness does not uniformly disrupt gaze. Instead, different aspects of eye-movement behavior respond differently and change in ways that only become visible when discomfort is tracked repeatedly over time. Understanding how gaze evolves during cybersickness progression provides the behavioral grounding needed to better interpret how discomfort shapes the user's visual experience of immersive environments and to design more sensitive detection approaches.

0.32

Effects of Locomotion and Viewpoint Control on Immersive Robot Telepresence for Navigation and Inspection

cs.RO cs.HC ·2026-11-18 ·Ammaar Zaman, Neven ElSayed, Oliver Prentner, Mohamed Ellethy, Mostafa M. Lotfy +2 more
similarity 0.63
Abstract

In many robot telepresence interfaces, movement and viewing are managed through handheld inputs. This can divide attention between steering, looking, and inspection. We compared joystick versus omnidirectional treadmill locomotion and joystick-based versus head-guided camera control in a within-subject 2x2 study in which 17 participants used a virtual reality headset to guide a quadruped robot through a physical maze while locating marked wall symbols and capturing them as visual evidence. Mixed-effects analyses showed that head-guided camera control was associated with faster completion, lower wall-contact cost, lower workload, and more favorable presence, usability, technology acceptance, and flow than joystick-based camera control. The strongest overall objective performance was observed in the joystick locomotion plus head-guided camera condition, whereas the omnidirectional treadmill plus head-guided camera condition emerged as the strongest experiential compromise. Exploratory camera analyses showed that head-guided camera control reduced switching, increased reliance on the pan-tilt view, and supported a more stable viewing strategy across the maze. These strategy differences were consistent with the performance advantage, especially for wall-contact duration. Targets captured remained near ceiling and simulator sickness remained low across all conditions. Overall, the results indicate that viewpoint control was the stronger differentiator in this combined navigation and inspection task, while locomotion still shaped the objective and experiential tradeoff.

0.29

An Eye-Tracking Dataset for Viewing Distance Categories in Real-World Scenarios

cs.HC ·2026-08-29 ·Dohwa Kim, Yejin Choi, Seungbok Lee, Chi Yoon Jeong, Eunji Park
dataset similarity 0.63
Abstract · 22 pages, 6 figures, Manuscript submitted to Scientific Data

Estimating viewing distance from gaze behavior is essential for understanding user intent and enabling distance-aware interactive systems. However, most existing eye-tracking datasets have been collected in constrained settings, such as laboratory environments or static tasks. Consequently, they only partially capture viewing behaviors in real-world situations where viewing distance changes with natural head and body movements. We introduce GazeDepth, an eye-tracking dataset collected from 19 participants using a wearable tracker during tasks reflecting real-world scenarios. GazeDepth includes fixed-distance viewing scenarios with constant observer-target distances at near (33 cm), middle (50 cm), and far (300 cm), as well as variable-distance viewing scenarios in which participants shift gaze among targets at different depths in indoor and outdoor environments. The dataset provides synchronized gaze data, pupil size, 3D eye-vectors, and head-motion signals, along with distance labels. Statistical analyses showed that distance-related gaze features, such as vergence angle and estimated viewing distance, differed consistently across viewing-distance categories. In addition, classification models trained on GazeDepth further demonstrated that the dataset captures gaze characteristics that distinguish the three viewing-distance categories, supporting gaze-based distance inference and distance-aware interaction in realistic scenarios.

0.26

Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning

cs.RO ·2026-09-28 ·Yihan Zhou, Rui Yan, Mingcong Li, Zheyuan Huang, Xu Yang +2 more
dataset similarity 0.62
Abstract

Vision-Language-Action (VLA) fine-tuning pairs images with actions at every step, yet typically provides only a task-level language instruction, leaving moment-to-moment visual relevance implicit. We introduce \emph{eye-tracker-supervised gaze prompting}, which uses gaze recorded during VR teleoperation to provide frame-level visual guidance for VLA fine-tuning. During training, recorded gaze locations are rendered as crosshairs on the robot's head-camera images. At deployment, a lightweight predictor estimates gaze locations from recent images and the instruction, supplying the same type of visual prompt without an eye tracker or changes to the policy architecture. Instantiated with $π_0$, gaze prompting increases mean success from $26.3\%$ to $56.0\%$ across six real-world bimanual manipulation tasks, with gains also observed when a single policy is trained on all six tasks. We release \textsc{GazeMani}, a dataset of $1{,}200$ teleoperated trajectories with synchronized gaze.

0.41

A Biomimetic Gaze Control to Restore Head-Neck Movements

cs.RO ·2026-10-02 ·Colin Rubow, Haohan Zhang
top venue similarity 0.62
Abstract

Powered neck exoskeletons are developed to restore head-neck motions for those with neck muscle weakness. Current methods using hand-held input devices to control these robotic systems are unintuitive or non-viable for these populations. Alternatively, the eyes coordinate with the head to accomplish many daily tasks. Therefore, movements of the eyes can be a useful signal to control the neck exoskeletons without needing to use the hands. However, previous control models lack biobehavioral basis as well as means to personalize the control behavior, causing unnatural head-neck movements. This paper presents a novel eye-tracking controller design leveraging the vestibulo-ocular reflex to emulate natural eyehead coordination. Personalization tools were also designed, consisting of sliders to allow users to adjust the parameters of this controller. Here, we present the technical design and validation of this system in human users. Compared to the previous eye-tracking model, the new controller provides natural head motions personalized to the user through more natural velocity profiles and a 24 percent average increase of accurate motion intent detection. This system provides a powerful platform for studying eye-tracking controllers in the context of personalization and preference, and ultimately restoring the lost head-neck mobility in patient populations.

0.51