CS Paper Radar

Unpacking the process of watching a 360-degree video: How physiological responses and head rotation relate to affective and cognitive outcomes

Portia Wang, Yujie Tao, Monique Santoso, Jeremy Bailenson

cs.HC ·submitted 2026-10-30 20:34 UTC · v1

Abstract

A defining feature of 360-degree video is that the perceptual experience is actively constructed. As viewers turn their heads, shift their gaze, and encounter changing visuals, their perceptual experience is not predetermined, but rather emerges through ongoing exploration. Yet, it is unclear how the process of watching immersive videos unfolds, and how it is related to psychological and physiological outcomes. We present a large-scale study (N=200) in which participants experienced one of 10 pieces of 360-degree videos in virtual reality. Results showed that greater head rotation was associated with greater valence, higher attention focus, longer length of subjective review, and lower simulator sickness; greater pupil dilation was associated with lower valence, lower review ratings, and greater use of negative tone in written reviews. A mediation analysis revealed that participants who rotated their heads more experienced greater frame-to-frame pixel-level perceptual changes in their field of view, which in turn resulted in greater valence and lower simulator sickness. Moreover, participants tended to rotate their heads toward field of view regions with greater perceptual movement, while directing their eye gaze toward less perceptually dynamic areas within that view. We outline theoretical and practical contributions for designing 360-degree content and predicting experiential outcomes.

Closest papers

Nearest neighbours by meaning across the whole index.

Gaze Under Strain: How Oculomotor Behavior Tracks Cybersickness Progression in VR

cs.HC ·2026-10-23 ·Nevzat Umut Demirseren, Mehedi Hasan Raju, Oleg Komogortsev, Isayas Berhe Adhanom
published similarity 0.69
Abstract · Accepted for publication at ACM VRST 2026. 10 pages, 4 figures

Cybersickness remains a major barrier to comfortable, accessible virtual reality (VR). Arising from mismatches between visual and vestibular signals, it places sustained demands on gaze stabilization and visual processing. Because gaze is the mechanism through which users actively sample the virtual environment, cybersickness-induced disruptions may alter both what users perceive and how discomfort itself emerges. Yet, how eye-movement behavior evolves alongside discomfort during prolonged VR exposure remains poorly understood. We present a behavioral analysis of eye-tracking data from 19 participants navigating a realistic virtual environment over a 20-minute session, with discomfort rated repeatedly throughout the experiment. Linear mixed-effects models examined gaze constructs spanning fixation stability, visual exploration, and gaze allocation as functions of discomfort, exposure duration, and their interaction. Our results show that fixation stability degraded progressively with increasing discomfort, with the effect strengthening over time. Visual exploration showed no marginal discomfort effect but exhibited significant discomfort-by-time interactions, indicating that saccadic behavior adapts dynamically rather than responding uniformly to discomfort. Gaze allocation was not associated with discomfort but shifted systematically with time. These findings show that cybersickness does not uniformly disrupt gaze. Instead, different aspects of eye-movement behavior respond differently and change in ways that only become visible when discomfort is tracked repeatedly over time. Understanding how gaze evolves during cybersickness progression provides the behavioral grounding needed to better interpret how discomfort shapes the user's visual experience of immersive environments and to design more sensitive detection approaches.

0.32

Exploring spatial configuration and group familiarity when co-watching 360-degree stories in social virtual reality

cs.HC ·2026-10-21 ·Portia Wang, Monique Santoso, Yujie Tao, Jeremy Bailenson
similarity 0.67
Abstract

While traditional cinematic viewing is often characterized as a social experience, engaging with immersive stories is predominantly researched as an individual activity. This mismatch becomes increasingly problematic in social virtual reality (VR), where features designed for typical social activities (e.g., virtual locomotion, spatial and social context) can become meaningful levers for shaping the user experience. To address our limited understanding of these effects, we conducted three exploratory experiments (N$_1$=109, N$_2$=116, N$_3$=88) examining how spatial boundary type, size of allocated personal space, and group familiarity influence co-watching 360-degree stories in social VR. Results shows that small communal spatial boundaries heightened social presence towards others compared to individual boundaries, but also increased mental demand. Reducing the size of the personal spatial boundary increased social presence towards others but also increased disorientation and frustration. Finally, participants with higher group familiarity reported stronger attentional focus on the story, as well as higher spatial presence and social presence towards story characters, but also reported greater physical and perceptual demand. We discuss systematic tradeoffs between engagement and cognitive effort, and suggest practical guidelines for designing shared immersive narrative experiences.

0.37

How Early Can You Tell? Early Eye Gaze Dynamics and Cybersickness Progression in Virtual Reality

cs.HC ·2026-09-21 ·Nevzat Umut Demirseren, Isayas Berhe Adhanom
similarity 0.65
Abstract · 6 pages, 3 figures

Cybersickness remains one of the primary barriers to prolonged and comfortable virtual reality (VR) use, yet the temporal development of cybersickness remains poorly understood because its onset and progression vary substantially across individuals. Eye tracking provides a continuous and unobtrusive measure of user behavior, making it well suited for investigating how users respond throughout VR exposure. However, existing work has mainly focused on aggregate gaze measures or post-exposure assessments, leaving the relationship between early eye-movement dynamics and discomfort progression underexplored. In this paper, we investigate whether early eye-movement dynamics characterize the subsequent progression of cybersickness. Using trajectories of fixation duration, fixation dispersion, saccade amplitude, saccade velocity, and gaze eccentricity computed over the first one to five minutes of VR exposure, we evaluate their association with subsequent discomfort progression and compare early gaze dynamics between participants with low and high post-exposure cybersickness severity. Our results show that early fixation dispersion is consistently associated with subsequent discomfort progression, whereas no significant differences are observed between cybersickness severity groups. These findings suggest that early fixation dispersion can characterize the progression of discomfort rather than the final cybersickness severity. Overall, this work provides new insight into the temporal relationship between early eye-movement behavior and cybersickness progression, contributing to the understanding of gaze dynamics during immersive experiences.

0.19

Passthrough Rigidity: The Behavioral and Visuomotor Costs of Mediated Perception

cs.HC ·2026-09-21 ·Markus D. Solbach, Mohit Goyal, Sakar Khattar, Jayant Varma, Bjorn Vlaskamp +2 more
publishedcode/data similarity 0.64
Abstract · 10 pages, 16 Figures, ISMAR

Broad public adoption of head-mounted displays using video passthrough remains elusive despite significant market investment. A precise understanding of why users experience persistent discomfort even as hardware factors such as resolution and latency have dramatically improved remains an open issue. This paper investigates the impact of viewing the world through video passthrough systems on human behavioral and physiological patterns through a large-scale multimodal study. We developed a novel protocol to capture synchronized oculomotor, kinematic, and physiological data during a block assembly task requiring complex hand-eye coordination. Using a within-subject design (N=110), we evaluated both natural and passthrough viewing conditions. Our results reveal a four-fold suppression of rotational head velocity and a pronounced decoupling of head-gaze coordination. This suggests motor caution being employed as an adaptive strategy - which we term "Passthrough Rigidity". This phenomenon appears to shift the information-gathering burden to the oculomotor system, resulting in significantly longer fixation durations and restricted visual search patterns. These kinematic shifts directly correlate with poorer task performance and measurable physiological cost, evidenced by a significant reduction in blink duration and increased reports of ocular strain and cognitive load. We conclude that current passthrough implementations induce a measurable shift from flexible exploration to motor caution, where task performance is preserved at the cost of user comfort and biomechanical efficiency. These findings provide a novel quantitative framework for evaluating and improving future XR devices, establishing that resolving "comfort" for passthrough requires addressing the deep-seated biomechanical compensations caused by mediated perception. Data available at https://data.nvision.eecs.yorku.ca/Passthrough

0.29

Slide to Report: Continuous Reporting Symptom-Specific Cybersickness in VR

cs.HC ·2026-11-05 ·Purnata Saha, Rifatul Islam, Qiliang He, John Quarles
similarity 0.64
Abstract

Cybersickness is often assessed during VR exposure through discrete overall sickness, which cannot capture specific symptoms or their changes over time. Post-exposure questionnaires such as the Simulator Sickness Questionnaire provide symptom-specific measures but cannot be collected during immersion. We investigate whether separating cybersickness into three symptom-specific dimensions -- nausea, oculomotor discomfort, and disorientation -- during immersion provides more informative continuous measurements. We conducted a between-subjects study with 52 participants in a VR-rollercoaster, comparing a three-slider interface with a single-slider interface. Concurrently, participants also completed an auditory Simon task to measure attention. We additionally collected multimodal set of physiological signals, including GSR, ECG, PPG, eye and head tracking. Results show that each slider correlated most strongly with its corresponding SSQ subscale, whereas the single slider correlated with all SSQ subscales. Using three sliders did not significantly affect usability, workload, or attention. We publicly release the multimodal dataset to support future cybersickness research.

0.20

Audiovisual Disparities in VR: Impact on Spatial Perception

cs.GR ·2026-11-06 ·Edurne Bernal-Berdun, Mateo Vallejo, Qi Sun, Ana Serrano, Diego Gutierrez
top venue similarity 0.63
Abstract · 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Virtual reality (VR) experiences often leverage rich and spatialized multimodal environments to increase immersion and engagement. This demands a consistent spatial perception of audiovisual stimuli, since perceived discrepancies can disrupt the sense of presence. In this work, we investigate the consequences of two types of spatial audiovisual disparities: true disparity, where there is a measurable spatial offset between auditory and visual cues, and perceptual disparity, where users report misalignment despite cues being colocated. Unlike most previous studies that employed controlled but simplified experimental setups, our research focuses on complex, realistic VR environments, allowing us to assess the actual implications for VR content design. Our experiments indicate that users are highly sensitive to true audiovisual disparities in controlled environments, detecting even minor misalignments. However, when engaged in additional tasks within realistic settings, their ability to notice such discrepancies diminishes significantly. We also observed that previously found perceptual disparities persist in complex audiovisual environments. However, we identify self-initiated head rotations as a key factor; its absence prevents the effect entirely. We hope our findings offer practical insights for designing more immersive and perceptually coherent VR experiences.

0.58

The Relationship Between Blood Pressure and Self-Reported Stress During Sound-Based VR Relaxation Videos

cs.HC ·2026-10-05 ·Md Alamin Hossain, M. Rasel Mahmud
similarity 0.62
Abstract

Virtual reality (VR) relaxation environments are increasingly proposed as accessible tools for stress management, yet the physiological correlates of self-reported stress during VR exposure remain unclear, particularly for blood pressure (BP). We conducted a within-subjects study (N = 18) in which participants viewed relaxing 360-degree videos, grouped into four sound-design categories, such as videos with rhythmic (RHYT), aperiodic (APRD), continuous (CONT), and low-ambient (LOWE) sound through an HTC Vive Focus Vision headset. Systolic (SYS) and diastolic (DIA) BP were recorded after each category using an Omron 3 Series monitor, and self-reported stress was collected via a 0-100 Visual Analogue Scale (VAS) with fixed intervals. While overall BP did not differ significantly across sound categories, self-reported stress did (Friedman chi-square(4) = 12.07, p = .017), with rhythmic sound eliciting significantly lower stress than aperiodic and continuous sound. Critically, DIA, but not SYS, correlated significantly with self-reported stress across conditions (r = .31, p = .003). This suggests that DIA may be a more sensitive physiological indicator of subjective stress than SYS in short VR exposures. We discuss implications for designing and evaluating VR mental health interventions and the value of low-cost physiological sensing alongside self-report.

0.26

Virtual Placebo: a scoping review of control conditions in randomized controlled trials of psychological immersive virtual reality interventions

cs.HC q-bio.NC ·2026-10-23 ·Madis Vasser, Mary-Ann Kubre, Kadi Tulver, Jaan Aru
similarity 0.62
Abstract

Research on immersive virtual reality (IVR) as a therapeutic tool is growing rapidly, with randomized controlled trials (RCTs) now commonplace. Yet the control conditions in many of these studies that claim strong specific IVR effects vary from usual care to active immersive experiences, making it difficult to draw clinically meaningful conclusions. We conducted a scoping review of recent literature on psychological IVR interventions to assess the main forms of control conditions used and their relations to study outcomes. In this paper, we make the case that most of the recent RCTs studying the effects of specific IVR interventions compare active immersive VR to usual care with no multimedia component. This can lead to strong yet potentially misleading study outcomes and can potentially inflate the IVR interventions' effect. Namely, the lack of an appropriate immersive control condition may risk misattributing general effects of VR devices to the specific content of the intervention. In this review, we discuss the implications of these design choices and propose strategies for including a suitable "virtual placebo" condition to improve the methodological rigor and interpretability of results.

0.19