CS Paper Radar

C-LISTEN: Cognitive Load Impacts of Sensory-Triggered Environmental Navigation in Virtual Reality

Md. Monowar Hossain, M. Rasel Mahmud

cs.HC ·submitted 2026-09-29 21:47 UTC · v1
top venue

Abstract

Nowadays, Virtual Reality (VR) systems are more helpful for making decisions, training, and rehabilitation. Multimodal settings in these systems impose a significant balance and cognitive difficulties. Additionally, decreased performance, higher cognitive load, user overwhelm, and limited accessibility of VR technology can be caused by excessive auditory, visual, and sensory stimulation. In our pilot study, we examine the strategic design of directional auditory cues to improve cognitive load and enhance user experience in virtual environments. This research also enhances fundamental knowledge that auditory feedback reduces cognitive load in VR, with statistical analysis confirming this improvement (p = .0011). This study investigates how postural balance and pupil diameter correlate with cognitive load while the users navigate. Moreover, this study provides realistic overview design guidelines for accessibility, which will make VR experiences safer and more useful for everyone, including people with cognitive impairments.

Comment
6 pages. Published in AIVR 2026, The Third International Conference on Artificial Intelligence and Immersive Virtual Reality, Lisbon, Portugal, April 19-23, 2026
Journal ref
AIVR 2026, The Third International Conference on Artificial Intelligence and Immersive Virtual Reality, pp. 10-15, 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Audiovisual Disparities in VR: Impact on Spatial Perception

cs.GR ·2026-11-06 ·Edurne Bernal-Berdun, Mateo Vallejo, Qi Sun, Ana Serrano, Diego Gutierrez
top venue similarity 0.70
Abstract · 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Virtual reality (VR) experiences often leverage rich and spatialized multimodal environments to increase immersion and engagement. This demands a consistent spatial perception of audiovisual stimuli, since perceived discrepancies can disrupt the sense of presence. In this work, we investigate the consequences of two types of spatial audiovisual disparities: true disparity, where there is a measurable spatial offset between auditory and visual cues, and perceptual disparity, where users report misalignment despite cues being colocated. Unlike most previous studies that employed controlled but simplified experimental setups, our research focuses on complex, realistic VR environments, allowing us to assess the actual implications for VR content design. Our experiments indicate that users are highly sensitive to true audiovisual disparities in controlled environments, detecting even minor misalignments. However, when engaged in additional tasks within realistic settings, their ability to notice such discrepancies diminishes significantly. We also observed that previously found perceptual disparities persist in complex audiovisual environments. However, we identify self-initiated head rotations as a key factor; its absence prevents the effect entirely. We hope our findings offer practical insights for designing more immersive and perceptually coherent VR experiences.

0.58

Auditory and Visual Virtualization in 6DoF XR: Effects on Plausibility and Dynamic Auditory Distance Perception

eess.AS ·2026-11-05 ·Johannes M. Arend, Christian Scheer, Melissa Ramírez, Stefan Weinzierl, Fabian Brinkmann
similarity 0.67
Abstract · Submitted to a peer-reviewed journal

Extended reality (XR) enables controlled yet naturalistic multisensory experiments, but its validity depends on whether virtualized cues are perceptually plausible and lead to behavior comparable to the real world. To the best of our knowledge, this is the first study to perceptually evaluate a six-degree-of-freedom (6DoF) XR system that combines real-time room acoustic simulation, binaural rendering, and an audio-visually matched virtual replica of a large laboratory room in terms of both plausibility and behavior. In two experiments with 45 participants, we investigated how auditory and visual virtualization affect plausibility and dynamic auditory distance perception (ADP). A plausibility experiment compared real and virtual sound sources in audio-augmented reality (AAR) and virtual reality (VR), while a locomotion-based ADP experiment assessed distance-judgment accuracy, signed error, and task effort across four virtualization conditions. The system produced plausible binaural rendering in both AAR and VR, with higher plausibility in VR, indicating that perceptual requirements for XR audio depend on the visual reference frame. In the ADP task, any form of virtualization reduced accuracy and increased effort, although performance remained high overall. Virtual audio produced a bias toward nearer perceived source distances, whereas visual-only virtualization reduced accuracy without a significant directional bias. These effects did not add up in full VR. Overall, the findings demonstrate the strong potential of current 6DoF XR systems for interactive perceptual research, while revealing that task-specific behavioral validation may be necessary.

0.31

Tactile Search: Enhancing Targeting in 3D Space

cs.HC ·2026-09-05 ·Amber Maimon, Iddo Yehoshua Wald, Jonas Keppel, Eunhee Chang, Yoshifumi Kitamura +3 more
top venue similarity 0.64
Abstract · Accepted to the 2026 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2026)

Visual search is crucial in daily life, from scanning for relevant information to spotting signs of danger. When sensory channels are overloaded or degraded, cognitive tasks can be supported by crossmodal information representations through vibrotactile cues. We introduce Tactile Search, an approach that uses modulation of frequency and amplitude of vibrations to the hands, for guiding attention to the location of objects in 3D space. We evaluated this approach in a competitive VR game where participants searched for targets using both vision and touch. Across two studies -- an in-the-wild demonstration (n=55) and a controlled laboratory experiment (n=28) -- we found that vibrotactile feedback significantly improved performance and increased user confidence. In the combined haptic condition, performance did not differ across target heights. We further analyzed participants' subjective experiences and search strategies highlighting the benefits of the tactile cues. Our findings suggest that Tactile Search can enhance interaction and provide design considerations for integrating haptic search into interactive systems.

0.24

Slide to Report: Continuous Reporting Symptom-Specific Cybersickness in VR

cs.HC ·2026-11-05 ·Purnata Saha, Rifatul Islam, Qiliang He, John Quarles
similarity 0.64
Abstract

Cybersickness is often assessed during VR exposure through discrete overall sickness, which cannot capture specific symptoms or their changes over time. Post-exposure questionnaires such as the Simulator Sickness Questionnaire provide symptom-specific measures but cannot be collected during immersion. We investigate whether separating cybersickness into three symptom-specific dimensions -- nausea, oculomotor discomfort, and disorientation -- during immersion provides more informative continuous measurements. We conducted a between-subjects study with 52 participants in a VR-rollercoaster, comparing a three-slider interface with a single-slider interface. Concurrently, participants also completed an auditory Simon task to measure attention. We additionally collected multimodal set of physiological signals, including GSR, ECG, PPG, eye and head tracking. Results show that each slider correlated most strongly with its corresponding SSQ subscale, whereas the single slider correlated with all SSQ subscales. Using three sliders did not significantly affect usability, workload, or attention. We publicly release the multimodal dataset to support future cybersickness research.

0.20

Reflective Nature Experiences in Virtual Reality

cs.HC ·2026-11-05 ·Shiva Ghasemi, Maddie Oehler, Annie Xenakis, Jeffrey Jiarui Yang, Scott McCrickard
published similarity 0.62
Abstract

This paper presents the design and evaluation of an accessible virtual reality (VR) nature experience developed to promote mindfulness, reduce stress, and support emotional well-being. The system immerses users in a calming natural environment through realistic landscapes, ambient soundscapes, guided breathing exercises, and interactive checkpoints that encourage reflection. Accessibility was a central design consideration, particularly for users with diverse physical and sensory abilities or limited access to natural environments and traditional mindfulness resources. A pilot study with 10 participants indicated that the experience could support relaxation and emotional well-being. Participants also reported greater immersion with continuous movement than with teleportation, highlighting the importance of intuitive locomotion in designing inclusive, nature-based VR experiences for mindfulness and stress reduction.

0.30

Steering Versus Teleporting in Mobile Virtual Reality

cs.HC ·2026-09-24 ·Kristen Grinyer, Daniel Zielasko, Robert J. Teather
published similarity 0.62
Abstract · to appear in VRST 2026

Mobile virtual reality (MVR) provides low-cost access to extended reality (XR), but its limited input restricts use of common locomotion techniques such as head-decoupled and velocity-controlled steering. Using a low-cost controller with an audio-based button, we compared gaze- and controller-directed steering and teleportation in MVR. We included a controller pitch-based speed-control technique enabling continuous head-decoupled steering. Performance and participant feedback indicate that gaze was better suited to teleportation, whereas controller pointing better supports steering in primed search. We compare with similar techniques in standard VR and derive design considerations for low-cost, narrow-FOV hardware, demonstrating the potential to support varied travel techniques and velocity control in low-fidelity XR.

0.36

Usability, User Experience, and Acceptability of the Trail Making Test in Virtual Reality in Younger and Older Adults

cs.HC cs.CY ·2026-10-16 ·Panagiotis Kourtesis, Dante O'Connor, Sarah E. MacPherson
similarity 0.61
Abstract · 20 pages, 3 figures, 4 tables, supplementary material are included

Immersive virtual reality (VR) adaptations of neuropsychological tests change how a test operates. Before their scores are interpreted, the individuals they are intended to assess should find them usable, acceptable and tolerable, and for older adults this evidence is usually missing. This study evaluated the experience of the Trail Making Test in Virtual Reality (TMT-VR), a head-gaze adaptation of the Trail Making Test that requires no hand-held controller, in 47 younger (20-38 years) and 44 older adults (64-81 years). After the task, participants rated usability, pragmatic and hedonic user experience, acceptability, and cybersickness. The study had three aims: to compare the two age groups on these ratings; to examine whether the ratings were associated with age group, gaming and technology experience, and whether cybersickness was associated with motion sickness susceptibility; and to examine whether the ratings were related to TMT-VR completion and error-adjusted times. Both groups rated the TMT-VR as highly usable, acceptable and pleasant to use. Older adults gave slightly lower usability and pragmatic ratings, but neither the age-group differences nor the associations with age group or previous experience were statistically significant after correction. Cybersickness was low, with 38 of the 91 participants reporting no symptoms; it did not differ between the age groups and was not associated with motion sickness susceptibility. No correlation between the ratings and TMT-VR performance survived correction. The TMT-VR with head-gaze selection is therefore usable, acceptable and well tolerated by older as well as younger adults. Because the ratings were favourable across the whole range of TMT-VR scores, slower or less accurate performance is unlikely to reflect difficulty with the interface.

0.37

Moving Beyond the Flat Screen: Opportunities and Challenges of Extended Reality for Studying Human Brain and Behavior

cs.HC ·2026-10-13 ·Tom Bullock, Radha Kumaran, You-Jin Kim, Emily Machniak, Tobias Höllerer +1 more
published similarity 0.61
Abstract · 4 pages, 1 figure. Workshop paper presented at the NeuroXR 2026 Workshop at IEEE ISMAR 2026 (ISMAR-Adjunct)

Much of what we know about human perception and cognition comes from austere experimental settings: static stimuli presented to sedentary observers on flat monitors, complex responses reduced to simple button presses, and brain activity recorded from immobilized heads using EEG or fMRI. These highly controlled paradigms have provided remarkable insights, but capture a small and often unusual slice of behavior, raising questions about how well the findings generalize to the real world. Extended reality (XR), spanning both immersive virtual reality (VR) and augmented reality (AR) that overlays digital content on the real world, offers a way beyond these constraints, supporting controlled, reproducible experiments in which participants actively engage with three-dimensional tasks. Drawing on a growing body of VR and AR studies of attention, memory, and language -- our own and others', some involving EEG -- we outline what XR makes newly possible for cognitive neuroscience and reflect on the practical and conceptual obstacles that remain. The opportunities are substantial, but realizing them requires solving practical problems of hardware, timing, and measurement, and being realistic about what a virtual or augmented world can and cannot stand in for.

0.40