CS Paper Radar

Ageing, Digital Literacy, and Interaction Modality in Immer-sive Virtual Reality: Psychomotor Performance, Cognitive Flexibility, and Their Processing-Speed Association

Panagiotis Kourtesis, Katerina Denaxa, Lydia Asimakopoulou, Petros Roussos, Maria Roussou

cs.HC cs.CY ·submitted 2026-09-17 17:15 UTC · v2
published

Abstract

Extended reality (XR) increasingly supports training and cognitive assessment, yet the age sensitivity of its interaction techniques is unclear. This study examined age, digital literacy, and interaction modality as correlates of psychomotor and cognitive-flexibility performance in immersive virtual reality (VR). Two hundred and two adults (19-90 years) completed a five-mode Fitts' law task (eye-gaze, head-gaze, controller ray-casting, virtual finger, and controller direct touch), the Trail Making Test in VR (TMT-VR), and a digital-literacy questionnaire. Age was associated with slower task times across modes, but controller direct touch carried the steepest relative age gradient yet remained among the fastest in absolute terms; technique altered relative age sensitivity without determining absolute efficiency. Higher digital literacy was associated with faster TMT-VR completion but not Fitts task times. A Fitts-derived speed score predicted TMT-VR performance beyond age and partly accounted for its age association, consistent with shared processing-speed variance; an exploratory full-battery extension confined the Fitts-score association to completion-time and error-adjusted-time indices and the digital-literacy association to error-adjusted-time indices, not wrong-target errors, mean selection distance, or relative Part B indices. Age-inclusive XR assessment should standardise interaction modality, evaluate rather than exclude mid-air direct selection, and interpret cognitive scores alongside digital literacy and psychomotor speed.

Comment
27 pages, 5 figures, 6 Tables

Closest papers

Nearest neighbours by meaning across the whole index.

Usability, User Experience, and Acceptability of the Trail Making Test in Virtual Reality in Younger and Older Adults

cs.HC cs.CY ·2026-10-16 ·Panagiotis Kourtesis, Dante O'Connor, Sarah E. MacPherson
similarity 0.78
Abstract · 20 pages, 3 figures, 4 tables, supplementary material are included

Immersive virtual reality (VR) adaptations of neuropsychological tests change how a test operates. Before their scores are interpreted, the individuals they are intended to assess should find them usable, acceptable and tolerable, and for older adults this evidence is usually missing. This study evaluated the experience of the Trail Making Test in Virtual Reality (TMT-VR), a head-gaze adaptation of the Trail Making Test that requires no hand-held controller, in 47 younger (20-38 years) and 44 older adults (64-81 years). After the task, participants rated usability, pragmatic and hedonic user experience, acceptability, and cybersickness. The study had three aims: to compare the two age groups on these ratings; to examine whether the ratings were associated with age group, gaming and technology experience, and whether cybersickness was associated with motion sickness susceptibility; and to examine whether the ratings were related to TMT-VR completion and error-adjusted times. Both groups rated the TMT-VR as highly usable, acceptable and pleasant to use. Older adults gave slightly lower usability and pragmatic ratings, but neither the age-group differences nor the associations with age group or previous experience were statistically significant after correction. Cybersickness was low, with 38 of the 91 participants reporting no symptoms; it did not differ between the age groups and was not associated with motion sickness susceptibility. No correlation between the ratings and TMT-VR performance survived correction. The TMT-VR with head-gaze selection is therefore usable, acceptable and well tolerated by older as well as younger adults. Because the ratings were favourable across the whole range of TMT-VR scores, slower or less accurate performance is unlikely to reflect difficulty with the interface.

0.37

Trail Making Tests in Extended Reality: A Critical Review with Implications for Cognitive Ageing

cs.HC cs.CY ·2026-11-08 ·Panagiotis Kourtesis
similarity 0.74
Abstract · Review article. 22 pages, 1 figure, 4 tables; Supplementary Materials (19 pages); ancillary files: the Supplementary Materials (PDF), File S…

Extended reality (XR) versions of the Trail Making Test and Color Trails Test are promising for assessing and training cognition in older adults. However, each XR adaptation is a new instrument, whose display, interaction technique, timing rules and layouts may change what it measures. This critical narrative review maps these implementations by software lineage and appraises their evidence for assessment and training against common criteria. The Trail Making Test in Virtual Reality (TMT-VR), whose source code was inspected, serves as a measurement case. XR trail-making tests showed convergence with paper and computerised versions, varying by test part and sample, and clinical group differences (e.g., Parkinson's disease, mild cognitive impairment). However, gaps in reliability (e.g., randomised forms), validation (e.g., norms, prospective samples) and reporting (e.g., error handling, build identity) emerged, and no training benefit attributable to the trail-making component was identified. The TMT-VR case shows how interaction technique, timing rule, error handling and unlogged layouts shape a score's meaning. Future tests should log layouts and events, estimate alternate-form reliability and undergo prospective validation, and training trials should isolate the trail-making component. Several XR trail-making tests have moved beyond feasibility, and reported tolerability during supervised sessions supports further evaluation in older adults.

0.13

AdaptType: Accessible and Customizable Multimodal Text Entry in Virtual Reality for People with Upper-Body Motor Impairments

cs.HC ·2026-11-14 ·Junhan Kong, Mingyuan Zhong, Sanjana Pavani, Jacob O. Wobbrock
similarity 0.62
Abstract

Text entry in virtual reality (VR) is cumbersome, especially for people with upper-body motor impairments. Existing techniques often demand both fine and gross motor control, yet users' motor abilities vary widely. To address this range of needs, we present AdaptType, a multimodal VR text entry system that enables users to configure input techniques that best suit their abilities, and scaffolds customization through ability-based recommendations. Through a study with 10 participants, we found that customized multimodal techniques improved text entry speed compared to gaze- or hand-only techniques, and complemented voice for error correction, decreasing failure rate from 15.1% to 2.0%. We found that AdaptType yielded high text entry speed (36.26 WPM) and accuracy (0.36% error rate), with low task load and high usability ratings. We also found ability-based recommendations effectively scaffolded customization. Our work contributes more accessible and personalized VR text entry solutions for people with upper-body motor impairments.

0.24

Comparing Hand and Controller Avatars with Hand Tracking and Controller-Based Interaction

cs.HC ·2026-09-18 ·Natalia Ocampo, J. Felipe Gonzalez, Robert J. Teather
top venuehighly cited similarity 0.60
Abstract

Previous research suggests that the congruency between common VR input devices - such as controllers or hand tracking - and their visual representations (e.g., hand or controller avatars) influences user experience and performance. However, the specific effects of input-avatar combinations remain underexplored. We study the effects of common input devices (hand tracking and controllers) and visual representations (hand and controller avatars) on performance and perceived success in target acquisition tasks. We included both grasping and pinching gestures across 16 combinations of input, avatar, and target size. Results indicate that hand tracking benefits from any form of visual representation - even when mismatched - achieving up to 5.8% greater accuracy compared to having no avatar, likely due to its reliance on visual feedback in the absence of a physical prop. Controllers were generally preferred and offered faster task completion. However, mismatched avatars had a stronger negative effect with controllers, particularly when the virtual gesture did not align with the physical action, leading to a 5.6% drop in accuracy compared to the matched condition - suggesting that inaccurate feedback can be more disruptive than having no avatar feedback at all.

0.65

C-LISTEN: Cognitive Load Impacts of Sensory-Triggered Environmental Navigation in Virtual Reality

cs.HC ·2026-09-29 ·Md. Monowar Hossain, M. Rasel Mahmud
top venue similarity 0.59
Abstract · 6 pages. Published in AIVR 2026, The Third International Conference on Artificial Intelligence and Immersive Virtual Reality, Lisbon, Portug…

Nowadays, Virtual Reality (VR) systems are more helpful for making decisions, training, and rehabilitation. Multimodal settings in these systems impose a significant balance and cognitive difficulties. Additionally, decreased performance, higher cognitive load, user overwhelm, and limited accessibility of VR technology can be caused by excessive auditory, visual, and sensory stimulation. In our pilot study, we examine the strategic design of directional auditory cues to improve cognitive load and enhance user experience in virtual environments. This research also enhances fundamental knowledge that auditory feedback reduces cognitive load in VR, with statistical analysis confirming this improvement (p = .0011). This study investigates how postural balance and pupil diameter correlate with cognitive load while the users navigate. Moreover, this study provides realistic overview design guidelines for accessibility, which will make VR experiences safer and more useful for everyone, including people with cognitive impairments.

0.49

Game-Based versus Training-Based Virtual Reality for Cognitive Rehabilitation in Mild Cognitive Impairment and Dementia: A Systematization of Design Paradigms, Outcomes, and Evaluation Rigor

cs.HC ·2026-09-29 ·Anowarul Faruk Shishir, M. Rasel Mahmud
published similarity 0.58
Abstract · Accepted at the 32nd ACM Symposium on Virtual Reality Software and Technology (VRST 2026)

Therapeutic exercises can help slow cognitive decline in dementia, but conventional programs are often tedious and difficult to sustain. Virtual reality (VR) offers an alternative through game-based approaches designed to improve engagement and training-based approaches focused on structured functional recovery. Prior reviews report inconsistent findings about these paradigms, while it remains unclear whether the labels represent systems that are technologically distinct. Following PRISMA 2020 guidelines, we systematize 34 studies published between 2015 and 2026, including 16 controlled efficacy trials and 18 design and feasibility studies involving mild cognitive impairment, dementia and Alzheimer's disease. We develop a taxonomy covering design paradigm, immersion, feedback modality, difficulty adaptation and hardware. Our analysis shows substantial overlap between game-based and training-based systems, suggesting that these labels do not clearly distinguish their technological characteristics. We also introduce VR-RES, a seven-dimensional framework for evaluating study quality. Its application highlights recurring limitations in the evidence base, particularly limited follow-up, poor reproducibility and insufficient analysis of demographic factors such as age, sex and education. Based on these findings, we provide recommendations for future VR cognitive rehabilitation research, emphasizing specific design features, rigorous evaluation and improved reporting practices.

0.41

Evaluating the Impact of Adaptive Extended Reality on Human-Robot Interaction Across the Reality-Virtuality Continuum

cs.RO cs.HC ·2026-09-25 ·Carl Tornberg, Alicia Torck, Lotfi El Hafi, Tadahiro Taniguchi
code/data similarity 0.58
Abstract · Submitted to Advanced Robotics, Special Issue on "Next Generation Cognitive Robotics: Nurturing Embodied Intelligence for a Symbiotic Future…

As populations in developed countries age and labor shortages intensify, Cybernetic Avatars (CAs) are proposed to extend human capabilities through robotic embodiments, requiring effective Human-Robot Interaction (HRI) frameworks. Extended Reality (XR), an umbrella term for Augmented Reality (AR), Augmented Virtuality (AV), and Virtual Reality (VR), offers such interfaces, but prior research typically fixes the XR modality without evaluating its effect on task outcomes. This study examines whether the XR modality impacts HRI performance and whether an adaptive interface adjusting the level of virtuality along the Reality-Virtuality Continuum (RVC) at runtime improves it. A custom XR application interfaced with a mobile manipulator supports immersive control and runtime modality switching. In a within-participant multi-room pick-and-place experiment comparing fixed AR, AV, and VR with dynamic RVC through task metrics, the NASA-TLX, and the System Usability Scale (SUS), this study demonstrates that 1) the fixed reality modality affects HRI results, and 2) dynamically changing the modality along the RVC improves them. AR yielded significantly lower mental demand, effort, and frustration than AV and VR, while the dynamic RVC condition achieved the highest throughput and lowest workload, highlighting the value of adaptive XR interfaces for human-robot symbiosis. The implementation is available at https://github.com/CarlTornberg/XR-HRI.

0.38

AI-Adaptive Virtual Reality for STEM: Engagement, Retention, and Learning Outcomes

cs.ET ·2026-11-10 ·Srinivasa K G, Akshit Rana, Aman Singh, Kshitij Kumar Singh Chauhan
similarity 0.58
Abstract

Virtual Reality (VR) presents a com pelling opportunity to transform STEM pedagogy; however, empirical evidence evaluating AI-driven adaptivity, objective engagement metrics, and long-term knowledge retention remains sparse. This paper proposes and evaluates an AI-adaptive VR based solar system learning module deployed on Meta Quest 2, wherein a machine learning model dynamically adjusts in structional difficulty based on real-time learner interaction logs including dwell time, gaze patterns, and response latency. A controlled between-subjects experiment was conducted involving 120 secondary school students (mean age 14.3 years) across three schools in India, randomly assigned to three conditions: AI adaptive VR, standard VR, and traditional classroom instruction. Engagement was measured objectively through eye-tracking fixation density and heart rate variability (HRV), alongside pre-test, immediate post-test, and delayed post-tests at one week and one month intervals. Statistical analyses encompassing paired t-tests, one-way ANOVA, and Structural Equation Modeling (SEM) reveal that the AI-adaptive VR cohort demonstrated significantly higher knowledge improvement scores (mean gain = 38.4 vs. 31.2 vs. 10.7), superior one-month retention (p < 0.001), and measurably elevated engagement across all biometric indicators. SEM confirmed immersion as a significant mediator between adaptive instruction and knowledge acquisition (\b{eta} = 0.63, p < 0.001). Post-session self-directed learning exploration was recorded at 80% among AI-adaptive VR participants versus 40% in the traditional group. These findings establish an evidence based framework for deploying AI-adaptive immersive learning environments in resource-varied STEM educational contexts.

0.25