CS Paper Radar

Trail Making Tests in Extended Reality: A Critical Review with Implications for Cognitive Ageing

Panagiotis Kourtesis

cs.HC cs.CY ·submitted 2026-11-08 21:39 UTC · v1

Abstract

Extended reality (XR) versions of the Trail Making Test and Color Trails Test are promising for assessing and training cognition in older adults. However, each XR adaptation is a new instrument, whose display, interaction technique, timing rules and layouts may change what it measures. This critical narrative review maps these implementations by software lineage and appraises their evidence for assessment and training against common criteria. The Trail Making Test in Virtual Reality (TMT-VR), whose source code was inspected, serves as a measurement case. XR trail-making tests showed convergence with paper and computerised versions, varying by test part and sample, and clinical group differences (e.g., Parkinson's disease, mild cognitive impairment). However, gaps in reliability (e.g., randomised forms), validation (e.g., norms, prospective samples) and reporting (e.g., error handling, build identity) emerged, and no training benefit attributable to the trail-making component was identified. The TMT-VR case shows how interaction technique, timing rule, error handling and unlogged layouts shape a score's meaning. Future tests should log layouts and events, estimate alternate-form reliability and undergo prospective validation, and training trials should isolate the trail-making component. Several XR trail-making tests have moved beyond feasibility, and reported tolerability during supervised sessions supports further evaluation in older adults.

Comment
Review article. 22 pages, 1 figure, 4 tables; Supplementary Materials (19 pages); ancillary files: the Supplementary Materials (PDF), File S1 (evidence map, XLSX and CSV) and File S2 (XR inventory, XLSX)

Closest papers

Nearest neighbours by meaning across the whole index.

Usability, User Experience, and Acceptability of the Trail Making Test in Virtual Reality in Younger and Older Adults

cs.HC cs.CY ·2026-10-16 ·Panagiotis Kourtesis, Dante O'Connor, Sarah E. MacPherson
similarity 0.76
Abstract · 20 pages, 3 figures, 4 tables, supplementary material are included

Immersive virtual reality (VR) adaptations of neuropsychological tests change how a test operates. Before their scores are interpreted, the individuals they are intended to assess should find them usable, acceptable and tolerable, and for older adults this evidence is usually missing. This study evaluated the experience of the Trail Making Test in Virtual Reality (TMT-VR), a head-gaze adaptation of the Trail Making Test that requires no hand-held controller, in 47 younger (20-38 years) and 44 older adults (64-81 years). After the task, participants rated usability, pragmatic and hedonic user experience, acceptability, and cybersickness. The study had three aims: to compare the two age groups on these ratings; to examine whether the ratings were associated with age group, gaming and technology experience, and whether cybersickness was associated with motion sickness susceptibility; and to examine whether the ratings were related to TMT-VR completion and error-adjusted times. Both groups rated the TMT-VR as highly usable, acceptable and pleasant to use. Older adults gave slightly lower usability and pragmatic ratings, but neither the age-group differences nor the associations with age group or previous experience were statistically significant after correction. Cybersickness was low, with 38 of the 91 participants reporting no symptoms; it did not differ between the age groups and was not associated with motion sickness susceptibility. No correlation between the ratings and TMT-VR performance survived correction. The TMT-VR with head-gaze selection is therefore usable, acceptable and well tolerated by older as well as younger adults. Because the ratings were favourable across the whole range of TMT-VR scores, slower or less accurate performance is unlikely to reflect difficulty with the interface.

0.37

Ageing, Digital Literacy, and Interaction Modality in Immer-sive Virtual Reality: Psychomotor Performance, Cognitive Flexibility, and Their Processing-Speed Association

cs.HC cs.CY ·2026-09-17 ·Panagiotis Kourtesis, Katerina Denaxa, Lydia Asimakopoulou, Petros Roussos, Maria Roussou
published similarity 0.74
Abstract · 27 pages, 5 figures, 6 Tables

Extended reality (XR) increasingly supports training and cognitive assessment, yet the age sensitivity of its interaction techniques is unclear. This study examined age, digital literacy, and interaction modality as correlates of psychomotor and cognitive-flexibility performance in immersive virtual reality (VR). Two hundred and two adults (19-90 years) completed a five-mode Fitts' law task (eye-gaze, head-gaze, controller ray-casting, virtual finger, and controller direct touch), the Trail Making Test in VR (TMT-VR), and a digital-literacy questionnaire. Age was associated with slower task times across modes, but controller direct touch carried the steepest relative age gradient yet remained among the fastest in absolute terms; technique altered relative age sensitivity without determining absolute efficiency. Higher digital literacy was associated with faster TMT-VR completion but not Fitts task times. A Fitts-derived speed score predicted TMT-VR performance beyond age and partly accounted for its age association, consistent with shared processing-speed variance; an exploratory full-battery extension confined the Fitts-score association to completion-time and error-adjusted-time indices and the digital-literacy association to error-adjusted-time indices, not wrong-target errors, mean selection distance, or relative Part B indices. Age-inclusive XR assessment should standardise interaction modality, evaluate rather than exclude mid-air direct selection, and interpret cognitive scores alongside digital literacy and psychomotor speed.

0.50

Game-Based versus Training-Based Virtual Reality for Cognitive Rehabilitation in Mild Cognitive Impairment and Dementia: A Systematization of Design Paradigms, Outcomes, and Evaluation Rigor

cs.HC ·2026-09-29 ·Anowarul Faruk Shishir, M. Rasel Mahmud
published similarity 0.65
Abstract · Accepted at the 32nd ACM Symposium on Virtual Reality Software and Technology (VRST 2026)

Therapeutic exercises can help slow cognitive decline in dementia, but conventional programs are often tedious and difficult to sustain. Virtual reality (VR) offers an alternative through game-based approaches designed to improve engagement and training-based approaches focused on structured functional recovery. Prior reviews report inconsistent findings about these paradigms, while it remains unclear whether the labels represent systems that are technologically distinct. Following PRISMA 2020 guidelines, we systematize 34 studies published between 2015 and 2026, including 16 controlled efficacy trials and 18 design and feasibility studies involving mild cognitive impairment, dementia and Alzheimer's disease. We develop a taxonomy covering design paradigm, immersion, feedback modality, difficulty adaptation and hardware. Our analysis shows substantial overlap between game-based and training-based systems, suggesting that these labels do not clearly distinguish their technological characteristics. We also introduce VR-RES, a seven-dimensional framework for evaluating study quality. Its application highlights recurring limitations in the evidence base, particularly limited follow-up, poor reproducibility and insufficient analysis of demographic factors such as age, sex and education. Based on these findings, we provide recommendations for future VR cognitive rehabilitation research, emphasizing specific design features, rigorous evaluation and improved reporting practices.

0.42

AI-Adaptive Virtual Reality for STEM: Engagement, Retention, and Learning Outcomes

cs.ET ·2026-11-10 ·Srinivasa K G, Akshit Rana, Aman Singh, Kshitij Kumar Singh Chauhan
similarity 0.54
Abstract

Virtual Reality (VR) presents a com pelling opportunity to transform STEM pedagogy; however, empirical evidence evaluating AI-driven adaptivity, objective engagement metrics, and long-term knowledge retention remains sparse. This paper proposes and evaluates an AI-adaptive VR based solar system learning module deployed on Meta Quest 2, wherein a machine learning model dynamically adjusts in structional difficulty based on real-time learner interaction logs including dwell time, gaze patterns, and response latency. A controlled between-subjects experiment was conducted involving 120 secondary school students (mean age 14.3 years) across three schools in India, randomly assigned to three conditions: AI adaptive VR, standard VR, and traditional classroom instruction. Engagement was measured objectively through eye-tracking fixation density and heart rate variability (HRV), alongside pre-test, immediate post-test, and delayed post-tests at one week and one month intervals. Statistical analyses encompassing paired t-tests, one-way ANOVA, and Structural Equation Modeling (SEM) reveal that the AI-adaptive VR cohort demonstrated significantly higher knowledge improvement scores (mean gain = 38.4 vs. 31.2 vs. 10.7), superior one-month retention (p < 0.001), and measurably elevated engagement across all biometric indicators. SEM confirmed immersion as a significant mediator between adaptive instruction and knowledge acquisition (\b{eta} = 0.63, p < 0.001). Post-session self-directed learning exploration was recorded at 80% among AI-adaptive VR participants versus 40% in the traditional group. These findings establish an evidence based framework for deploying AI-adaptive immersive learning environments in resource-varied STEM educational contexts.

0.22

Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks

cs.HC cs.AI ·2026-09-21 ·Muzhe Wu, Zuchen Li, Xu Wang, Anhong Guo
similarity 0.54
Abstract

Visual instructions for physical tasks are typically authored in one context and followed in another, requiring users to translate demonstrated tools, materials, and spatial relationships into their own environment. We introduce Generative Tutorial, a conceptual framework for live visual instruction that depicts intended outcomes and actions within the user's environment and task flow. A formative evaluation of state-of-the-art image and video generation identifies failures and potential benefits across 15 physical tasks. Drawing on these findings, we build an augmented-reality prototype system that proactively generates goal images and demonstration videos using observed workspace context and predicted visual outcomes of preceding actions. A 24-participant lab study found higher task performance quality, greater perceived workspace correspondence, and shorter step-confirmation intervals with the system than with pre-authored guidance. Qualitative findings highlighted how contextual resemblance shapes trust, how generation errors affect interpretation, and how guidance delivery should adapt to users' needs, informing future designs.

0.41

Beyond the Lab: Large-Scale Remote Cybersickness Research in Virtual Reality Using the VERA Platform

cs.HC ·2026-09-04 ·Matt Gottsacker, Gerd Bruder, Daniel Zielasko, Alexander Giovannelli, Ali Haskins +11 more
similarity 0.53
Abstract · This is a preprint of a publication currently under review at IEEE Transactions on Visualization and Computer Graphics (TVCG)

Cybersickness remains a major barrier for the adoption of virtual reality (VR), yet most existing knowledge is derived from laboratory-based studies with relatively small and homogeneous participant samples. In this paper, we investigate whether remote VR studies can produce cybersickness findings comparable to traditional in-lab experiments while enabling larger and more diverse participant populations. Using the Virtual Experience Research Accelerator (VERA), we deployed a remote adaptation of the standardized Cybersicker testbed for cybersickness research and collected data from N=263 participants using their own consumer VR headsets. We compared these results against a previously published in-lab dataset and a demographically matched subset of the remote sample. Across cohorts, cybersickness outcomes were consistent in direction and temporal pattern, including symptom onset trajectories, Fast Motion Sickness Scale (FMS) ratings, and Simulator Sickness Questionnaire (SSQ) responses, supporting the validity of remote cybersickness human-subjects research. Leveraging the larger remote dataset, we additionally examined demographic and individual-difference factors associated with cybersickness. These analyses confirm at scale the effects of sex, sickness susceptibility, and sickness expectation reported in smaller laboratory samples, and they add well-powered evidence on the contested relationship between age and cybersickness. These findings demonstrate that the VERA platform provides a viable means of remotely replicating laboratory-based studies and highlight its ability to support large, demographically diverse participant samples. This work establishes a validated methodological foundation for future large-scale remote studies of cybersickness and other VR research topics.

0.20

Moving Beyond the Flat Screen: Opportunities and Challenges of Extended Reality for Studying Human Brain and Behavior

cs.HC ·2026-10-13 ·Tom Bullock, Radha Kumaran, You-Jin Kim, Emily Machniak, Tobias Höllerer +1 more
published similarity 0.53
Abstract · 4 pages, 1 figure. Workshop paper presented at the NeuroXR 2026 Workshop at IEEE ISMAR 2026 (ISMAR-Adjunct)

Much of what we know about human perception and cognition comes from austere experimental settings: static stimuli presented to sedentary observers on flat monitors, complex responses reduced to simple button presses, and brain activity recorded from immobilized heads using EEG or fMRI. These highly controlled paradigms have provided remarkable insights, but capture a small and often unusual slice of behavior, raising questions about how well the findings generalize to the real world. Extended reality (XR), spanning both immersive virtual reality (VR) and augmented reality (AR) that overlays digital content on the real world, offers a way beyond these constraints, supporting controlled, reproducible experiments in which participants actively engage with three-dimensional tasks. Drawing on a growing body of VR and AR studies of attention, memory, and language -- our own and others', some involving EEG -- we outline what XR makes newly possible for cognitive neuroscience and reflect on the practical and conceptual obstacles that remain. The opportunities are substantial, but realizing them requires solving practical problems of hardware, timing, and measurement, and being realistic about what a virtual or augmented world can and cannot stand in for.

0.40

MemTransfer: Benchmarking Memory Beyond Matched Experience in Embodied Decision-Making

cs.RO ·2026-09-26 ·Haiming Tang, Xianjie Dai, Gujie Shao, Zuyi Guo, Jingguang Li +3 more
benchmark similarity 0.53
Abstract

Memory lets an embodied agent reuse past experience, yet retaining useful information does not ensure that the agent can apply it when conditions change. We present MemTransfer, a benchmark comparing six memory representations, a working-memory baseline and five representations of past experience, under a shared frozen vision-language-model policy. It comprises 100 navigation cases across ten task types in a simulated warehouse, with expert demonstrations supplying the history. Three comparisons vary the starting pose, route availability, and amount and task relevance of history. With one demonstration per task, Full-context and Episodic memory reach 95.3% and 100.0% success at the original demonstration start, but lose 48-49 percentage points at a new test start. Summary changes little between these two test starts, yet with four demonstrations per task it retains a smaller fraction of its unchanged-route success after blocking (39.3%) than Working memory (44.8%) or the two trajectory memories (56-58%). At the new test start, increasing from one to four relevant demonstrations raises Episodic success by 14.3 percentage points, while the other evaluated representations gain no more than 1.3 percentage points. Replacing half of the relevant histories with other-task experience lowers success for both trajectory memories. These results show that robustness to one kind of mismatch does not imply robustness to another, motivating evaluation of both stored information and its use at decision time.

0.41