CS Paper Radar

Designing Collaborative Virtual Environments for Software Engineering Education

Filipe Fernandes, Cláudia Werner

cs.SE ·submitted 2026-11-10 03:01 UTC · v1
published

Abstract

Collaborative virtual environments offer opportunities to make software models available for shared inspection, but educational design and usability need to be examined separately from claims of learning effectiveness. This article presents MetaSEE, an approach connecting requirements guidance, a Web XR feature model, a reusable UML component, and a browser-based multiuser platform. We synthesize documented formative evaluations of the framework (16 participations), feature model (15), UML component (9), and platform (14). These counts represent evaluation participations; the same 12 developers took part in the first two evaluations. The principal platform study involved six teachers working individually and eight students working in four pairs through desktop or notebook computers, keyboard, and mouse. The documentary synthesis traces educational intentions to implemented features and reported difficulties. Participants identified potential value in shared modeling and simulation, alongside navigation, interaction, visualization, and distraction concerns. A numerical audit reconstructs a student System Usability Scale mean of 67.50 from published item frequencies, conflicting with the reported 79.38; an incomplete teacher item distribution prevents recovery of that group's overall mean. The contribution is a traceable account of educational design and formative limitations, with practical implications for onboarding, model readability, collaboration, and evaluation reporting. The evidence supports bounded feasibility and perceived usefulness, without establishing learning gains, sustained engagement, or adoption.

Comment
Submitted to Computers and Education: X Reality
Journal ref
Computers and Education: X Reality, 2026

Closest papers

Nearest neighbours by meaning across the whole index.

The Collaborative Critique: An Inspection Method for Expert Evaluation of User Interfaces

cs.HC ·2026-10-27 ·Wendy Lucas, Tamara Babaian
publishedhighly cited similarity 0.60
Abstract · 33 pages, 5 figures, 3 tables

The development of the collaborative critique (CC) usability inspection method was driven by the need for systems, ranging from the simple to the complex, to lessen the workload on their users by being better collaborative partners. In the collaborative view of system-user interaction, the role of the system is expanded to that of a partner that must help its users achieve their goals. This perspective shifts the dynamic from focusing on the user's ability to make effective and efficient use of the system to the system's usefulness within a given task, user, and interaction context, thereby reducing the user's cognitive and physical efforts. The CC method consists of a walkthrough evaluation in which the questions answered at each step of the interaction assess the collaborative strength of the system. This method is further distinguished by the inclusion of questions that access the behavior of the system in error situations, which are known to be particularly burdensome to users of complex systems. In this paper, we provide a detailed description of the CC method and its application and demonstrate its usefulness in evaluating an interface. The results of a laboratory evaluation show that the method performed well in identifying the problems experienced by users across all severity levels and predicted almost all of the problems associated with error situations.

0.65

Making the Invisible Visible: A Framework for Reflective AI Use in Software Engineering Education

cs.SE cs.CYcs.HC ·2026-09-28 ·Ali Shakiba, Thomas Chaffey
publishedhighly cited similarity 0.59
Abstract · 9 pages, 2 figures, Accepted for publication in the Proceedings of the 37th Annual Conference of the Australasian Association for Engineerin…

Generative AI (GenAI) is increasingly embedded in software engineering education, supporting activities such as requirements development, design exploration, documentation, and prototyping. However, educators often have visibility only into final artefacts, with limited insight into how students evaluate, verify, and refine AI-generated outputs during the learning process. This creates challenges for assessing evaluative judgement and responsible AI-assisted practice. This paper introduces the AI Journal, a structured reflection framework designed to make student-GenAI interaction visible in first-year software engineering education. The framework combines execution tracking, which records prompts, outputs, intent, and interaction context, with cognitive auditing, which captures verification strategies, intervention decisions, confidence judgements, critical learning moments, and reflections on AI-supported work. Deployed in a first-semester software engineering course, the AI Journal enabled visibility into aspects of student learning not observable through artefact-based assessments alone. Preliminary observations suggested variation in verification practices, intervention strategies, and perceptions of AI-supported work. Critical learning moments frequently occurred when students evaluated contextual suitability, feasibility, and requirements alignment rather than identifying obvious errors. The AI Journal demonstrates a practical, lightweight, and model-agnostic approach for making AI-assisted learning processes visible. By foregrounding verification, intervention, and reflection, it shifts attention from product-focused assessment toward evaluative judgement and responsible AI-assisted practice.

0.51

Enjoying the Product but Not Joining the Builders: Investigating Why Students Don't Contribute to OSS

cs.SE ·2026-10-15 ·Italo Santos, Briana Lee, Derek Garcia, Yick Ching Wong, Anthony Peruma
surveycode/data similarity 0.58
Abstract

Open-source software (OSS) participation provides students with authentic exposure to collaborative, real-world software development, yet active contributions remain limited. This short paper presents an exploratory study of computing students' perceptions, knowledge, and experiences with OSS at the University of Hawai'i at Manoa. We administered a survey and analyzed 122 responses using both quantitative and qualitative methods. Students reported moderate OSS familiarity and frequent OSS use in coursework and personal projects, yet only 12.3% actively contributed and engagement with OSS communities was limited. Key barriers included skill gaps (72.89% of non-contributors), time constraints (59.81%), and codebase complexity (66.67% of contributors), often alongside imposter syndrome (36.45%). Students indicated that more time, mentorship, beginner-friendly issues, better onboarding/documentation, and curricular incentives (e.g., course credit) would most increase participation, while most reported their courses do not require or incentivize OSS contributions (58.20%). Grounded in a single institutional context, this study provides a nuanced understanding of how curriculum structure, faculty encouragement, and competing academic demands shape OSS participation. These insights inform the design of targeted curricular and institutional interventions aimed at supporting student onboarding and participation in OSS communities.

0.32

Perspicacious: An Educational Intelligence Platform for Instructional Designers

cs.CY cs.ETcs.HC ·2026-11-10 ·Yumou Wei, Michael C Sutton, Paulo F. Carvalho
similarity 0.57
Abstract

Designing effective instruction requires instructional designers to create assessment questions aligned with clearly defined knowledge components (KCs). These KCs represent specific knowledge or skills that students must acquire. This process is often time-consuming and relies heavily on expert labor. Although AI for education research has produced a growing body of automated question-generation and KC-discovery methods, few have moved beyond research prototypes into user-friendly tools that instructional designers can readily use. To bridge the research-to-practice gap, we developed and evaluated an educational intelligence platform that unifies question generation and KC discovery behind a single interface to support instructional content development. Named "Perspicacious," our platform aims to help instructional designers "see through" complex data and algorithms to derive instructional insights. A cost model calibrated on 17 production runs revealed a cost-time trade-off: extracting KCs from a 576-question bank cost US $1.98-4.11 and took 36-158 minutes to complete, depending on the budget. A formative, partially Wizard-of-Oz study with eight instructional designers found strong perceived usability (mean SUS 78.8) and surfaced concrete requirements that we treat as prerequisites for deployment.

0.42

Integrating Slides, Mathematics, and Simulation in One Page: GenAI-Assisted HTML Learning Objects for Engineering Courses

cs.HC ·2026-11-11 ·Xuan-Quy Dao, Ngoc-Bich Le, Xuan-Dung Phan, Le-Minh Nguyen
similarity 0.57
Abstract · 25 pages, 5 figures, 11 tables

Engineering courses spread their materials across slides (PPTX), typeset notes (LaTeX/PDF), and MATLAB, leaving students to connect them. We describe an instructor-in-the-loop workflow in which generative AI (GenAI) converts these assets into single-file HTML learning objects that combine presentation, mathematics, visualization, simulation, and assessment; a page is released only after its simulations pass numerical verification. Six open demonstrators implement 18 tasks from six engineering courses. In the eight tasks with quantitative cross-checks, every quantity met its tolerance at default settings (1\%, or 2\% for the finite-difference time-domain simulation) and agreed with a separate Python re-computation and a value-blinded MATLAB re-computation run by a colleague not involved in development; the checks also flagged under-resolved settings. In a perception survey, students (19 after post-hoc screening of 28 responses) reported that the pages linked equations with simulation, and 74\% preferred them to separate files, but usability was marginal (System Usability Scale 56.8). Twelve lecturers rated the approach as useful (item means 4.25--4.58) but were hesitant to adopt it; their median ratings on a 12-criterion capability rubric agreed moderately with the first author's ($κ_w=0.60$; individual median 0.31). The results show technical feasibility and preliminary positive perceptions; learning outcomes were not measured.

0.47

Generative AI and Extended Reality in Collaborative Architectural Design Education: An Exploratory Studio Study

cs.HC cs.AI ·2026-09-11 ·Yao Xiao, Max Chen, Yichen Li, Nathaniel Powers, Maxwell Wiesenfeld +3 more
similarity 0.56
Abstract

Architectural design education relies heavily on visual ideation and representation to support collaborative learning in studio environments. Recent advances in generative artificial intelligence (GenAI) and extended reality (XR) offer new opportunities for rapid idea exploration and immersive spatial visualization. This exploratory mixed-methods classroom study investigated how GenAI-assisted multi-user XR influenced collaborative architectural conceptual design. We developed GenARch, a pipeline that integrates GenAI-based visual generation with collaborative XR environments, and deployed it in an undergraduate architectural design studio. Twenty-seven students formed seven self-selected design teams; four teams incorporated GenARch into their usual course workflow to support collaborative ideation and visualization, while three teams continued the same course workflow without GenARch. Pre- and post-intervention surveys assessed design self-efficacy, attitudes toward collaborative learning, and teamwork; a seven-member panel evaluated team design presentations; and GenARch teams participated in group interviews. The quantitative results showed larger relative declines in confidence and outcome expectancy for the GenARch condition and a positive difference-in-differences estimate for perceived conflict management, while panel-rated presentation outcomes were not significantly different between conditions. Interviews indicated complementary roles for the technologies: GenAI supported idea externalization and visual reference generation, whereas XR supported spatial, contextual, and scale-based evaluation. Students also reported challenges related to control, dimensional fidelity, shared attention, and motion comfort. These findings highlight both opportunities and limitations when GenAI and XR are incorporated into collaborative design education.

0.27

Designing Accessible and Rigorous ML Experiments: No-Code Visual Workflows and Structured Guidance for Beginners

cs.HC ·2026-11-10 ·Henrik H. J. Detjen, David Pfrang, Max Westphal, Melissa Finster, Dörte Corr +1 more
similarity 0.56
Abstract

Designing machine learning (ML) experiments requires beginners to plan a methodologically sound workflow and implement it in a concrete environment. We evaluated two forms of support in two within-participant studies with 18 predominantly technically trained participants: mlguide, which provides structured, evidence- backed guidance for workflow design, and AI Sandbox, a visual no-code environment for workflow implementation. After using mlguide, participants produced better high-level workflow designs, but their scores on a quiz about specific methodological choices did not improve significantly. Compared with Google Colab, AI Sandbox received higher hedonic user experience ratings, while perceived workload and acceptance did not differ significantly. These findings suggest that different forms of interactive support help with differ- ent aspects of beginner ML experimentation. The paper contributes a reusable evaluation task with instructions, a modified dataset, and a quiz, as well as empirical evidence on structured guidance for workflow design and on the experience of implementing workflows in visual and notebook-based environments.

0.36

Making Gender-Inclusive Practices Actionable: Evaluating a Research-Informed Computing Education Toolkit

cs.CY cs.HC ·2026-09-03 ·Alina Berry, Susan McKeever, Brenda Murphy, Sarah Jane Delany
published similarity 0.55
Abstract · 9 pages, 4 figures, 3 tables, ACM International Conference on Information Technology for Social Good - GoodIT 26

The persistent gender imbalance in computing remains a global concern, and universities offer a key part of the pipeline to address it. Although research has identified practices that support under-represented student groups, translating this evidence into actionable guidance remains challenging. This paper first presents a novel web- based toolkit (TechMate) designed to address this gap by helping computing educators implement gender- inclusive initiatives through practical research-informed guidance. The toolkit defines over 25 actions, ranging from operational to strategic, and provides case studies and implementation resources. Second, this work reports on the evaluation of TechMate, capturing educators first impressions of its usefulness and usability through authentic tasks, and eliciting unanticipated insights about structural barriers to gender-inclusive practice in computing higher education. Eighteen computing educators of varying seniority from eight universities in Ireland assessed the toolkit using nine research-driven attributes: four usefulness measures (novelty, relevance, trustworthiness, actionability) and five usability measures (effectiveness, aesthetics, navigation, terminology, user satisfaction). Data was analysed using mixed methods: deductive coding, quantitative sentiment scoring, and inductive thematic analysis. Educators rated TechMate highly for user satisfaction and praised its novelty and trustworthiness, with over 60% of participants reporting positively on all attributes, suggesting that research -informed tools can be designed for real-world use. Thematic analysis highlighted other challenges, including women students isolation, institutional resistance to change, and the scarcity of women role models, while also surfacing proposed solutions such as leveraging student ambassadors and fostering supportive learning environments.

0.35