CS Paper Radar

New Lenses on Learning Design: Course Types and Indicators from Large-Scale Moodle Data

Ekaterina Soroka, Niels Seidel, Marcus Specht, Kamila Misiejuk

cs.CY cs.HC ·submitted 2026-08-14 12:10 UTC · v2
published

Abstract

Although learning design (LD) plays a central role in shaping online courses, large-scale empirical evidence on how courses are actually structured remains scarce, and existing analytics work has characterised courses through student engagement with specific learning activities rather than through indicators of the design itself. This study addresses both gaps through an analysis of learning management system (LMS) data from 606 courses at a distance university. Using LMS data, we first applied dimensionality reduction and clustering to a structural variable set, from which three distinct LD types emerged empirically: Compact, Expansive, and Interactive and statistically characterised how their design elements differ across disciplines, activity load, and interfaces. Building on this typology, we derived three LD indicators, activity-mode balance, structural clarity, and analytics readiness, each combining multiple LMS-derived variables into higher-order constructs that target a different aspect of LD. All three indicators differentiated significantly across the LD types and added pedagogically meaningful dimensions for interpretation. These contributions advance the operationalisation of LD in technology-enhanced learning research by demonstrating that higher-order LD indicators can be derived directly from routinely collected LMS data, and offer empirical insight into how LD manifests at scale within a large distance university.

Journal ref
Lecture Notes in Computer Science 16905 (2026) 561-576
DOI
10.1007/978-3-032-37979-5_38

Closest papers

Nearest neighbours by meaning across the whole index.

Exploring Students' Insights on Creating Videos to Learn Software Design and Engineering

cs.CY ·2026-11-17 ·Pedro G. Feijóo-García, John D. Centner, Lucas G. Zangari, Chase G. Wrenn, Neha Rani +2 more
published similarity 0.60
Abstract · This work was presented at 2025 ASEE/IEEE Frontiers in Education (FIE)

This research-to-practice study examines the use of student-created instructional videos as an active learning strategy in a large undergraduate Software Design and Engineering (SWE) course. Supporting engagement and understanding in large-scale computer science (CS) courses remains a challenge, as instruction often relies on automated activities and summative assessments that prioritize grading over meaningful learning. This can make the learning experience feel impersonal, leading to frustration, anxiety, and confusion, especially when students face complex topics or new programming tools. To address these issues, we implemented a learner-centered strategy grounded in the principle of ``learning by teaching," where students created instructional videos to explain course concepts in their own words. This approach allowed students to take ownership of their learning, adapting the material to fit their individual perspectives and reinforcing their understanding through explanation. We report on students' reflections from a large introductory SWE course (over 700 students), analyzing their open-ended feedback on the benefits and drawbacks of the strategy. Students highlighted increased engagement and learning, and many appreciated the flexibility of the video-based format compared to traditional multiple-choice exams, which they found more restrictive. However, students also noted that the video creation process was time-consuming. This study contributes to the growing conversation on active learning in computing and engineering education by showcasing the potential of student-created instructional videos to enhance student agency, motivation, and conceptual understanding in large-scale learning environments.

0.47

The Challenge of Modeling the Complexity of Use for the Measurement of Digital Maturity in Education

cs.CY ·2026-11-06 ·Christine Michel, La{ë}titia Pierrot, Frederic Oru, Olivier Vigneau
published similarity 0.59
Abstract

Measurement of teachers' digital maturity can be useful in diagnosing technology adoption in education and in supporting teachers' professional development. However, there is a lack of easily usable tools in the existing literature. By investigating the most effective ways to measure teachers' digital maturity, our research aims to fill this gap. The focus of this article is on a data-driven approach to the assessment of digital maturity in education. Following a process similar to teaching analytics (data collection, data modeling, data understanding and visualization, and contextual understanding), we draw on diary data collected from 12949 French primary school teachers using a virtual learning environment (VLE) during the 2022--2023 school year. Specifically, the paper presents results related to modeling and visualizing data. To this end, we propose a critical analysis of two automatic classification techniques, one supervised rule-based and the other unsupervised (hierarchical clustering). In addition to providing different scales to measure, we have proposed a new approach to diagnose and visualize digital maturity. In this way, the method provides insight into the diversity and intensity of technology use, contributing to a better understanding of digital maturity and providing a practical tool for assessing day-to-day teaching practices.

0.40

Longitudinal Learner Participation Profiling in Online Learning: Heterogeneous Consensus Clustering under Unequal Observation Windows

cs.LG cs.CY ·2026-10-12 ·David Otoo-Arthur, Terence L. van Zyl
published similarity 0.55
Abstract · Accepted for presentation at SACAIR 2026 and publication in the conference proceedings

Learning management system traces are clustered to identify participation profiles, but unequal observation windows may cause profiles to reflect duration rather than participation alone. Using 16,448 complete learner--course sequences from 4,599 learners across 152 courses at a South African public university, we evaluated eight participation measures. All remained related to observation-window length even when expressed as rates or shares. Course-grouped adjustment reduced these relationships. Five retained measures were evaluated using K-means, Gaussian mixtures, Ward agglomerative clustering and K-medoids, with standardised measures and principal-component summaries. Evidence supported a broad two-profile grouping and a more detailed adjusted four-profile consensus: Gradually declining, Early-concentrated, Cyclical variable and Sustained active. Profile membership accounted for 2.87% of the variation in duration in the primary consensus, versus 38.18% using original measures. Mean assignment support was 0.739; 8.35% of assignments fell below 0.50, with greatest uncertainty in Sustained active. Two week-by-week sequence analyses agreed strongly with each other but only modestly with the four-profile consensus, indicating that the profiles combined multiple aspects of participation rather than distinct sequence patterns. Profiling should therefore assess duration effects, compare clustering methods and participation summaries, and report assignment consistency.

0.26

Student Use of LLMs and the Limits of AI-Generated Question Difficulty in Data Science Courses

cs.CY ·2026-09-22 ·Yuan An, Lei Wang
hot direction similarity 0.53
Abstract

This paper presents a multi-source classroom study conducted during a 10-week quarter in data science courses at Drexel University. We first investigate the behaviors of student engagement with large language models (LLMs) using four surveys across three data science courses. Second, we evaluate the construct validity of multiple-choice questions (MCQs) generated by an LLM for in-lecture retrieval practice. Based on 378 authored questions (311 deployed, producing 7{,}888 student responses), we analyze whether the difficulty ratings assigned by an LLM match empirical item difficulty. Our study shows that student engagement with LLMs varied across courses and increased over the term. Although students expressed high satisfaction and reported saving considerable time, their perception of deep learning benefits declined, and many noted a tendency toward over-reliance. Regarding the difficulty ratings of LLM-generated MCQs, the Easy, Medium, and Hard labels correlated closely with its assigned Bloom's Taxonomy levels (Spearman $ρ=0.90$), reflecting an artifact of co-generation. However, neither metric predicted empirical item difficulty (difficulty label $ρ=0.06$; Bloom level $ρ=0.02$). The ratings reflect the structural formatting of a question rather than its underlying difficulty.

0.34

The Use of Learning Management Systems for Self-paced Learning: The Case at a South African Public Access Centre

cs.CY ·2026-08-13 ·Guidance Mthwazi, Meke Kapepo, Jean-Paul Van Belle
published similarity 0.53
Abstract · 13 pages

This study investigates the use of a Learning Management System (LMS) to support self-paced learning at a South African Public Access Centre (PAC), using the I-CAN Centre as a case study. Through semi-structured interviews with thirty-eight learners and thematic analysis, the research explores opportunities and challenges associated with LMS adoption. Findings reveal that PACs play a critical role in promoting ICT skills and digital inclusion, offering learners flexible access to learning resources and fostering empowerment. While LMS use enhances convenience and supports blended learning as the preferred approach, persistent challenges, such as poor connectivity, outdated infrastructure, and unclear course instructions, limit its effectiveness. These findings highlight the need for infrastructural upgrades and user-centric design to optimise LMS implementation in community-based learning environments.

0.25

Decreasing Digital Distraction in College Students: Associated Online Learning Strategies Identified by Unsupervised Data Mining Approaches

cs.CY cs.HC ·2026-09-03 ·Hui Shi, Ran Bi, Xi Lin, Yan Dai
publishedcode/data similarity 0.52
Abstract · 51 pages. Accepted manuscript. Published in Journal of Educational Computing Research. Data and code: https://osf.io/p85s3/overview

The proliferation of digital tools in education offers numerous benefits but also introduces significant challenges, notably digital distractions that hinder academic performance, especially in online learning contexts. This study employed unsupervised data mining techniques, specifically association rule mining and clustering analysis, to identify effective learning strategies associated with lower levels of digital distractions among college students. Data from 530 participants revealed that self-regulated learning strategies (i.e., goal setting, environment structuring, and time management) co-occurred most consistently with lower digital distractions. Additionally, learner-instructor and learner-content engagement strategies, as well as technical competencies, also tended to appear in the same profiles as lower distraction. Interestingly, reliance on peer help-seeking and learner-learner engagement strategies appeared less often in those lower distraction profiles. These findings offer actionable implications for educators to design targeted interventions that foster focused and productive online learning environments.

0.51

When Attention Guardrails Become Barriers to Learning: Towards the Tipping Point

cs.HC cs.CY ·2026-09-30 ·Meenakshi V., Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
position similarity 0.52
Abstract · 10 pages, 2 figures, 4 tables

Online learning offers flexibility but lacks the structure of a classroom, where a teacher's presence guides attention. The platform we study restores that structure by monitoring the learner through the webcam during ordinary coursework, interrupting or restarting a video when the learner appears distracted. What such monitoring does to a learner across a whole course, rather than in a single examination, is largely unexamined. We report a convergent mixed-methods study of one monitored course pipeline in a summer internship program. We read two free-text surveys alongside three platform channels. The dropout exit survey yielded 15 analyzable responses; the persisting-learner reflection survey, 36. The channels are camera-verification telemetry (14,529 flags from 448 students), an in-video emotion widget (615 submissions from 273 students), and a mandatory end-of-course survey (up to 634 respondents per item). Neither survey named monitoring, so every mention analyzed here was raised by the respondent. Focus-monitoring was raised by 18 of the 51 free-text respondents: 7 of 15 dropouts and 11 of 36 persisting learners. Among the dropouts who raised it, focus-monitoring was the stated primary cause of departure in 4 of 7 cases. None of the 18 questioned being observed in principle. What learners contest is the misreading of ordinary actions, drinking water or moving the head, and the severity of what follows a flag: a video already watched returns to the start of its segment. These findings identify two targets for redesign: the severity of the response to a flag, and the environment check, which can flag a learner before any content has been seen. We argue that the proportionality of that response marks the point at which an attention guardrail becomes a barrier to learning, the tipping point this study approaches.

0.33

What Do Visualization Instructors Want Students to Learn? Introducing a Concept Inventory for Visualization Design

cs.HC ·2026-08-20 ·Medina Lamkin, Heer Patel, Sayamindu Dasgupta, Leilani Battle
code/data similarity 0.52
Abstract · 11 pages, 5 figures, submitted to VIS 2026

The term "visualization design" encompasses multiple concepts and skills that go well beyond current assessments of graphical perception and visualization literacy. In the context of education, what exactly should a student be able to do if they "know" visualization design? To answer this question, we draw on existing methodology from the field of education to propose a concept inventory for visualization design, i.e., a theoretical model capturing the most important concepts and skills commonly associated with visualization design. We initially draft the concept inventory using a qualitative analysis of course objectives from visualization course syllabi. Then, we iteratively refine the concept inventory by soliciting feedback from instructors through semi-structured interviews. Based on our experiences in developing the concept inventory, we reflect on open questions and future research directions in visualization education, such as developing assessments for visualization design (similar to those for visualization literacy) and providing automated assistance for learning and teaching visualization design. Our supplemental materials are available at https://osf.io/dma3f/.

0.26