CS Paper Radar

Longitudinal Learner Participation Profiling in Online Learning: Heterogeneous Consensus Clustering under Unequal Observation Windows

David Otoo-Arthur, Terence L. van Zyl

cs.LG cs.CY ·submitted 2026-10-12 23:33 UTC · v1
published

Abstract

Learning management system traces are clustered to identify participation profiles, but unequal observation windows may cause profiles to reflect duration rather than participation alone. Using 16,448 complete learner--course sequences from 4,599 learners across 152 courses at a South African public university, we evaluated eight participation measures. All remained related to observation-window length even when expressed as rates or shares. Course-grouped adjustment reduced these relationships. Five retained measures were evaluated using K-means, Gaussian mixtures, Ward agglomerative clustering and K-medoids, with standardised measures and principal-component summaries. Evidence supported a broad two-profile grouping and a more detailed adjusted four-profile consensus: Gradually declining, Early-concentrated, Cyclical variable and Sustained active. Profile membership accounted for 2.87% of the variation in duration in the primary consensus, versus 38.18% using original measures. Mean assignment support was 0.739; 8.35% of assignments fell below 0.50, with greatest uncertainty in Sustained active. Two week-by-week sequence analyses agreed strongly with each other but only modestly with the four-profile consensus, indicating that the profiles combined multiple aspects of participation rather than distinct sequence patterns. Profiling should therefore assess duration effects, compare clustering methods and participation summaries, and report assignment consistency.

Comment
Accepted for presentation at SACAIR 2026 and publication in the conference proceedings

Closest papers

Nearest neighbours by meaning across the whole index.

Study-Strategy Clusters from EdNet Logs Track Engagement, Not Mastery

cs.LG cs.CYstat.AP ·2026-08-17 ·Qingchuan Lyu, Yingxin Li, Albert Yang
similarity 0.66
Abstract

Learning analytics often treats unsupervised clusters of intelligent tutoring system (ITS) logs as learner types that should predict learning. We test that assumption on EdNet-KT3. Clustering study-strategy features (resource use, revision, video, problem practice) for 5{,}000 active learners yields a silhouette-selected parent cut ($k=5$) with 4 contrast poles (reading-focused, video-heavy, revision-heavy, and problem-first) plus a large near-mean residual ($\sim$64.9\%). Reclustering that residual adds four finer styles, giving a bootstrap-stable hierarchy of 8 named strategies. We split each learner's timeline by respond count so clusters use only the early half and outcomes only the late half. Early clusters predict later engagement (continuing to practice and finishing late sessions, especially persistence, $η^{2}\approx 0.106$; completion $η^{2}\approx 0.021$) but not later unassisted accuracy (correctness on late first-attempts without help; $p_{\mathrm{adj}}\approx 0.093$). Volume rises with some styles, yet volume-only clustering barely matches strategy labels (ARI$=0.064$). A knowledge-tracing model (SAKT) on the seven TOEIC exam sections predicts next correctness only modestly better than a baseline that knows only how hard each section usually is (AUC lift $+0.051$; CI $[+0.045,+0.058]$), and that mastery signal is nearly independent of behavior styles (ARI$=0.007$). Behavioral clustering here describes study styles and engagement, not knowledge gains.

0.32

Participation-Sensitive Convergence and the Fragment First, Converge Later Pattern in Asynchronous Online Learning: A Topological Analysis Across 22 OULAD Courses

cs.CY cs.LG ·2026-10-01 ·Hitoshi Inoue, Koichi Yasutake
published similarity 0.65
Abstract · Author's version, posted under the non-commercial rights retained in the APSCE copyright transfer agreement. v2: method description correcte…

Asynchronous online learning offers temporal flexibility at a structural cost: learning communities tend to fragment rather than cohere. $β_0$, the number of disconnected behavioral clusters from Zigzag Persistent Homology, serves as a cohort-level indicator of this structure. Two questions remained unverified at scale: (1) does apparent $β_0$ convergence reflect genuine behavioral alignment or learner dropout? and (2) do assessment deadlines produce reproducible fragmentation-convergence cycles? We address both across all 22 OULAD courses (N > 22,000; 857 week-pairs). Changes in $β_0$ strongly co-vary with active learner changes (pooled r = 0.387; median per-course r_delta = 0.459, 20/22 courses), identifying $β_0$ as a participation-sensitive indicator: $β_0$ and active learner counts co-respond to deadline events rather than one causing the other. Deadlines produced fragmentation in 82.6% of assessments and the full Fragment First, Converge Later (FFCL) cycle in 60.2%. 3-phase analysis confirmed structural fragmentation as the dominant long-term trajectory (90.9% of courses), moderated by curriculum structure. These findings establish $β_0$ as a participation-sensitive structural indicator with direct implications for AI-augmented learning analytics design.

0.60

From Early Participation to Later Completion: Evidence from a Large-Scale Self-Paced Learning Programme

cs.HC ·2026-09-28 ·Sakshi Sharma, Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
similarity 0.64
Abstract · 12 Pages, 3 figures, 3 tables

Large-scale learning programmes generate records that make learner participation observable across different activities. Participation points are commonly used to record and encourage such participation, but their value may extend beyond the activities for which points are awarded. Existing evaluations often examine gamification outcomes within the activities or learning environments in which the game elements are implemented, providing limited evidence about whether early participation points contain information about later participation outside the points system. This study examines whether early participation points can provide information about learners' later participation in a self-paced learning track that does not award participation points. Using anonymised records from 876 learners in a large-scale remote software-upskilling internship, we examined participation points generated from live-session attendance and poll responses against later self-paced course completion. The primary analysis used the 438 learners who earned at least one point during the first week, while the full cohort was retained for the no-point analysis. Week-one participation points distinguished learners who later completed a self-paced course with an AUC of 0.89, increasing to 0.95 by the fourth week. Similar AUCs were observed at both stages of the self-paced course sequence, while the absence of week-one points identified learners who did not start or did not complete a self-paced course with 95% precision. These findings indicate that early participation points can provide information about later participation outside the activities that generate the points. Such information can help large-scale learning programmes identify learners who may require timely attention while learning is still in progress, without treating participation points as a measure of overall learner engagement.

0.40

Engagement-Led Segmentation of Gamified Participation Data in a Large-Scale Remote Internship: A Mixed-Methods Study

cs.HC cs.CY ·2026-09-30 ·Sakshi Sharma, Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
survey similarity 0.62
Abstract · 19 Pages, 2 figures, Poster accepted for T4E

Gamified points are widely used to represent learner participation, but cumulative point totals provide limited information about how participation changes over time. This limitation matters in continuously enrolling programmes, where learners have different opportunities to accumulate points. This study examines how gamified participation data can be interpreted as indicators of behavioural engagement in a large-scale, continuously enrolling remote internship. Using an anonymised operational dataset, 3,607 distinct started learners were first classified by participation status, separating dormant learners from those with observable participation. The 1,871 active learners were then grouped using K-means clustering on normalised longitudinal and opportunity-aware participation features. Four participation patterns emerged: Thriving Core, Tapering, Fast Starters, and Occasional Participants. Their trajectories differed in both level and direction. A perception survey of 597 respondents provided complementary learner-reported evidence, integrated with the behavioural strand through a joint display by segment. Perceptions differed across segments, while individual-level correlations between perceptions and behaviour were small, and learners with low recorded participation could report positive perceptions of the points system alongside external barriers. Segments assigned from the first four weeks were then checked against eleven weeks of later platform records: 94% of the Thriving Core attended at least ten further sessions and 22% completed the internship, against under 7% and under 1% in the low-engagement segments. The findings suggest that gamified participation data are more informative when interpreted as longitudinal, opportunity-aware behavioural indicators rather than cumulative scores alone.

0.28

Effects of a Behavioural Commitment Scheme on Study Regularity in a Self-Paced Learning Platform

cs.HC cs.CY ·2026-10-01 ·Meenakshi V., Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
published similarity 0.59
Abstract · 16 pages, 2 figures, 6 tables. Accepted as a long paper at the International Conference on Technology for Education (T4E 2026). Authors' ver…

Online education has enabled learners worldwide to take up courses from reputed institutions. However, a self-paced online course cannot guarantee the motivation and engagement that a learner experiences in a real-time classroom. Self-paced access also makes platform load unpredictable, which drives up the compute cost. We propose a Commitment Scheme for course access that aligns learner commitment with platform capacity. Learners book their study slots in advance; the instructor sets the budget of learning hours available for the course; and learners who use a full window earn additional watch hours. A booked window records an intention to study at a stated time, and a learner who appears in that window implements it. The byproduct is a platform load that can be forecast and bounded. The study involved two courses taken in sequence by the same learners, with the slot booking system activated only in the second. In-window study was observed on 86.8% of booked windows, and the median committer placed 95.5% of all study time inside self-booked windows. Among learners who studied across the launch, study regularity improved from 1.01 to 1.33 active days per week, with a supporting difference of +1.37 days per week against the same learners' preceding course. Commitments made on the same day as the study slot were honoured more often than advance bookings (88.8% against 62.5% two days ahead), which is consistent with the classic intention-behaviour gap.

0.40

What fidelity metrics miss: a structural check on synthetic educational data

cs.CY ·2026-09-23 ·Hitoshi Inoue, Koichi Yasutake
similarity 0.56
Abstract · Accepted for presentation at 1st Workshop of Trustworthy Educational Data Sharing and Secondary Use: ReLEAF Data Challenge, The 34th Interna…

Secondary use of educational records is increasingly mediated by platforms that share a differentially private synthetic version of a dataset and validate specific findings against the real data on request. The synthetic version is evaluated by comparing summary statistics of each variable, yet reported confirmation rates suggest that such comparisons do not predict which findings survive. We propose a structural check: the number of connected components of a weekly proximity graph over learners, tracked across a term. Across four annual cohorts of lower-secondary study-habit logs, the synthetic versions reproduced the level of this quantity and the shape of the weekly partition, but its variation across the term was between 2.6 and 4.9 times smaller than in the real data at a common working point, without exception, and those changes fell in different weeks: the synthetic cohorts single out the term's examination weeks and the real cohorts do not. We also show that a routine rule for setting the graph threshold makes naive comparisons between two datasets invalid, and illustrate this with an error of our own. The real curves are also distinguishable from marginal-preserving surrogates of themselves in all four cohorts, where three of the four synthetic ones are not, a comparison that needs no real data; these differences trace to what the generator was given.

0.31

New Lenses on Learning Design: Course Types and Indicators from Large-Scale Moodle Data

cs.CY cs.HC ·2026-08-14 ·Ekaterina Soroka, Niels Seidel, Marcus Specht, Kamila Misiejuk
published similarity 0.55
Abstract

Although learning design (LD) plays a central role in shaping online courses, large-scale empirical evidence on how courses are actually structured remains scarce, and existing analytics work has characterised courses through student engagement with specific learning activities rather than through indicators of the design itself. This study addresses both gaps through an analysis of learning management system (LMS) data from 606 courses at a distance university. Using LMS data, we first applied dimensionality reduction and clustering to a structural variable set, from which three distinct LD types emerged empirically: Compact, Expansive, and Interactive and statistically characterised how their design elements differ across disciplines, activity load, and interfaces. Building on this typology, we derived three LD indicators, activity-mode balance, structural clarity, and analytics readiness, each combining multiple LMS-derived variables into higher-order constructs that target a different aspect of LD. All three indicators differentiated significantly across the LD types and added pedagogically meaningful dimensions for interpretation. These contributions advance the operationalisation of LD in technology-enhanced learning research by demonstrating that higher-order LD indicators can be derived directly from routinely collected LMS data, and offer empirical insight into how LD manifests at scale within a large distance university.

0.29

Decreasing Digital Distraction in College Students: Associated Online Learning Strategies Identified by Unsupervised Data Mining Approaches

cs.CY cs.HC ·2026-09-03 ·Hui Shi, Ran Bi, Xi Lin, Yan Dai
publishedcode/data similarity 0.55
Abstract · 51 pages. Accepted manuscript. Published in Journal of Educational Computing Research. Data and code: https://osf.io/p85s3/overview

The proliferation of digital tools in education offers numerous benefits but also introduces significant challenges, notably digital distractions that hinder academic performance, especially in online learning contexts. This study employed unsupervised data mining techniques, specifically association rule mining and clustering analysis, to identify effective learning strategies associated with lower levels of digital distractions among college students. Data from 530 participants revealed that self-regulated learning strategies (i.e., goal setting, environment structuring, and time management) co-occurred most consistently with lower digital distractions. Additionally, learner-instructor and learner-content engagement strategies, as well as technical competencies, also tended to appear in the same profiles as lower distraction. Interestingly, reliance on peer help-seeking and learner-learner engagement strategies appeared less often in those lower distraction profiles. These findings offer actionable implications for educators to design targeted interventions that foster focused and productive online learning environments.

0.51