CS Paper Radar

From Early Participation to Later Completion: Evidence from a Large-Scale Self-Paced Learning Programme

Sakshi Sharma, Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade, Rohit Sharma, Meenakshi V, S. R. S. Iyengar

cs.HC ·submitted 2026-09-28 11:42 UTC · v1

Abstract

Large-scale learning programmes generate records that make learner participation observable across different activities. Participation points are commonly used to record and encourage such participation, but their value may extend beyond the activities for which points are awarded. Existing evaluations often examine gamification outcomes within the activities or learning environments in which the game elements are implemented, providing limited evidence about whether early participation points contain information about later participation outside the points system. This study examines whether early participation points can provide information about learners' later participation in a self-paced learning track that does not award participation points. Using anonymised records from 876 learners in a large-scale remote software-upskilling internship, we examined participation points generated from live-session attendance and poll responses against later self-paced course completion. The primary analysis used the 438 learners who earned at least one point during the first week, while the full cohort was retained for the no-point analysis. Week-one participation points distinguished learners who later completed a self-paced course with an AUC of 0.89, increasing to 0.95 by the fourth week. Similar AUCs were observed at both stages of the self-paced course sequence, while the absence of week-one points identified learners who did not start or did not complete a self-paced course with 95% precision. These findings indicate that early participation points can provide information about later participation outside the activities that generate the points. Such information can help large-scale learning programmes identify learners who may require timely attention while learning is still in progress, without treating participation points as a measure of overall learner engagement.

Comment
12 Pages, 3 figures, 3 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Engagement-Led Segmentation of Gamified Participation Data in a Large-Scale Remote Internship: A Mixed-Methods Study

cs.HC cs.CY ·2026-09-30 ·Sakshi Sharma, Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
survey similarity 0.72
Abstract · 19 Pages, 2 figures, Poster accepted for T4E

Gamified points are widely used to represent learner participation, but cumulative point totals provide limited information about how participation changes over time. This limitation matters in continuously enrolling programmes, where learners have different opportunities to accumulate points. This study examines how gamified participation data can be interpreted as indicators of behavioural engagement in a large-scale, continuously enrolling remote internship. Using an anonymised operational dataset, 3,607 distinct started learners were first classified by participation status, separating dormant learners from those with observable participation. The 1,871 active learners were then grouped using K-means clustering on normalised longitudinal and opportunity-aware participation features. Four participation patterns emerged: Thriving Core, Tapering, Fast Starters, and Occasional Participants. Their trajectories differed in both level and direction. A perception survey of 597 respondents provided complementary learner-reported evidence, integrated with the behavioural strand through a joint display by segment. Perceptions differed across segments, while individual-level correlations between perceptions and behaviour were small, and learners with low recorded participation could report positive perceptions of the points system alongside external barriers. Segments assigned from the first four weeks were then checked against eleven weeks of later platform records: 94% of the Thriving Core attended at least ten further sessions and 22% completed the internship, against under 7% and under 1% in the low-engagement segments. The findings suggest that gamified participation data are more informative when interpreted as longitudinal, opportunity-aware behavioural indicators rather than cumulative scores alone.

0.28

Effects of a Behavioural Commitment Scheme on Study Regularity in a Self-Paced Learning Platform

cs.HC cs.CY ·2026-10-01 ·Meenakshi V., Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
published similarity 0.66
Abstract · 16 pages, 2 figures, 6 tables. Accepted as a long paper at the International Conference on Technology for Education (T4E 2026). Authors' ver…

Online education has enabled learners worldwide to take up courses from reputed institutions. However, a self-paced online course cannot guarantee the motivation and engagement that a learner experiences in a real-time classroom. Self-paced access also makes platform load unpredictable, which drives up the compute cost. We propose a Commitment Scheme for course access that aligns learner commitment with platform capacity. Learners book their study slots in advance; the instructor sets the budget of learning hours available for the course; and learners who use a full window earn additional watch hours. A booked window records an intention to study at a stated time, and a learner who appears in that window implements it. The byproduct is a platform load that can be forecast and bounded. The study involved two courses taken in sequence by the same learners, with the slot booking system activated only in the second. In-window study was observed on 86.8% of booked windows, and the median committer placed 95.5% of all study time inside self-booked windows. Among learners who studied across the launch, study regularity improved from 1.01 to 1.33 active days per week, with a supporting difference of +1.37 days per week against the same learners' preceding course. Commitments made on the same day as the study slot were honoured more often than advance bookings (88.8% against 62.5% two days ahead), which is consistent with the classic intention-behaviour gap.

0.40

Longitudinal Learner Participation Profiling in Online Learning: Heterogeneous Consensus Clustering under Unequal Observation Windows

cs.LG cs.CY ·2026-10-12 ·David Otoo-Arthur, Terence L. van Zyl
published similarity 0.64
Abstract · Accepted for presentation at SACAIR 2026 and publication in the conference proceedings

Learning management system traces are clustered to identify participation profiles, but unequal observation windows may cause profiles to reflect duration rather than participation alone. Using 16,448 complete learner--course sequences from 4,599 learners across 152 courses at a South African public university, we evaluated eight participation measures. All remained related to observation-window length even when expressed as rates or shares. Course-grouped adjustment reduced these relationships. Five retained measures were evaluated using K-means, Gaussian mixtures, Ward agglomerative clustering and K-medoids, with standardised measures and principal-component summaries. Evidence supported a broad two-profile grouping and a more detailed adjusted four-profile consensus: Gradually declining, Early-concentrated, Cyclical variable and Sustained active. Profile membership accounted for 2.87% of the variation in duration in the primary consensus, versus 38.18% using original measures. Mean assignment support was 0.739; 8.35% of assignments fell below 0.50, with greatest uncertainty in Sustained active. Two week-by-week sequence analyses agreed strongly with each other but only modestly with the four-profile consensus, indicating that the profiles combined multiple aspects of participation rather than distinct sequence patterns. Profiling should therefore assess duration effects, compare clustering methods and participation summaries, and report assignment consistency.

0.26

Automated Feedback to Peer Tutors Increases Their Talk Moves and Learner Reasoning but Not the Balance of Talk

cs.CL cs.ETcs.HC ·2026-11-04 ·Dorottya Demszky, Yann Hicke, Joy Yun, Mariah Olson, Max Karpawich +5 more
similarity 0.59
Abstract

Automated feedback on classroom discourse improves instruction in professional and online teaching contexts, and recent work suggests that delivering similar feedback to learners may strengthen these effects by sharing responsibility for participation. Whether this holds in small-group volunteer tutoring has not been tested. We present results from a randomized controlled trial across two four-week SAT mathematics bootcamps on the Schoolhouse.world platform, involving 1,030 volunteer tutors, 7,443 learners and 6,508 recorded sessions. Tutors were randomly assigned to receive no feedback, automated feedback on their own discourse, or that feedback together with participation feedback delivered to their learners under one of two motivational framings. Feedback to tutors increased eliciting of learner ideas, uptake of learner contributions, and learner reasoning by 8-15%, and the pattern replicated across both bootcamps. However, tutor talk time, which averaged 91.5% in the control group, did not change in any condition, and learner-facing feedback did not further change discourse. Interviews with 17 tutors indicate that they adopted the moves the feedback recommended but were limited by learners who did not respond. Interviews with 13 learners suggest why the learner-facing feedback had little effect: it reported a group-level rather than a learner-level statistic, some learners preferred to listen, and learner-to-learner interaction was rare in these sessions. Automated feedback can change how tutors invite learner thinking, but shifting how much learners talk likely requires changes beyond feedback.

0.16

When Attention Guardrails Become Barriers to Learning: Towards the Tipping Point

cs.HC cs.CY ·2026-09-30 ·Meenakshi V., Pavani Ayinampudi, Aditya B. M. V., Jinal Gupta, Prakash Hegade +3 more
position similarity 0.57
Abstract · 10 pages, 2 figures, 4 tables

Online learning offers flexibility but lacks the structure of a classroom, where a teacher's presence guides attention. The platform we study restores that structure by monitoring the learner through the webcam during ordinary coursework, interrupting or restarting a video when the learner appears distracted. What such monitoring does to a learner across a whole course, rather than in a single examination, is largely unexamined. We report a convergent mixed-methods study of one monitored course pipeline in a summer internship program. We read two free-text surveys alongside three platform channels. The dropout exit survey yielded 15 analyzable responses; the persisting-learner reflection survey, 36. The channels are camera-verification telemetry (14,529 flags from 448 students), an in-video emotion widget (615 submissions from 273 students), and a mandatory end-of-course survey (up to 634 respondents per item). Neither survey named monitoring, so every mention analyzed here was raised by the respondent. Focus-monitoring was raised by 18 of the 51 free-text respondents: 7 of 15 dropouts and 11 of 36 persisting learners. Among the dropouts who raised it, focus-monitoring was the stated primary cause of departure in 4 of 7 cases. None of the 18 questioned being observed in principle. What learners contest is the misreading of ordinary actions, drinking water or moving the head, and the severity of what follows a flag: a video already watched returns to the start of its segment. These findings identify two targets for redesign: the severity of the response to a flag, and the environment check, which can flag a learner before any content has been seen. We argue that the proportionality of that response marks the point at which an attention guardrail becomes a barrier to learning, the tipping point this study approaches.

0.33

TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education

cs.AI cs.HC ·2026-08-22 ·David Barron, Xiaohang Tang, Rezky Dwisantika, Minsun Kim, David H. Smith +2 more
top venuedataset similarity 0.57
Abstract · Accepted to ACM UIST 2026, Detroit, MI, USA, 14 pages, 5 figures Dataset: https://vizpi.org/dataset

AI programming tutors provide scalable support, yet lack the behavioral context human tutors rely on to adapt support to learners' needs. We present TutorTrace, a dataset and behavioral abstraction pipeline that makes learners' behavioral context visible and computable in real time from low-level IDE telemetry. Across four deployments in two introductory Python courses (N=480), TutorTrace captures approximately 180K telemetry events, 13,633 behavioral segments, and 27 continuously computed metrics. From this foundation, we derive a taxonomy of learner activity before the first AI query, between consecutive queries, and across the full session, enabling systems to respond not just to what learners say, but to what they have done leading up to the help-seeking moment. In a preliminary classroom evaluation, behavior-aware prompts were associated with a decrease in intervals between queries with no independent work from 50.0% to 20.7%. As an additional demonstration of downstream utility, we evaluate TutorTrace on two held-out prediction tasks: whether a learner will query within the next 60 seconds (AUROC=.726) and whether an upcoming query reflects guided or dependent help-seeking (AUROC=.717). Together, these findings show how behavioral context can enable adaptive AI tutoring at scale.

0.37

Study-Strategy Clusters from EdNet Logs Track Engagement, Not Mastery

cs.LG cs.CYstat.AP ·2026-08-17 ·Qingchuan Lyu, Yingxin Li, Albert Yang
similarity 0.57
Abstract

Learning analytics often treats unsupervised clusters of intelligent tutoring system (ITS) logs as learner types that should predict learning. We test that assumption on EdNet-KT3. Clustering study-strategy features (resource use, revision, video, problem practice) for 5{,}000 active learners yields a silhouette-selected parent cut ($k=5$) with 4 contrast poles (reading-focused, video-heavy, revision-heavy, and problem-first) plus a large near-mean residual ($\sim$64.9\%). Reclustering that residual adds four finer styles, giving a bootstrap-stable hierarchy of 8 named strategies. We split each learner's timeline by respond count so clusters use only the early half and outcomes only the late half. Early clusters predict later engagement (continuing to practice and finishing late sessions, especially persistence, $η^{2}\approx 0.106$; completion $η^{2}\approx 0.021$) but not later unassisted accuracy (correctness on late first-attempts without help; $p_{\mathrm{adj}}\approx 0.093$). Volume rises with some styles, yet volume-only clustering barely matches strategy labels (ARI$=0.064$). A knowledge-tracing model (SAKT) on the seven TOEIC exam sections predicts next correctness only modestly better than a baseline that knows only how hard each section usually is (AUC lift $+0.051$; CI $[+0.045,+0.058]$), and that mastery signal is nearly independent of behavior styles (ARI$=0.007$). Behavioral clustering here describes study styles and engagement, not knowledge gains.

0.32

OBER+: Continuity-Aware Reporting and Traceable Continuous Improvement in Outcome-Based Education

cs.LG cs.CLcs.CY ·2026-09-03 ·Elakkiya Rajasekar
unusual similarity 0.55
Abstract · 14 pages, 6 figures, 7 tables. Submitted to IEEE Transactions on Learning Technologies

Institutions practising outcome-based education compute learning outcome attainment routinely, while reviews of curriculum analytics report an absence of evidence on how that computation informs decisions. This paper presents OBER+, an extension of a deployed institutional attainment platform that computes the step from a measured shortfall to an evaluated corrective action. Five connected stages accumulate attainment across deliveries of a course, signal a shortfall and a persistent shortfall, grade it on cutoffs the regulator already uses, record the decision against a catalogue of practices annotated with their evidence, log the change, and quantify the subsequent movement in the shortfall. A further rule compares successive statements of an outcome, so attainment is never read as a series across a point at which the outcome changed. Applying the rules to the live record of two real courses produced three results. Every outcome of a core course was substantively redefined between consecutive deliveries, with subject matter moving between outcome numbers, so a naive reading would have reported a twenty-five point collapse between quantities that do not refer to the same learning. Recomputing the platform's figures from its documented rule showed six of ten differing by more than rounding explains, in a pattern that identified a defect since reported to the institution. Across fifteen statement pairs from three transitions, five were identical character for character, and among the ten that were not, the outcome carrying a given number was nearest to a differently numbered earlier outcome in six, a result resting on an ordering of similarities and requiring no threshold and no labelling. The contribution is a computational design for outcome-based reporting, stated as rules any attainment platform can implement, with evidence of what they make visible in a live institutional record.

0.31