CS Paper Radar

Auditing Contextual Bias in Human Ball-Strike Calls Using KBO's Automated Umpiring Transition

Kichang Lee, JeongGil Ko

cs.HC ·submitted 2026-09-03 12:59 UTC · v1
benchmarkunusual

Abstract

This paper uses the Korean Baseball Organization's adoption of the Automated Ball-Strike (ABS) system to audit long-standing claims about contextual bias in human ball-strike calls. Using pitch-level KBO data from 2021 through the available portion of the 2026 season, we model called-strike probability for taken pitches near the strike-zone boundary, with 2022-2023 as the primary human-umpire baseline and ABS seasons (2024 and onward) as a diagnostic benchmark. The strongest evidence concerns count pressure. Relative to 0--0 counts, human umpires called substantially fewer strikes in two-strike counts and more strikes in hitter-ahead three-ball counts. Specifically, in the main 0.25-ft boundary band, 0--2 was associated with a -17.17 percentage-point effect and 3--0 with a +6.61 percentage-point effect. Under ABS, the corresponding effects were close to zero and did not survive false-discovery-rate correction. Game progression shows a smaller but coherent pattern as human calls were less strike-prone in early innings and more strike-prone in innings 7--9+, especially in late-close situations, while complete ABS seasons were essentially flat. Other suspected biases are weaker or more localized. Salary-based reputation proxies provide suggestive but proxy-sensitive evidence, and catcher identity shows human-period residual heterogeneity that disappears under ABS. Home-context evidence is mostly null at the umpire level, with one FDR-significant human-period exception and an exploratory umpire-team gap best treated as an audit lead. Overall, the results do not show that human umpires were biased everywhere. Instead, they map where the human strike zone was most context-sensitive, where evidence was weaker, and where common suspicions received little support.

Comment
12 pages, 10 figues

Closest papers

Nearest neighbours by meaning across the whole index.

When the Strike Zone Becomes Algorithmic: Umpire Judgment and Player Challenge Decisions under AI Review

cs.HC cs.CY ·2026-09-22 ·Kichang Lee, Gyeongmin Han, Sungmin Lee, JeongGil Ko
highly cited similarity 0.74
Abstract · 31 pages, 10 figures, 1 table

The Automated Ball-Strike challenge system that Major League Baseball adopted in 2026 offers a distinctive setting for studying human AI interaction in which umpires make every ball and strike call, while players can selectively ask an automated system to publicly overturn those decisions. We analyze 4,114,256 called pitches from 2015 through 2026 and 8,447 challenges from the 2026 season to examine how algorithmic review reshapes umpire judgment and player behavior. We study where umpires placed the effective strike zone boundary, how consistently they applied that boundary, how they responded to overturned calls, and which calls players chose to challenge. In 2026, the effective called boundary shifted toward the automated strike zone beyond the trajectory observed in prior seasons, while the consistency of that boundary largely continued its existing trend. Following an overturned call, umpires temporarily adjusted subsequent decisions near the corrected boundary, although these effects did not consistently persist into the next game. Count dependent variation in calling remained, while differences associated with player status narrowed. Players, meanwhile, left many overturnable calls unchallenged and appeared to base challenge decisions more strongly on immediately observable evidence than on the precise geometry of the automated zone. Together, these findings show that selective AI review does more than correct individual errors. It reshapes human judgment, adaptation, and strategic behavior around an algorithmic authority.

0.40

Unified Pitch Graphs for Diagnosing Pitching Strategy

cs.IR ·2026-09-03 ·Kichang Lee, JeongGil Ko
similarity 0.59
Abstract · 10 pages, 9 figures, 3 tables

Pitching strategy in baseball is expressed through both physical execution and the ordered context in which pitches are used, yet common representations collapse pitches into discrete types or aggregate statistics. We present Unified Pitch Graphs (UPG), a hierarchical graph representation for retrospective analysis of sequential spatiotemporal events. UPG preserves each pitch as an exact event with reconstructed three-dimensional trajectory and context, connects consecutive pitches through directed sequence edges, and organizes the same events across semantic and temporal resolutions. A support-adaptive mechanism backs off from fine, long sequences when repeated evidence is insufficient, while retaining exact event lineage. We evaluate UPG on 3.94 million MLB Statcast pitches from 2021 to 2026. Nominally identical pitch sequences exhibit distinct physical executions, and ordered structure becomes increasingly evident in longer context-conditioned paths. Support-adaptive backoff increases held-out path coverage from 18.9\% to 94.9\% while improving execution reconstruction from $R^2=0.495$ to $0.685$. UPG also reliably localizes controlled execution changes that discrete pitch-mix and sequence representations cannot detect. These results demonstrate that UPG provides a traceable, multi-scale representation for identifying recurring strategy patterns without conflating retrospective associations with causal or future-performance claims.

0.62

A Fairness Audit of the Duckworth-Lewis-Stern Method: Format-Specific and Gender-Differential Bias, with an Interpretable Calibration Layer for Cricket Target Revision

cs.LG ·2026-09-04 ·Soumyadeep Roy
publishedbenchmark similarity 0.57
Abstract · Accepted for publication in the Journal of Quantitative Analysis in Sports (JQAS); forthcoming

The Duckworth-Lewis-Stern (DLS) method has been the international standard for revising target scores in rain-interrupted limited-overs cricket since 1999. Despite over two decades of operational use, no large-scale empirical audit of its prediction bias has been published. We conduct such an audit on 8,150 international matches (3,095 ODIs, 5,055 T20Is) from Cricsheet, generating 233,550 synthetic interruption scenarios with temporal splits. We document two structured biases. First, DLS prediction error spans a 137-run range across (overs-remaining, wickets-lost) match-state buckets. Second, DLS exhibits a gender-differential bias on ODIs that has not previously been quantified: on the training split, mean over-prediction is +1.51 runs for men but +7.63 runs for women, a gap of +6.13 runs (F = 195.16, p < 10^-43). We benchmark DLS against five modern alternatives: Bi-LSTM, XGBoost, an enriched XGBoost variant, a deep context-aware model, and a stacking ensemble, and propose DLS-Cal, a lightweight interpretable calibration layer (27K parameters) outputting a state-conditioned correction added to DLS. DLS-Cal reduces absolute bias by 31% on ODI and 19% on T20I, and a gender-aware variant reduces women's ODI residual bias from +6.19 to +0.65 runs while leaving men's calibration unchanged. We release code, models, and data.

0.42

Comparing wins above replacement across baseball history

cs.CE stat.ME ·2026-10-29 ·Michael Doane
similarity 0.56
Abstract

This paper introduces iWAR, a system for estimating wins above replacement from historical Retrosheet play-by-play records. We compare its runs-allowed (RA) and fielding-independent pitching (FIP) versions with Baseball-Reference WAR (bWAR), FanGraphs WAR (fWAR) and run-based alternatives. The common historical sample contains 1,471 team-seasons across 79 years and 1,441 consecutive franchise pairs. Under the fixed conversion to wins, same-season mean absolute error was 3.695 credited wins per 162 games for iWAR RA, compared with 4.724 for bWAR and 4.744 for fWAR: reductions of 21.793% and 22.112%. The paired differences were -1.030 and -1.049, with conditional 95% calendar-block intervals of [-1.367, -0.706] and [-1.398, -0.725]. Calibration preserved most of these advantages. A broader bWAR comparison across 118 years retained a smaller advantage; modern differences were smaller or sometimes reversed. PythagenPat reconstructed records more closely than every WAR total. Next-season replay gave nearly identical fixed-map errors for iWAR FIP and fWAR, while calibration changed their ordering. An amended chronological learned-model analysis of 1,552 franchise pairs gave neural RMSE 10.163, versus 9.946 for the development-selected ridge comparator (difference +0.217; conditional interval [0.015, 0.474]). This work provides a new, specialized framework for analyzing WAR across eras and provides context for future work using learning models.

0.26

PRISM: A Post-Prediction Reliability Framework for Evidence-Guided Correction and Selective Abstention

cs.NI cs.LG ·2026-11-13 ·Omm Swarup, Shrishail M. Hiremath
similarity 0.52
Abstract · 7 pages

A model may produce a prediction with high confidence and still get the outcome wrong. This is a challenge in sequential applications, where the system evolves over time and deployment data may differ from the data used during training. To address this issue, we propose PRISM (Prediction Reliability and Intelligent Self-Correction Mechanism), a framework that evaluates prediction reliability after the initial output is generated. It estimates the risk of error and examines predictions identified as potentially unreliable. For these cases, PRISM analyses available signals, retrieves similar situations from historical data, and verifies whether an alternative prediction is supported by the evidence. It can then retain the original prediction, apply a verified correction, or abstain when the evidence is insufficient. We evaluate PRISM on second-innings match prediction in the Indian Premier League (IPL). Ball-by-ball records are converted into over-level observations to capture changes in match conditions throughout an innings. To preserve temporal order, earlier IPL seasons are used for training, IPL 2024 for validation, and IPL 2025-2026 for out-of-time testing. The dataset contains 8,665 over-level observations from 475 matches, with the test partition comprising 2,568 observations from 142 matches. In one experimental record, Logistic Regression, Random Forest, and HistGradientBoosting achieve accuracies of 65.2%, 68.4%, and 70.2%, respectively. The corresponding PRISM evaluation reports a selective accuracy of 82.4% at 88.5% coverage, with a Brier score of 0.126 and an expected calibration error (ECE) of 0.019.

0.23

When Should AI Overturn a Human Decision? Controversy at the 2026 World Cup and a $\sqrt{2/π}$ Solution

cs.AI cs.LGmath.OCstat.ML ·2026-11-09 ·Amir Ali Ahmadi, Parsa Alavi, Radeen Alavi
theoryunusual similarity 0.48
Abstract · This paper is intended for educational purposes

We study how to combine a human binary call (a referee's offside or onside decision) with an AI numerical measurement (VAR's estimate of an attacker's position relative to the offside line). We derive an explicit maximum-likelihood rule that determines when the referee's call should stand and when a conflicting VAR measurement should overturn it. Our model treats the true offside margin as fixed and unknown and assumes independent additive Gaussian errors in the human's perception and the AI measurement. When both errors have zero means and known standard deviations $σ_H$ and $σ_{AI}$, respectively, the reversal threshold is $\sqrt{2/π}\,σ^2_{AI}/σ_H$. An onside call is overturned precisely when VAR's measured offside margin exceeds this threshold---not merely because VAR places the attacker beyond the offside line. We also derive the rule when either source has a systematic bias. We prove that the maximum-likelihood estimate of the true margin exists and is unique, while the final binary decision requires only a threshold comparison, without computing that estimate numerically. We illustrate the rule through numerical examples and show how to estimate the error parameters from calibration data. The same analysis applies beyond soccer to binary classification problems in which a human call and an AI measurement satisfy the stated model. This paper is intended for educational purposes: we aim to illustrate how undergraduate students and advanced high school students familiar with basic probability and calculus can investigate research questions in AI and its applications.

0.24

Detecting Common Golfing Faults Using AI and Video-Derived Biomechanical Features

cs.LG cs.AI ·2026-11-08 ·Oliver Martin, Jeff Clark, Nawid Keshtmand
similarity 0.48
Abstract

Understanding how an athlete moves can improve both technique and safety, yet outside the laboratory technique is still assessed by eye. We present a pipeline that detects named golf swing faults from ordinary video, without markers or calibration. Instead of learning end to end, it tracks body pose and the clubhead in a body-centered frame, and classifies the biomechanical quantities a coach would measure, such as the height of the clubhead above the swing plane, with shallow boosted trees. We demonstrate the approach on two common faults, coming over-the-top (OTT) and early-extension (EE). On 160 swings and 143 swings from public sources it detects OTT and EE with a cross-validated ROC-AUC of 0.975 and 0.911 respectively. Because every feature is a biomechanical quantity a coach already uses, measured at a known phase of the downswing, each decision can be traced to the signals and the moments of the swing that drove it. The signals the model relies on most are the same ones a coach checks when diagnosing these faults. The pipeline processes phone video on a consumer laptop in seconds, so it could feasibly be developed into an app for golfers of all abilities and extended to other sports in which technique is judged against a biomechanical reference.

0.27

DShuttleNet: A Badminton Doubles Dataset for Evaluating Team Coordination

cs.LG ·2026-09-29 ·Guan-Yi Jhang, Chiencheng Chiang, Wei-Kai Chen, Hui-Ching Yu, Hsu-Chao Lai +4 more
datasetcode/data similarity 0.47
Abstract

Most existing sports datasets are individual-centric or ball-centric, focusing on individual player actions while ignoring interactions among teammates. In badminton doubles, tactical success is governed by rapid team formation and coordination, yet standard resources for modeling these player interactions are scarce. To bridge this gap, we present DShuttleNet, a comprehensive dataset for badminton doubles curated from elite BWF World Tour tournaments. Beyond trajectory data, DShuttleNet uniquely incorporates expert-labeled "Loss Reasons," transforming the dataset into a diagnostic tool for causal tactical evaluation. We formally define two geometry-driven representations, Teammate-Relative Angle (TRA) and Vertical Shot Angle (VSA), to characterize coordination and shot aggressiveness. To quantify interpersonal synergy, we introduce novel metrics, Court Coverage Efficacy Index (CCEI) and Threat Load Asymmetry Index (TLAI), which evaluate the often-overlooked non-hitting partner's role and defensive coordination. Experimental results demonstrate that conventional models suffer from underfitting when failing to incorporate these coordination-centric features, highlighting the critical importance and potential impact of releasing DShuttleNet. Dataset is available at: https://doi.org/10.34740/kaggle/dsv/16097938.

0.29