CS Paper Radar

Addressing Bias Early in the AI Lifecycle: Social Determinants of Health in Functional and Cognitive Assessment Labels of Nursing Home Residents

Isabel Amaya-Rodríguez, Cristina Martin, Nekane Larburu, Teresa Garcia-Navarro, Roberto González Novas, Alberto Rodríguez Taboada, Maite García-Sebastian, Ainara Estanga, Mirian Ecay-Torres, Pablo Martínez-Lage, Miguel A. Armengol de la Hoz, Cristina Rubio-Escudero, Iván Macía

cs.LO stat.OT ·submitted 2026-11-08 18:20 UTC · v1

Abstract

Fairness in clinical artificial intelligence (AI) is usually evaluated after model training, yet bias can enter earlier in the AI lifecycle, during data collection and labelling. When routine clinical assessments serve as target variables, systematic differences in these labels across sociodemographic groups are carried into model development, validation and updating. This study addresses this early lifecycle stage by auditing labels from three standardised instruments used in residential care: the Barthel Index (BI), the Mini-Mental State Examination (MMSE) and the Global Deterioration Scale (GDS). Using electronic health records of 2,407 residents from 12 nursing homes in the Basque Country, Spain (2011-2021), we assessed four social determinants of health (SDoH) - sex, educational attainment, lifetime work activity and marital status - with two group fairness metrics, Disparate Impact (DI) and Statistical Parity Difference (SPD), computed for each outcome category with bootstrap confidence intervals. Disparities were found for all four attributes and across the three instruments: men, residents with intermediate education and never-partnered residents were more frequently classified in categories indicating preserved function or cognition. These disparities may reflect genuine differences in health status, measurement properties of the instruments, assessment practices or selective admission to residential care, and cannot be attributed to a single cause with the present design. Regardless of their origin, any model trained on these labels would inherit them, and they could persist through later lifecycle stages unless explicitly examined. These findings support pre-training label auditing as the first step of a continuous fairness assessment spanning model development, validation, deployment and updating.

Comment
14 pages, 24 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Machine-Learning Assessment of the Predictive Value of Inflammatory Biomarkers for Cognitive Impairment in an Older Hispanic Adult Cohort

cs.LG ·2026-09-16 ·Antony Garcia, Gabrielle Britton, Alcibiades Villarreal, Diana Oviedo, Giselle Rangel +1 more
similarity 0.56
Abstract

Small clinical tabular datasets require interpretable machine learning because deep learning is often impractical and ensemble models can be difficult to inspect. A key pitfall is that statistical significance does not necessarily imply predictive utility. Using data from the Panama Aging Research Initiative--Health Disparities (PARI-HD) cohort (n=165), we implemented a leakage-safe threshold-likelihood Bernoulli/Categorical Naive Bayes (BNB/CNB) classifier. Within every training fold, each continuous predictor was reduced to a supervised chi-square-derived state, while income entered the model through a categorical likelihood. All data-dependent steps were performed within repeated stratified 10-fold cross-validation with 30 repeats. The demographic baseline achieved a ROC-AUC of 0.630 +/- 0.017. I-309 (CCL1) was the dominant incremental feature, increasing AUC by 0.110, with paired DeLong tests yielding p<0.05 in 100% of repeats. In the pre-specified primary analysis, I-309 produced a fixed-partition DeLong p=0.0018, with robustness assessed across 200 random partitions, where the median p-value was 0.0011. Within the exploratory family of 18 candidate markers, I-309 achieved a Benjamini-Hochberg-adjusted q=0.032 on the frozen partition and satisfied q<0.05 in 85% of random partitions, whereas no other marker demonstrated reliable incremental predictive value. Because the fitted model is an inspectable table of thresholds and class-conditional probabilities, these results identify I-309/CCL1 as an interpretable candidate feature for tabular prediction of cognitive impairment, pending external validation.

0.33

Reconstructing the Human Development Index at the Individual Level from Survey Microdata: Development and Validation of a Methodology

cs.LG stat.APecon.GN ·2026-09-12 ·Tcharlies Bachmann Schmitz, Natalia Veronez da Cunha, Isabelle Ferreira
unusual similarity 0.54
Abstract · 12 pages, 3 figures. Replication notebook and data archived at https://doi.org/10.5281/zenodo.22714205

This study proposes and validates a methodology for reconstructing the Human Development Index (HDI) from individual-level survey microdata, enabling disaggregated estimates for demographic subpopulations while maintaining coherence with the official HDI. Data from 40,185 respondents in 21 countries from the European Social Survey (ESS7, 2014) were analysed, combined with World Bank indicators for life expectancy, gross national income per capita, and expected years of schooling. The health dimension was estimated from national life expectancy, adjusted by self-rated health; income, by a lognormal multiplier calibrated by the Gini coefficient; and education, by combining observed and expected years of schooling. The dimensions were aggregated by geometric mean, weighted by sampling weights, with confidence intervals estimated via the delta method. Among the 39,706 individuals with valid data (98.8%), the reconstructed HDI showed high agreement with the official 2014 HDI, with a mean absolute error of 0.0099 and a Pearson correlation of 0.917. Consistent differences across subgroups evidenced the methodology's convergent validity and its capacity to produce disaggregated estimates of human development, expanding the HDI's potential for analyses of socioeconomic and demographic inequalities.

0.41

Using AI Predictions to Augment Rather Than Replace Surveys

cs.CY ·2026-11-04 ·Lai Wei, Yifei Zhu
similarity 0.53
Abstract

LLMs can predict human survey responses with nontrivial accuracy. What this means for the future of social surveys remains hotly contested. Optimists anticipate a coming era of synthetic respondents; skeptics see a fragile and overhyped substitute. This article advocates a position: AI predictions cannot replace surveys, but they can augment them. Using prediction-powered inference (PPI), a statistical framework rooted in survey methodology and known in sociology as "mixed subjects design", the study tests whether AI predictions can improve the statistical efficiency of social surveys when combined with census-scale auxiliary information. Applying the framework to 83 social outcomes in the General Social Survey (GSS) and National Health Interview Survey (NHIS), with American Community Survey (ACS) being the auxiliary file, we find that supervised predictors yield effective-sample-size gains of about 7-12 percent when estimating the mean, while LLM gains are smaller but positive.

0.22

Rethinking How We Evaluate Methodological Progress in Health AI

cs.LG cs.AI ·2026-09-16 ·Florent Pollet, Matthew McDermott
similarity 0.51
Abstract

Methodological progress in artificial intelligence (AI) for electronic health records (EHRs) depends on our ability to determine which algorithms work better, and under which conditions. However, such progress is thought to be hindered by difficulties in reproducibility and in defining clinically meaningful evaluation tasks. We empirically study these barriers by re-implementing 12 historical and recent algorithms within a shared evaluation framework and evaluating them on two clinical datasets, MIMIC-IV and NWICU. We compare two complementary task families: expert-authored clinically meaningful tasks and generated tasks defined from randomly sampled event codes and prediction horizons. We ask whether relative algorithms comparisons transfer across task families and datasets, whether residual task heterogeneity contains useful methodological structure, and what a controlled comparison reveals about progress over the last decade. We find that aggregate pairwise comparisons transfer strongly across evaluation settings, including from randomly generated tasks to clinically meaningful tasks and across datasets. At the same time, clinically meaningful tasks exhibit greater task-method interaction, providing preliminary evidence that task properties can help explain when particular modeling choices are advantageous. Finally, newer algorithms do not consistently outperform earlier approaches: gradient-boosted trees remain highly competitive when paired with a modern, wide and sparse representation of the EHR. Together, these results suggest that useful methodological knowledge may require less task engineering than commonly assumed, while highlighting the importance of understanding the structured heterogeneity that remains across tasks and methods.

0.42

Beyond Demographic Balance: Multi-Metric and Intersectional Evaluation of Fairness in MIMIC-IV Mortality Prediction

cs.LG ·2026-10-01 ·Abdullah Al Noman, Fahmid Al Rifat, Tahrima Hashem, Syed Muhammad Ibne Zulfiker, Rishov Paul +1 more
similarity 0.51
Abstract · NEurlPS TAE workshop 2026 accepted

Fairness conclusions in clinical prediction can depend strongly on both the metrics reported and the demographic resolution at which performance is evaluated. We revisit these evaluation choices for ICU mortality prediction on MIMIC-IV, comparing predictive-utility and subgroup-error metrics across several fairness interventions. As a complementary case study, we introduce a lightweight adaptation strategy that jointly balances ethnicity--gender--insurance representation without conditioning on mortality outcomes, allowing demographic representation balancing to be examined separately from outcome-conditioned or direct error-rate interventions. We evaluate its behavior at both marginal and corresponding three-way intersectional subgroup levels, while accounting for the statistical support of finer-grained estimates. The results show that interventions can receive substantially different assessments across accuracy/AUROC, sensitivity, and false-positive rate, and that marginal demographic summaries can conceal heterogeneous error profiles within their constituent intersections, including among larger subgroups. These findings highlight the importance of evaluating fairness interventions at both complementary metric and subgroup resolutions, while accounting for the intervention target and the reliability of subgroup estimates.

0.15

Ninety-Six Ways to Measure a Scribe: Fragmented Evaluation of Ambient Scribes in Healthcare

cs.HC cs.AI ·2026-11-10 ·Amama Mahmood, Shiye Cao, Laura Fleig, Junan Jiang, Theodore Jensen +3 more
hot direction similarity 0.51
Abstract

Ambient artificial intelligence (AI) scribes have moved rapidly from experimental pilots to enterprise-wide deployment across health systems, promising reduced documentation burden and improved clinician experience. While research evaluating these tools has expanded quickly, there are no agreed-upon protocols or standardized metrics for assessing their performance, making it difficult to compare findings or cumulatively synthesize evidence across studies. Across 54 recent evaluation studies, we identify ten evaluation dimensions and 40 distinct metrics, operationalized in 96 different ways-35 of them (36%) used by only a single study. Assessment is dominated by documentation efficiency and time, measured in 44 of 54 studies. The other dimensions appear at broadly similar rates (16-24 studies each), and safety and clinical outcome least consistently of all. Ripple effects on the broader care system, such as impact on patients' care outcomes, redistribution of work, changes in billing and coding intensity, and downstream use of notes by other clinicians are rarely assessed. Moreover, the metrics used rely heavily on self-report and are fragmented and inconsistently operationalized, which limits comparability and hinders synthesis across studies. As an effort to support more rigorous and cumulative evaluation, in this paper we review the study designs, data sources, and metrics commonly used to evaluate ambient AI scribes in healthcare settings, discuss the limitations of current evaluation practice, and argue for a more holistic approach grounded in a standardized, multi-dimensional set of metrics.

0.30

Healthcare Utilization, Chronic Condition Management, and Workplace Functioning Among Users of a Purpose-Built Mental Health AI (Ash): Cross-Sectional Study

cs.HC ·2026-09-08 ·Kristen M. Van Swearingen, Thomas D. Hull, Jeffrey Swigert, Caitlin A. Stamatis
similarity 0.51
Abstract

Mental health challenges can exacerbate physical symptoms and complicate management of chronic conditions. Purpose-built artificial intelligence (AI) tools may offer scalable support for co-occurring mental and physical health concerns. This cross-sectional study compared past-6-month healthcare utilization, chronic condition management, physical health behaviors, mental health change, and workplace functioning between active (n = 169) and non-users (n = 73) of a mental health AI (Ash). Participants had at least one chronic condition (e.g. hypertension, chronic pain). Binary outcomes were modeled as adjusted risk differences (RDs) using linear probability models and continuous outcomes were modeled with linear regression; all models were adjusted for hypertension. Relative to non-users, active users were more likely to report improved mental health (61.4% vs. 34.3%; RD = 0.27), higher medication adherence (91.7% vs. 76.4%, RD = 0.15), fewer skipped or delayed chronic-condition care activities (b = -0.44), and were less likely to report repeat urgent care visits (9.5% vs. 23.3%; RD = -0.15) and monthly-or-more absenteeism (24.2% vs. 45.2%; RD = -0.20, all ps < .05). Findings provide preliminary evidence that use of purpose-built AI may be associated with positive symptom-based and utilization outcomes for those managing co-occurring mental and physical concerns.

0.35

CareGraph: An Auditable Hybrid AI Framework for Evidence-Grounded Personalized Longitudinal Health Intelligence

cs.AI cs.IRcs.MA ·2026-08-25 ·Pratik Ghawate, Tanvi Patil
benchmarkcode/data similarity 0.50
Abstract · 21 pages, 7 figures, Code and data: https://github.com/PratikGhawate/ai-personalized-health-intelligence

Artificial intelligence is transforming personalized healthcare, yet fragmented clinical, self reported, and wearable evidence remains difficult to interpret and trace. We present CareGraph, an auditable hybrid AI framework that converts heterogeneous records into prioritized trends, missing context indicators, bounded next steps, discussion questions, and provenance linked explanations. CareGraph organizes evidence without diagnosing, predicting outcomes, selecting treatment, or making autonomous clinical decisions. Its pipeline covers deterministic analysis, context detection, graph construction, constrained language model synthesis, evidence validation, safety controls, and release gating. Tests used synthetic cohorts of 400 patients each for development, validation, and holdout. On holdout data, a frozen ordinary least squares trend rule with a sufficiency gate achieved 0.827 accuracy, 0.837 macro F1 with a 95 percent confidence interval of 0.819 to 0.854, and 0.974 insufficient data F1. Missing context detection achieved 0.815 strict micro F1 versus 0.318 for the legacy detector. On an authored holdout benchmark, safety ruleset version 1.2 achieved 1.000 precision, 0.950 recall, and 0.974 F1. An audit requiring graph retrieval across 80 patients yielded 79 syntheses and 78 presentations without fallback; one output was blocked and one failed closed because of an invalid evidence key. Against monolithic GPT 5.6 on 56 matched patients, CareGraph was faster at 40.15 versus 49.62 seconds, shorter at 661 versus 1,163 words, and showed better exploratory lexical alignment with longitudinal targets; the baseline used fewer tokens and cited more raw evidence. Graph auditing verified provenance and deterministic retrieval; incremental graph effects on generation require paired evaluation. CareGraph offers a safety bounded foundation for intelligent personalized health systems.

0.42