CS Paper Radar

Profile-Based Auditing of Domestic Violence Survey Selection Across South Asia

Mohammad Abu Obaida Mullick, Rezaur Rahman Ratul, Mymuna Nourin, Md. Motaharul Islam

cs.LG ·submitted 2026-11-11 06:34 UTC · v2
top venue

Abstract

Domestic violence (DV) data in the Demographic and Health Surveys (DHS) are collected through a specialized module whose household-level sampling and privacy requirements create a distinct observation process. We ask whether demographic, socioeconomic, and household characteristics form reproducible population profiles and whether these profiles contain information about selection into the DV module across South Asia. Using DHS Individual Recode data for 796,374 women aged 15-49 across Afghanistan, India, Myanmar, Nepal, and Pakistan, we harmonize 61 numeric and 8 categorical features, reduce the profile space with PCA, and identify six interpretable profiles. We then evaluate 22 machine-learning models under primary-sampling-unit-aware holdout validation. The best model, HistGradientBoosting, achieves ROC-AUC 0.9167 and PR-AUC 0.9612, versus 0.8475 and 0.9203 for a design-only baseline. Adding woman-level characteristics yields the largest incremental gain, while explicit interaction terms add little out-of-sample performance. Country-specific analyses reveal substantial heterogeneity, and leave-one-country-out evaluation shows that transferability of the incremental profile signal is limited. These results demonstrate that interpretable ML can audit differential coverage in sensitive survey modules beyond the formal sampling design.

Comment
Accepted at the AI4Science and NewinML Workshops (NeurIPS 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations

cs.CL cs.AI ·2026-09-17 ·Sarah Wyer, Sue Black, Noura Al Moubayed
top venue similarity 0.55
Abstract · Accepted at EMNLP 26 Main Conference

Safety evaluations for large language models rely on surface-form classifiers that report declining harm scores across model generations. We provide evidence that this methodology is systematically incomplete: explicit discriminatory content is transformed rather than removed. We call this \emph{harm laundering}. Analysing 450,000 gender-directed completions across 15 models spanning GPT-2 through to GPT-5 (OpenAI GPT lineage; three demographic conditions), we show that sexual violence clusters prevalent in GPT-2 women-directed output disappear by GPT-4, while men-directed completions gain positive representational territory (caregiving, emotional range, ally identity) that women-directed completions do not. The pattern is most visible at GPT-5: Topic~5 (1,997~documents) frames breast cancer as a men's rights debate, while zero equivalent clusters appear in women-directed output. Three independent classifiers score this content as non-toxic. Sentiment scores invert at GPT-4: early models demean women; later models over-correct. Topic diversity in women-directed completions falls 36\% relative to men at the GPT-4 alignment boundary (W/M~$= 0.58$, from $0.91$ at GPT-2). REGARD representational harm disparity correlates with release date ($ρ= +0.55$, $p = .034$) while Detoxify does not ($ρ= -0.23$, $p = .42$): toxicity scores fall as representational harm grows. We formalise harm laundering as a three-criteria test and provide a three-stage detection protocol applicable to any generative model. Within the OpenAI GPT lineage, toxicity score reduction is not a sufficient proxy for harm reduction.

0.54

Multidimensional Suicide Risk Assessment with Machine Learning using Electronic Health Records

cs.LG ·2026-11-02 ·Nathan Scollar, Kemal Davaslioglu, Nathan Conger, Sastry Kompella, Yalin E. Sagduyu +1 more
similarity 0.54
Abstract · IEEE Healthcom 2026

Suicide prevention remains a critical public health challenge, and electronic health records (EHRs) provide an opportunity to characterize suicide-related risk indicators using documented clinical, behavioral, medical, and social-contextual information. This paper presents a multidimensional machine learning framework to model and estimate suicide-related outcomes using MIMIC-IV EHR data. We construct clinically motivated diagnosis categories and define a composite outcome from documented codes corresponding to suicidal ideation, suicide attempt, prior suicidal behavior, and intentional self-harm. To address severe class imbalance and reduce age-related confounding, we apply age-matched resampling that retains all positive patients and samples comparison-cohort patients from the same age group. Logistic regression, random forest, and XGBoost classifiers are evaluated before and after resampling with isotonic calibration. The calibrated XGBoost model achieves the strongest matched-cohort performance, outperforming the other evaluated classifiers. SHAP-based interpretation shows that diagnostic burden, depression-related features, age, personality-disorder history, social determinants related to violence, and medical comorbidity contribute to elevated predicted probabilities. Our results demonstrate that combining broad EHR-derived features, age-matched cohort construction, calibration, and feature-level interpretation provides a practical framework for retrospective suicide-related risk modeling.

0.23

Necessary for What? Auditing Demographic Disclosure to LLM Synthetic Respondents

cs.CY cs.CL ·2026-11-16 ·Aspen Wang, Yen Yu Shan, Lun-Wei Ku
surveycode/data similarity 0.53
Abstract · 29 pages, 10 figures, 11 tables; Code: https://github.com/aspenywang/necessary-for-what

Large language models (LLMs) increasingly answer surveys on behalf of real panelists, and each panelist's recorded demographic attributes (e.g., age, education, ethnicity) are often placed in the prompt on the premise that richer profiles make more faithful synthetic respondents. While data minimization limits personal data to what a purpose requires, a synthetic survey serves several purposes at once, from predicting individual answers to estimating how opinions are distributed and comparing groups. We ask which of these purposes require the respondent's record, and whether improved estimates support sound conclusions about groups. We vary whose profile a model receives, where it comes from, and how many fields it contains, in two U.S. surveys with eleven open-weight and three hosted models, and compare each model with a statistical model fit to the same information. We make four contributions. First, we show that the record adds little to individual predictions and that, for the open-weight models, most of its gain in population estimates remains when it is replaced by census data or a synthetic persona. Second, we find that group comparisons improve only with the respondent's own record, and that even then the models' group differences rest more on the demographic label in the prompt than on the individual respondent, which the usual check of reproducing known group differences does not reveal. Third, we find that the models make groups look more alike than they are, keeping differences in circumstances while flattening or reversing differences in attitudes, most sharply for religious affiliation and ethnic origin, both special categories of personal data. Fourth, we outline an audit that a survey organization can run on questions it has already fielded to decide which estimates may use the record.

0.32

Using AI Predictions to Augment Rather Than Replace Surveys

cs.CY ·2026-11-04 ·Lai Wei, Yifei Zhu
similarity 0.52
Abstract

LLMs can predict human survey responses with nontrivial accuracy. What this means for the future of social surveys remains hotly contested. Optimists anticipate a coming era of synthetic respondents; skeptics see a fragile and overhyped substitute. This article advocates a position: AI predictions cannot replace surveys, but they can augment them. Using prediction-powered inference (PPI), a statistical framework rooted in survey methodology and known in sociology as "mixed subjects design", the study tests whether AI predictions can improve the statistical efficiency of social surveys when combined with census-scale auxiliary information. Applying the framework to 83 social outcomes in the General Social Survey (GSS) and National Health Interview Survey (NHIS), with American Community Survey (ACS) being the auxiliary file, we find that supervised predictors yield effective-sample-size gains of about 7-12 percent when estimating the mean, while LLM gains are smaller but positive.

0.22

Making Fragmented Reports Legible: Finding Patterns and Perceptions of Sexual Violence in Bangladesh

cs.HC cs.CY ·2026-09-21 ·Sheherjan Haq, Sharifa Sultana
similarity 0.52
Abstract · 14 pages, 6 figures, and 7 tables

Evidence about sexual violence in Bangladesh is fragmented across individual reports, while official and civil-society statistics rarely provide reusable case-level detail. We examine how structured analysis can make one part of this fragmented record legible without treating it as prevalence data. Our corpus contains 2,811 articles timestamped 2013-2023 from the Prothom Alo publishing ecosystem; 2,794 include parseable metadata about reported victims, alleged perpetrators, incidents, legal responses, and locations. We combine descriptive and spatial analysis of these records with thematic analysis of 115 convenience-sample survey responses collected in late 2020. The corpus documents many young, female, and student victims, frequent acquaintance and neighbor relationships, uneven geographic documentation, and substantial missingness in legal outcomes. Respondents most often describe weak enforcement, insecurity, patriarchal socialization, education gaps, and community inaction as conditions enabling persistence. These findings characterize news documentation and public perceptions; they do not estimate incidence, geographic risk, or causality. We contribute an uncertainty-aware framing for HCI research using sensitive, low-resource news data and identify design requirements for provenance, privacy, validation, and responsible communication.

0.39

HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic Behavior

cs.CL ·2026-10-06 ·Jin Huang, Diego Ferreras Garrucho, Yutong Xie, Walter M. Yuan, Qiaozhu Mei +2 more
benchmark similarity 0.51
Abstract

Large language models (LLMs) have the potential to meet a key goal in economics: a quantitative model of household decision making, across a variety of settings. Yet existing evaluations cover few surveys and outcomes, and do not study how households adjust to changing economic conditions. We introduce a new evaluation, HouseholdBench, which unites 6 U.S. household surveys and 32 prediction tasks spanning numeric, categorical and probabilistic outcomes, related to consumption, income, labor, expectations, and housing. Using past behavior, demographics and macroeconomic conditions, the tasks test whether LLMs predict behavior, including how households adjust to changes in various policies. We evaluate 13 proprietary and open-weight LLMs against a no-change baseline and a gradient-boosted tree model. Most LLMs outperform the no-change baseline, including for policy response tasks -- with the best model lowering error for numeric outcomes by 12.2%. Across most tasks, gradient-boosted trees rank first; leading proprietary LLMs approach their performance, but open-weight models lag. LLMs exhibit systematic over- and underprediction across different tasks. We identify methods that enable a 4 billion parameter open-weight model to match proprietary models' performance: fine-tuning and aggregating 16 predictions per observation. Improvements generalize to policy-response tasks, which are excluded from fine-tuning. We release our datasets, code, and leaderboard on our website: https://jn-huang.github.io/householdbench

0.31

Does Lifestyle Information Improve Hypertension Prediction? A Leakage-Controlled Evaluation on NHANES

cs.LG ·2026-11-14 ·Uriel Benymon
top venuecode/data similarity 0.51
Abstract · Accepted to the Machine Learning for Health (ML4H) 2026 Symposium, Findings Track. Code: https://github.com/urielbenymon/nhanes-lifestyle-hy…

Does readily available lifestyle information improve machine-learning prediction of hypertension beyond routine demographic and anthropometric data? On NHANES 2017-March 2020, five model families (Logistic Regression, Random Forest, Gradient Boosting, Bagged Decision Trees, and XGBoost) were evaluated with fold-local preprocessing and paired bootstrap confidence intervals. Adding physical activity, alcohol use, smoking, and sleep information showed no consistent detectable improvement in held-out discrimination: every paired ROC-AUC confidence interval included zero, including under a stricter measured-blood-pressure phenotype and without synthetic oversampling. Mean cross-model SHAP rank agreement fell from 0.873 to 0.806 over all encoded columns, but this decline was largely attenuated over the 19 baseline columns shared by both arms (0.873 vs. 0.863), and likewise under both robustness checks; attribution-agreement comparisons across feature sets of different sizes therefore require a matched comparison space. In exploratory analysis of untreated adults (measured-blood-pressure outcome), all five models showed small positive differences, two with unadjusted intervals excluding zero, meriting confirmation. These results do not imply that lifestyle factors are clinically unimportant; within this cohort, the evaluated lifestyle block added little incremental discrimination beyond an already-informative baseline.

0.48

Machine-Learning Assessment of the Predictive Value of Inflammatory Biomarkers for Cognitive Impairment in an Older Hispanic Adult Cohort

cs.LG ·2026-09-16 ·Antony Garcia, Gabrielle Britton, Alcibiades Villarreal, Diana Oviedo, Giselle Rangel +1 more
similarity 0.51
Abstract

Small clinical tabular datasets require interpretable machine learning because deep learning is often impractical and ensemble models can be difficult to inspect. A key pitfall is that statistical significance does not necessarily imply predictive utility. Using data from the Panama Aging Research Initiative--Health Disparities (PARI-HD) cohort (n=165), we implemented a leakage-safe threshold-likelihood Bernoulli/Categorical Naive Bayes (BNB/CNB) classifier. Within every training fold, each continuous predictor was reduced to a supervised chi-square-derived state, while income entered the model through a categorical likelihood. All data-dependent steps were performed within repeated stratified 10-fold cross-validation with 30 repeats. The demographic baseline achieved a ROC-AUC of 0.630 +/- 0.017. I-309 (CCL1) was the dominant incremental feature, increasing AUC by 0.110, with paired DeLong tests yielding p<0.05 in 100% of repeats. In the pre-specified primary analysis, I-309 produced a fixed-partition DeLong p=0.0018, with robustness assessed across 200 random partitions, where the median p-value was 0.0011. Within the exploratory family of 18 candidate markers, I-309 achieved a Benjamini-Hochberg-adjusted q=0.032 on the frozen partition and satisfied q<0.05 in 85% of random partitions, whereas no other marker demonstrated reliable incremental predictive value. Because the fitted model is an inspectable table of thresholds and class-conditional probabilities, these results identify I-309/CCL1 as an interpretable candidate feature for tabular prediction of cognitive impairment, pending external validation.

0.33