CS Paper Radar

Reconstructing the Human Development Index at the Individual Level from Survey Microdata: Development and Validation of a Methodology

Tcharlies Bachmann Schmitz, Natalia Veronez da Cunha, Isabelle Ferreira

cs.LG stat.APecon.GN ·submitted 2026-09-12 15:08 UTC · v1
unusual

Abstract

This study proposes and validates a methodology for reconstructing the Human Development Index (HDI) from individual-level survey microdata, enabling disaggregated estimates for demographic subpopulations while maintaining coherence with the official HDI. Data from 40,185 respondents in 21 countries from the European Social Survey (ESS7, 2014) were analysed, combined with World Bank indicators for life expectancy, gross national income per capita, and expected years of schooling. The health dimension was estimated from national life expectancy, adjusted by self-rated health; income, by a lognormal multiplier calibrated by the Gini coefficient; and education, by combining observed and expected years of schooling. The dimensions were aggregated by geometric mean, weighted by sampling weights, with confidence intervals estimated via the delta method. Among the 39,706 individuals with valid data (98.8%), the reconstructed HDI showed high agreement with the official 2014 HDI, with a mean absolute error of 0.0099 and a Pearson correlation of 0.917. Consistent differences across subgroups evidenced the methodology's convergent validity and its capacity to produce disaggregated estimates of human development, expanding the HDI's potential for analyses of socioeconomic and demographic inequalities.

Comment
12 pages, 3 figures. Replication notebook and data archived at https://doi.org/10.5281/zenodo.22714205

Closest papers

Nearest neighbours by meaning across the whole index.

Addressing Bias Early in the AI Lifecycle: Social Determinants of Health in Functional and Cognitive Assessment Labels of Nursing Home Residents

cs.LO stat.OT ·2026-11-08 ·Isabel Amaya-Rodríguez, Cristina Martin, Nekane Larburu, Teresa Garcia-Navarro, Roberto González Novas +8 more
similarity 0.54
Abstract · 14 pages, 24 tables

Fairness in clinical artificial intelligence (AI) is usually evaluated after model training, yet bias can enter earlier in the AI lifecycle, during data collection and labelling. When routine clinical assessments serve as target variables, systematic differences in these labels across sociodemographic groups are carried into model development, validation and updating. This study addresses this early lifecycle stage by auditing labels from three standardised instruments used in residential care: the Barthel Index (BI), the Mini-Mental State Examination (MMSE) and the Global Deterioration Scale (GDS). Using electronic health records of 2,407 residents from 12 nursing homes in the Basque Country, Spain (2011-2021), we assessed four social determinants of health (SDoH) - sex, educational attainment, lifetime work activity and marital status - with two group fairness metrics, Disparate Impact (DI) and Statistical Parity Difference (SPD), computed for each outcome category with bootstrap confidence intervals. Disparities were found for all four attributes and across the three instruments: men, residents with intermediate education and never-partnered residents were more frequently classified in categories indicating preserved function or cognition. These disparities may reflect genuine differences in health status, measurement properties of the instruments, assessment practices or selective admission to residential care, and cannot be attributed to a single cause with the present design. Regardless of their origin, any model trained on these labels would inherit them, and they could persist through later lifecycle stages unless explicitly examined. These findings support pre-training label auditing as the first step of a continuous fairness assessment spanning model development, validation, deployment and updating.

0.33

Online and Survey Representations of Well-Being: Coherence and Cross-Source Correspondence

cs.LG econ.EMphysics.soc-phstat.AP ·2026-09-29 ·Stefano M. Iacus, Giuseppe Porro, Haodong Qi
similarity 0.53
Abstract

Digital traces may complement population surveys in the measurement of well-being, but the two sources do not necessarily capture identical constructs. We compare the Human Flourishing Geographic Index (HFGI) with World Values Survey and European Social Survey measures across three domains using structural equation models. The results show strong within-source coherence and construct-specific cross-source correspondence. Cross-source convergence varies across domains; the observed pattern is consistent with stronger correspondence where the underlying indicators are more closely aligned conceptually. Near-perfect agreement would be unexpected, since surveys elicit standardized self-reports, whereas HFGI captures naturally occurring public expressions. HFGI should therefore be viewed as a distinct but empirically connected measurement system that complements survey-based evidence on well-being.

0.23

Using AI Predictions to Augment Rather Than Replace Surveys

cs.CY ·2026-11-04 ·Lai Wei, Yifei Zhu
similarity 0.47
Abstract

LLMs can predict human survey responses with nontrivial accuracy. What this means for the future of social surveys remains hotly contested. Optimists anticipate a coming era of synthetic respondents; skeptics see a fragile and overhyped substitute. This article advocates a position: AI predictions cannot replace surveys, but they can augment them. Using prediction-powered inference (PPI), a statistical framework rooted in survey methodology and known in sociology as "mixed subjects design", the study tests whether AI predictions can improve the statistical efficiency of social surveys when combined with census-scale auxiliary information. Applying the framework to 83 social outcomes in the General Social Survey (GSS) and National Health Interview Survey (NHIS), with American Community Survey (ACS) being the auxiliary file, we find that supervised predictors yield effective-sample-size gains of about 7-12 percent when estimating the mean, while LLM gains are smaller but positive.

0.22

Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment

cs.CY stat.AP ·2026-08-24 ·Eunjeong Song, Sehee Hong
surveytheory similarity 0.44
Abstract · 27 pages, 2 figures, 6 tables. Data, materials, and code: https://doi.org/10.7910/DVN/BUFIGC

We examine how strongly demographic-distribution diagnostics of LLM-based synthetic persona data depend on the official statistics chosen as the reference. We compared the sex $\times$ age-group $\times$ province joint distribution of the 1,000,000 Nemotron-Personas-Korea (NPK) records with Korean official statistics using total variation distance (TVD). Against the resident-registration population for April 2026, the time of use, the upper bound on the share discrepancy of any subgroup defined by the three variables was 1.81 percentage points, the margin of error of a survey with about 2,900 respondents. This value, however, depended on the reference date and population definition of the official statistics. The closest candidate examined, the 2024 census distribution for Korean nationals, gave 0.56 percentage points; no monthly resident-registration reference was closer. The reference distributions themselves also moved: between January 2025, when NPK's distance was smallest, and April 2026, the resident-registration distribution moved by more than twice that minimum distance, as did the census Korean-national distribution between 2024 and 2025. Raking reduced the range of the distance across reference months to about one fifth. Cell poststratification was applicable because none of the 204 cells was empty, and neither scheme produced extreme weights. Demographic alignment is necessary but not sufficient for response validity, and even this basic diagnostic depends on the choice of reference distribution. Providers should therefore disclose the source, reference date, population definition, and joint-cell allocation procedure of the official statistics used for demographic attributes, and users should repeat the diagnosis and adjustment against statistics current at the time of use.

0.40

Geospatial Foundation Models Capture Health-Relevant Dimensions of Place Beyond Conventional Social Risk Indices

cs.LG stat.AP ·2026-09-10 ·Nathaniel Hendrix, Carl Y. Zhang, Chris Heitzig, Andrew Bazemore, David H. Rehkopf
similarity 0.43
Abstract

Area-based social risk indices summarize residents' socioeconomic conditions but incompletely capture physical features of place that may affect health. We evaluated whether numerical representations of physical place produced by four geospatial foundation model families from 2022 satellite data explained residual variance in tract-level associations between the Area Deprivation Index, Social Deprivation Index, and Social Vulnerability Index with health outcomes. We used LightGBM to predict variables from the American Community Survey and 40 chronic disease and health-behavior outcomes from CDC PLACES across 82,646 census tracts in the contiguous United States, evaluating performance across 10 held-out states. Among survey variables, models were moderately predictive of some variables including housing type (R-squared up to 0.54) but weak for disability, unemployment, and income disparity. For health outcomes, models explained up to 54% of variance left unexplained by social risk indices, with the largest gains for annual checkups, arthritis, and high blood pressure. Mean total variance explained by geospatial foundation models across the 40 health-related outcomes increased from 0.31 in the smallest tract-size decile to 0.39 in the largest. Geospatial foundation models capture health-relevant features of place not represented by conventional social risk indices and may usefully augment them in epidemiological analyses.

0.33

Profile-Based Auditing of Domestic Violence Survey Selection Across South Asia

cs.LG ·2026-11-11 ·Mohammad Abu Obaida Mullick, Rezaur Rahman Ratul, Mymuna Nourin, Md. Motaharul Islam
top venue similarity 0.43
Abstract · Accepted at the AI4Science and NewinML Workshops (NeurIPS 2026)

Domestic violence (DV) data in the Demographic and Health Surveys (DHS) are collected through a specialized module whose household-level sampling and privacy requirements create a distinct observation process. We ask whether demographic, socioeconomic, and household characteristics form reproducible population profiles and whether these profiles contain information about selection into the DV module across South Asia. Using DHS Individual Recode data for 796,374 women aged 15-49 across Afghanistan, India, Myanmar, Nepal, and Pakistan, we harmonize 61 numeric and 8 categorical features, reduce the profile space with PCA, and identify six interpretable profiles. We then evaluate 22 machine-learning models under primary-sampling-unit-aware holdout validation. The best model, HistGradientBoosting, achieves ROC-AUC 0.9167 and PR-AUC 0.9612, versus 0.8475 and 0.9203 for a design-only baseline. Adding woman-level characteristics yields the largest incremental gain, while explicit interaction terms add little out-of-sample performance. Country-specific analyses reveal substantial heterogeneity, and leave-one-country-out evaluation shows that transferability of the incremental profile signal is limited. These results demonstrate that interpretable ML can audit differential coverage in sensitive survey modules beyond the formal sampling design.

0.47

Marginal Fidelity Does Not Establish User Simulation in Demographic Synthetic Survey Panels: Response Contracts, Support Collapse and Conditioning Failure

cs.CL cs.HC ·2026-09-07 ·Alexander Doudkin
unusual similarity 0.42
Abstract · 28 pages, 2 figures

Demographic synthetic survey panels are often validated by matching aggregate answers to published surveys. We test what that certificate establishes across six multiselect batteries from four survey organisations in three countries. The headline analysis is restricted to three instruments whose synthetic cohort and human target share the stated population frame; three other batteries remain sensitivity analyses. The response contract dominates measured fidelity. In the aligned instruments, committed sets leave 66 of 128 model-battery option slots empty in panels of up to 500 respondents, versus 0 of 128 under per-option probability elicitation. Across eight uncapped model-instrument comparisons, probabilities reduce option-marginal MAE by 4.53 to 7.30 points. The capped instrument reverses on two models until the vectors are projected onto its stated maximum. These are measurement effects: human targets are realised check-all responses, whereas the vectors are latent inclusion propensities. Published marginal agreement also fails to discriminate respondent simulation from direct population estimation. On nine aligned model-battery pairs, a no-persona population-prevalence query averages 6.27 MAE versus 12.39 for committed panels and wins all nine comparisons. Constraint-aware probability vectors average 5.34 and beat the query on four of nine, so the baseline challenges the validation criterion rather than proving direct estimation uniformly best. On three unpublished demographic cells, neither approach beats reciting the national distribution. Population-marginal agreement is therefore evidence about an elicitation contract and an estimand obtainable without simulated respondents, not evidence of individual simulation.

0.62

Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations

cs.CL cs.AI ·2026-09-24 ·Yeeun Chae, Yewon Choi, Seunghyun Lee, IL Im
published similarity 0.41
Abstract · Accepted to the EMNLP 2026 Workshop on Pluralistic AI & NLP (PANDORA)

Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural survey simulation, evaluations should assess not only distributional fidelity within countries but also whether differences across countries are preserved. However, existing distance-based metrics such as Jensen--Shannon divergence (JSD) do not directly capture such cross-country differences. To address this limitation, we introduce Cultural Divergence Preservation (CDP), a reference-light diagnostic based on a one-time human calibration. CDP identifies reduced cross-country divergence as cultural flattening and increased divergence as cultural caricature. To evaluate CDP, we conduct experiments across four LLM backbones, three persona-based prompting methods, and two survey domains, the World Values Survey (WVS) and the Big Five Personality Test. The results reveal a systematic discrepancy between conventional fidelity metrics and CDP. Controlled experiments show that CDP changes monotonically as cross-country divergence is attenuated or amplified, while the corresponding changes in JSD remain relatively small. In our audit of real LLM generations, DeepPersona-Inspired prompting is frequently favored by conventional fidelity metrics but exhibits the strongest flattening in every model--domain block. CDP thus complements fidelity metrics by directly quantifying the attenuation or amplification of cross-country divergence.

0.48