CS Paper Radar

Explainable Machine Learning for Broadband Adoption Disparities: Tract-Level Prediction and SHAP-Based Factor Profiling

Xiao Han

cs.LG ·submitted 2026-08-29 07:39 UTC · v1

Abstract

The United States has allocated approximately $65 billion through the Infrastructure Investment and Jobs Act for broadband expansion, yet evidence-based methods for targeting these investments remain underdeveloped. This paper presents an explainable machine learning framework for profiling broadband adoption disparities at census-tract granularity across 83,359 tracts nationwide. Using 65 socioeconomic, demographic, and infrastructure features derived from the American Community Survey 2022, we train a LightGBM model under spatial five-fold cross-validation, achieving R^2 = 0.533 and Spearman rho = 0.763; state-held-out cross-validation (51 folds) confirms generalization (R^2 = 0.525). TreeSHAP analysis identifies income and education as the dominant factor group (with the engineered interaction term absorbing attribution from its constituent features), and SHAP-based clustering reveals three exploratory factor profiles: Well-Connected Moderate (~49K tracts), Affordability-Limited Severe (~21K tracts), and Rural-Elderly (~13K tracts). As a screening tool, ML-based tract selection captures 38.0% of the total adoption gap within the top 10% of tracts versus 35.2% for income-only heuristics (+2.8 pp, p < 0.002, county-block bootstrap); in regret-reduction terms, the model closes 19% of the remaining gap between income-only and oracle selection. The primary contribution is the per-tract factor decomposition: SHAP identifies which feature groups (income/education, rurality, age) are most strongly associated with each tract's predicted gap, and informs differentiated investigation. A temporal stability check, training on ACS 2017 and predicting ACS 2022 with zero survey-year overlap, confirms ranking stability (rho = 0.784, noting hyperparameters tuned on 2022 data).

Closest papers

Nearest neighbours by meaning across the whole index.

Decision-Centered Evaluation of Machine Learning Poverty Maps Using Mobile Phone and Satellite Data

cs.CY ·2026-09-20 ·Chanuka Algama, Merl Chandana, Viren Dias, Kasun Amarasinghe
similarity 0.54
Abstract

Identifying the poorest communities is essential for poverty alleviation, but household surveys and censuses are costly and infrequent. Machine learning offers alternative poverty estimates from mobile phone and satellite data, yet average prediction accuracy alone does not show whether maps support targeting under limited budgets. We apply a decision-centered evaluation to 13,985 Grama Niladhari divisions in Sri Lanka, combining call detail records (CDRs), remote sensing (RS), and CNN-derived Landsat 8 embeddings. We assess recovery of the poorest administrative units, compare random and spatially grouped validation, and examine errors in socioeconomically atypical communities. Against a census-derived asset index (PC1), Random Forest achieves Recall@25\% of 0.830, compared with 0.450 for nighttime lights. Random splitting raises recall by 4.1 percentage points relative to Divisional Secretariat Division (DSD)-grouped holdouts. The combined model recovers 86\% of the 25 poorest DSDs by PC1, versus 69\% for RS-only and 67\% for CDR-only models. Spatially isolated divisions have 10.8\% higher prediction error. Stronger isolation--error association in RS-only models is consistent with spatial smoothing, although its cause remains unconfirmed. These findings support evaluating poverty maps by targeting performance and geographic transfer, while recognising that agreement with an asset index does not establish consumption-poverty accuracy.

0.20

Data Center Agglomeration and Power Infrastructure Capacity in the United States

cs.AR ·2026-11-04 ·Yutong Ma
published similarity 0.54
Abstract · 10 pages, 4 figures, 2 tables, conference paper that have been accepted after peer-review

The continuous expansion of digital infrastructure, especially data centers, has imposed unprecedented, geographically concentrated stress on existing power grids. However, rigorous causal evidence quantifying how these facilities reshape local power-infrastructure supply remains limited. This study builds a comprehensive county-level US panel dataset spanning 2010-2024, uniquely integrating individual data center building footprints and power-plant additions. To mitigate endogeneity and high-dimensional confounding, this study deploys Double Machine Learning with five-fold cross-fitting, conditioning on county and year fixed effects alongside regional socioeconomic covariates. Baseline estimation identifies a significant positive causal effect robust across multiple rigorous specifications. The result holds following 1%-99% winsorization that downweights mega-clusters including Loudoun County: growth in data-center floor area drives meaningful increases in nearby power-generation capacity (ATE=1.982, P=0.000, CI: [1.25, 2.72]). Outcomes remain statistically significant using a one-year lagged treatment to address reverse causality, and are stable under state-level fixed-effect alternatives. An event-study framework augmented with historical agglomeration controls validates clear parallel trends and detects a sharp causal spike at t = 3, matching typical utility-scale grid-construction lead times. A placebo test further verifies these causal estimates cannot emerge from random chance. Substantial regional heterogeneity emerges: strong positive impacts concentrate in the West, while significant negative displacement-related effects appear within resource-constrained Northeastern counties. These results deliver timely insights for urban planners and energy regulators, stressing the importance of forward-looking grid-capacity investment to support ongoing digital transformation.

0.42

Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment

cs.LG cs.CY ·2026-08-31 ·Saad Mohammad Abrar, Eesha Kurella, Arnav Dadarya, Naman Awasthi, Kazi Tasnim Zinat +1 more
similarity 0.53
Abstract

Human mobility is central to urban planning, transportation, public health, and emergency response, yet fine-grained trajectory data are often proprietary, restricted, and privacy-sensitive. Large language models (LLMs) offer a potential alternative by generating plausible mobility traces and predicting individual movement, but their ability to infer aggregate neighborhood-level mobility remains unclear. We evaluate zero-shot LLMs on Census Block Group-level mobility prediction across four U.S. metropolitan areas using anonymized Cuebiq data to construct point-level, trajectory-level, and temporal mobility outcomes, paired with sociodemographic and built-environment predictors. We compare LLM predictions with supervised baselines and introduce a directional alignment analysis to test whether LLM-implied predictor effects agree with empirical OLS and Jonckheere-Terpstra trends. Supervised models achieve 0.580 average accuracy, compared with 0.435 for the best LLM, with spatial extent outcomes showing the strongest predictability but also the largest LLM-baseline gaps. Directional analysis shows that LLMs often rely on coarse, stable predictor-level priors that remain similar across outcomes and cities, including asymmetric treatment of protected-group predictors. Overall, LLMs can partially recover aggregate mobility patterns from urban context, but their predictions should not be treated as structurally grounded without auditing empirical alignment and potential bias.

0.18

Quantifying geographic domain shift to decouple the geospatial transferability of human mobility flow generation models

cs.AI ·2026-08-21 ·Zhiyong Zhou, Song Gao, Qianheng Zhang, Feng Zhang, Zhenhong Du
publishedbenchmark similarity 0.52
Abstract · 28 pages, 4 figures

Human mobility serves as an essential proxy for understanding social, economic, and environmental dynamics in urban systems. Geospatial transferability, which measures a model's capability in a new location or unseen region, is a critical dimension for comparing different human mobility generation models. However, few studies have studied the intrinsic characteristics of geospatial transferability. To this end, this study systematically investigates the geospatial transferability of four representative human mobility generation models using a large-scale benchmark dataset of census tract level commuting flows across 2265 counties in the United States. Inspired by the domain adaptation theory in machine learning, we introduce geographic domain shift to describe the intrinsic differences in geographic feature distributions and spatial structures between source and target regions, which may jointly affect model transferability. Moreover, we propose two metrics, mutual information and spatial shift, to quantify the geographic domain shift. To examine their associations with model transferability, we employ linear mixed-effects regression to analyze the associations between geographic domain shifts and transferability. Our results reveal substantial spatial heterogeneity and asymmetry in transfer performance across regions. Both information shift and spatial shift exhibit statistically significant and complementary explanatory power. This indicates that geospatial transferability depends not only on model design but also on intrinsic geographic differences. These findings provide a novel methodological framework for evaluating and improving the geospatial transferability of human mobility generation models and support more robust and fair human mobility data synthesis across diverse regions. It also offers insights on spatial transferability for GeoAI model development.

0.41

Applying foundation model embeddings towards urban livability evaluation

cs.LG cs.CY ·2026-09-08 ·Ayush Khot, Wen Zhou, Shaowen Wang
published similarity 0.51
Abstract · 11 pages, 5 figures, 6 tables

While accurate measurement of socioeconomic indicators remains challenging in data-scarce regions, which limits policy interventions and resource allocation, high-resolution geospatial data is widely available and can contain information on various livability statistics. We investigate which physical features are encoded within foundation model embeddings, such as AlphaEarth, AnySat, and TerraMind, and provide a systematic framework for identifying the most predictive geospatial indicators. By analyzing how different types of geospatial data influence urban livability predictions, our approach enables researchers to prioritize the most informative features for their specific applications. Additionally, we demonstrate how to leverage foundation model embeddings to enhance prediction performance for these outcomes. This work contributes a principled methodology for extracting actionable information from satellite imagery while accounting for complex spatial dependencies, with applications in predicting urban livability in regions with limited observation data.

0.21

HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic Behavior

cs.CL ·2026-10-06 ·Jin Huang, Diego Ferreras Garrucho, Yutong Xie, Walter M. Yuan, Qiaozhu Mei +2 more
benchmark similarity 0.51
Abstract

Large language models (LLMs) have the potential to meet a key goal in economics: a quantitative model of household decision making, across a variety of settings. Yet existing evaluations cover few surveys and outcomes, and do not study how households adjust to changing economic conditions. We introduce a new evaluation, HouseholdBench, which unites 6 U.S. household surveys and 32 prediction tasks spanning numeric, categorical and probabilistic outcomes, related to consumption, income, labor, expectations, and housing. Using past behavior, demographics and macroeconomic conditions, the tasks test whether LLMs predict behavior, including how households adjust to changes in various policies. We evaluate 13 proprietary and open-weight LLMs against a no-change baseline and a gradient-boosted tree model. Most LLMs outperform the no-change baseline, including for policy response tasks -- with the best model lowering error for numeric outcomes by 12.2%. Across most tasks, gradient-boosted trees rank first; leading proprietary LLMs approach their performance, but open-weight models lag. LLMs exhibit systematic over- and underprediction across different tasks. We identify methods that enable a 4 billion parameter open-weight model to match proprietary models' performance: fine-tuning and aggregating 16 predictions per observation. Improvements generalize to policy-response tasks, which are excluded from fine-tuning. We release our datasets, code, and leaderboard on our website: https://jn-huang.github.io/householdbench

0.31

Beyond the Desert Label: A Pathway Diagnostic for User-Centered Smart Mobility Service Design

cs.CY ·2026-09-18 ·Oluwasegun Adegoke, Sevgi Erdogan
similarity 0.50
Abstract · 5 pages, 4 figures. Accepted for publication in the Proceedings of the 2026 IEEE International Smart Cities Conference (ISC2), Workshop W02,…

Smart-city mobility platforms increasingly rely on spatial screening tools to identify neighborhoods where public transit fails dependent users, but a single transit desert label can mask very different user problems: localized mismatch between service and concentrated need, or basic absence of usable service. These call for different user-centered responses. This paper introduces a pathway-based, reproducible, data-driven diagnostic that distinguishes relative transit mismatch from minimum-service failure and reports the specific service attributes (frequency, span, weekend service, walking access, and destination accessibility) driving each classification. The workflow combines open data (GTFS, ACS, LEHD, Census, and OpenStreetMap), detects spatially coherent mismatch using Local Moran's I, and applies an equity-informed service-failure test that centers vulnerable users. Applied to Baltimore, Philadelphia, Nashville, and Dallas, the diagnostic shows that legacy-transit cities are dominated by localized mismatch, while auto-oriented cities show broader minimum-service failure, with distinct service-deficit profiles in each case. By making the mechanism behind an under-service label explicit, the tool supports more inclusive, user-centered smart-mobility planning across cities with different transit baselines.

0.25

Profile-Based Auditing of Domestic Violence Survey Selection Across South Asia

cs.LG ·2026-11-11 ·Mohammad Abu Obaida Mullick, Rezaur Rahman Ratul, Mymuna Nourin, Md. Motaharul Islam
top venue similarity 0.49
Abstract · Accepted at the AI4Science and NewinML Workshops (NeurIPS 2026)

Domestic violence (DV) data in the Demographic and Health Surveys (DHS) are collected through a specialized module whose household-level sampling and privacy requirements create a distinct observation process. We ask whether demographic, socioeconomic, and household characteristics form reproducible population profiles and whether these profiles contain information about selection into the DV module across South Asia. Using DHS Individual Recode data for 796,374 women aged 15-49 across Afghanistan, India, Myanmar, Nepal, and Pakistan, we harmonize 61 numeric and 8 categorical features, reduce the profile space with PCA, and identify six interpretable profiles. We then evaluate 22 machine-learning models under primary-sampling-unit-aware holdout validation. The best model, HistGradientBoosting, achieves ROC-AUC 0.9167 and PR-AUC 0.9612, versus 0.8475 and 0.9203 for a design-only baseline. Adding woman-level characteristics yields the largest incremental gain, while explicit interaction terms add little out-of-sample performance. Country-specific analyses reveal substantial heterogeneity, and leave-one-country-out evaluation shows that transferability of the incremental profile signal is limited. These results demonstrate that interpretable ML can audit differential coverage in sensitive survey modules beyond the formal sampling design.

0.38