CS Paper Radar

Is Your Neighborhood Safe? Place-based Stigma in Large Language Models' Urban Safety Judgments

Huy Nguyen, Yue Lin

cs.AI ·submitted 2026-08-23 02:40 UTC · v1

Abstract

Large language models are increasingly used to inform safety decisions in cities, such as where it is safe to walk, rent, or travel. We ask whether such judgments track measured risk or the patterns attached to an urban neighborhood's name. We probe seven instruct-tuned models under three conditions that dissociate name from geography: coordinates-only, name-only, and name+coordinates, across 186 neighborhoods in Los Angeles and Chicago, joined to violent crime and American Community Survey data. First, ratings are nearly flat under coordinates for six of seven models, while names carry most between neighborhood variation and are moderately calibrated to violent crime; only at frontier scale does the coordinate channel show appreciable variation. Second, names lower safety ratings more for neighborhoods with higher shares of the locally dominant marginalized group (percent Black in Chicago, percent Hispanic in Los Angeles), and this name effect tracks demographic share in all seven models and both cities. In Los Angeles, where demographic share and crime are more separable, the effect survives controls for crime and income and is confirmed by crime-matched pairs. An enforcement-elasticity analysis further shows that over-caution tracks near-fully-reported homicide rather than discretionary, deployment-driven offenses. Third, the effect scales with geographic knowledge: models that better distinguish real neighborhoods apply more demographic stereotype to them. Because neighborhood names carry both genuine crime signal and demographic stereotype, removing names reduces both bias and accuracy. We discuss implications for deploying LLMs in advice and decision-support settings.

Comment
12 pages, 8 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment

cs.LG cs.CY ·2026-08-31 ·Saad Mohammad Abrar, Eesha Kurella, Arnav Dadarya, Naman Awasthi, Kazi Tasnim Zinat +1 more
similarity 0.65
Abstract

Human mobility is central to urban planning, transportation, public health, and emergency response, yet fine-grained trajectory data are often proprietary, restricted, and privacy-sensitive. Large language models (LLMs) offer a potential alternative by generating plausible mobility traces and predicting individual movement, but their ability to infer aggregate neighborhood-level mobility remains unclear. We evaluate zero-shot LLMs on Census Block Group-level mobility prediction across four U.S. metropolitan areas using anonymized Cuebiq data to construct point-level, trajectory-level, and temporal mobility outcomes, paired with sociodemographic and built-environment predictors. We compare LLM predictions with supervised baselines and introduce a directional alignment analysis to test whether LLM-implied predictor effects agree with empirical OLS and Jonckheere-Terpstra trends. Supervised models achieve 0.580 average accuracy, compared with 0.435 for the best LLM, with spatial extent outcomes showing the strongest predictability but also the largest LLM-baseline gaps. Directional analysis shows that LLMs often rely on coarse, stable predictor-level priors that remain similar across outcomes and cities, including asymmetric treatment of protected-group predictors. Overall, LLMs can partially recover aggregate mobility patterns from urban context, but their predictions should not be treated as structurally grounded without auditing empirical alignment and potential bias.

0.18

Urban Representation Learning for Identifying Potential Disparities in Crime Reporting

cs.LG cs.CYcs.IR ·2026-11-16 ·Jorge Valverde-Rebaza, Carlos Paez De La Cruz, Pedro Pérez-Collado, Daniel Sánchez-Cataño, Eashley Martínez-Vergara
top venue similarity 0.57
Abstract · Accepted for publication in International Conference on Artificial Intelligence, Computer, Data Sciences, and Applications (ACDSA 2027)

Open crime data support urban safety analysis but reflect reported incidents rather than the complete distribution of criminal activity, potentially introducing spatial distortions in downstream analysis. We propose a self-supervised urban representation learning framework for identifying unusual reporting patterns relative to representation-similar peers using only georeferenced crime records. The method constructs complementary hourly, weekly, and static reporting profiles, learns scale-specific representations under geographic self-supervision, and integrates them into a unified latent space. Neighbor Profile Divergence (NPD) is then used to quantify disagreement between each region's reporting profile and those of its retrieved peers. Experiments on more than 1.8 million crime records from Mexico City, aggregated into 1,058 H3 regions, show that the proposed representation achieves a mean Silhouette score of 0.4052, compared with 0.2863 for Hex2Vec. NPD rankings remain highly stable across neighborhood sizes, with Spearman correlations from 0.9720 to 0.9951, while most high-divergence candidates persist across configurations. The retrieved peers also extend substantially beyond immediate geographic neighborhoods, indicating that the learned representation captures structure beyond local spatial proximity. High-divergence regions exhibit spatially organized patterns and, in several cases, differences in incident volume relative to peer expectations. These results support NPD as an internal auditing and prioritization mechanism for identifying regions that warrant further investigation, rather than as direct evidence of underreporting.

0.35

Experienced partisan segregation across patterns of mobility behavior in US cities

cs.SI physics.soc-ph ·2026-09-16 ·Marco Tonin, Michele Tizzoni, Bruno Lepri, Esteban Moro
similarity 0.57
Abstract

Residential and social sorting along political lines structure Americans' daily interactions, often limiting encounters with opposing viewpoints. Here, we combine high-resolution anonymized mobility data from 11 major U.S. metropolitan areas with precinct-level voting results to quantify and examine individuals' experienced partisan segregation in urban areas. We find that residential context provides a strong baseline for political exposure, but experienced partisan segregation is also shaped by everyday mobility behavior, since individuals living in similar residential environments can experience different levels of partisan segregation depending on their daily routines. In particular, individuals who travel farther encounter more politically diverse environments, especially in highly segregated areas, indicating that mobility range moderates the relationship between residential and experienced segregation, while exploring a wider range of places does not reduce partisan segregation and may even reinforce it. Moreover, place segregation largely reflects political geography, yet categories of points of interest have distinct segregation patterns, with community places and social businesses tending to attract more left-leaning visitors, reflecting visitation patterns rather than local accessibility alone. Our findings show that experienced partisan segregation extends beyond residential geography and is also associated with the mobility behavior and visitation patterns that structure people's daily lives.

0.22

In the Guise of Correction: How Framing and Cultural Adaptation Erode LLM Safety on Real-World Criminal Cases

cs.CL cs.AIcs.CY ·2026-10-15 ·Mohsinul Kabir, Md. Tariquzzaman, Karam S. R. Elradie, Polydoros Giannouris, Yuechen Jiang +2 more
benchmarkhot direction similarity 0.56
Abstract · Under Review

Existing safety benchmarks rely largely on synthetic prompts with loosely grounded taxonomies and offer little focused analysis of severe crime categories. We introduce GUISE, a benchmark of criminal-assistance scenarios sourced from real-world cases and organised under a taxonomy from the UNODC International Classification of Crime for Statistical Purposes (ICCS). Each scenario is rendered under three linguistic framings and evaluated across five distinct cultures. Using our proposed two-tier evaluation framework, which judges both harmfulness and operational uplift, we find that: (i) framing alone drives unsafe compliance, with the mean unsafe compliance rate rising from 28.9% under direct requests to 66.4% under correction seeking (peaking at 97.3%; p < 0.05), as models correcting deliberately distorted details supply executable criminal steps; (ii) culturally adapted prompts elicit significantly more unsafe compliance than literal translations of the same requests in all four non-English languages (+7 to +18 points), a risk that translation-based benchmarks miss; and (iii) unsafe responses from the least-safe models carry strong Anglocentric registers, and the extent of this leakage increases monotonically with response harmfulness ($ρ$ = 0.46 to 0.63 across languages, all p < 0.001). GUISE offers a grounded resource and fine-grained diagnostics for strengthening refusal alignment across languages and cultures. We publish our code and data to facilitate future research.

0.31

Multi-Scale Spatio-Temporal Exploratory Analysis of Urban Vehicle Theft

cs.CY ·2026-10-27 ·Chaitanya Jobanputra, George Mohler, Sebastian Vollmer, Gerrit Großmann
code/data similarity 0.55
Abstract · 18 pages, 8 figures, 6 tables. Preprint, under review. Code: https://github.com/gerritgr/car_theft

Vehicle theft is a persistent urban problem with large economic and social costs. We analyze 521,098 stolen-vehicle reports filed with the Los Angeles Police Department from 2000 to 2022, at scales from hours to decades and from 100 m grid cells to census tracts. Much of the work lies in making the administrative records fit for analysis: we separate thefts from recoveries and traffic reports filed in the same records, repair time fields, validate the geocoding, and harmonize census data across changing tract boundaries. Theft is strongly and persistently concentrated: 10.8% of 250 m cells hold half of all thefts, and six census tracts are significant rate hotspots in all 23 years after false discovery rate control. Thefts close in space and time are more frequent than expected by chance, but about half of this excess comes from events at identical coordinates. Lower-income tracts have more thefts at equal exposure, monthly temperature shows no association with theft, and thefts peak in the evening. From 2015-2019 to 2021-2022, the share of Kia and Hyundai among stolen vehicles rose from 1.5% to 9.5% and from 1.6% to 7.7%, mostly among model years 2011-2021, which largely lacked a standard immobilizer. All findings are descriptive. We also describe how the data quality issues we corrected would otherwise distort several of these patterns.

0.44

Name-Bias in Large Language Models

cs.CL ·2026-10-15 ·Kalyan Bhetwal, Ceren Mert, Ian Whitehouse
similarity 0.55
Abstract

Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large language models spanning multiple providers and parameter scales. Using a fill-in-the-blank task, we prompt these models to choose between pairs of first names drawn from U.S. Social Security Administration datasets and a race classification dataset by Rosenman et al.. Our experimental de- sign isolates age and gender effects through balanced name pairings and sentence templates that share a fixed syntactic structure. Across 300,000 local LLM responses, we find consistent and measurable name bias. Models prefer names that are less stereotypically male, older, popular, and white. Furthermore, we find that name-bias is highly sentence-dependent, but not more than associated stereotypes, and gender is the most significant bias, followed by age, name popularity, and race. Our results demonstrate that name-based bias remains pervasive even in local LLMs, highlighting the necessity for standardized evaluation methods and mitigation strategies.

0.41

Hate speech toward migrants on a citizen reporting platform concentrates in neighborhoods undergoing demographic change

cs.SI cs.CY ·2026-08-12 ·Eduardo Graells-Garrido, Daniela Opitz, Francisco Rowe, Carmen Cabrera
similarity 0.55
Abstract · 19 pages. Under review

Understanding when migration generates social integration or exclusion is a central challenge for urban communities. Existing research has mostly relied on surveys, administrative data, or aggregate indicators that fail to capture expressions of exclusion at fine spatiotemporal scales. Here, we analyze over 550,000 geolocated reports from SOSAFE (Chile's largest citizen reporting platform) to examine the relationship between migration and hate speech in Santiago. We fine-tune a Spanish hate speech classifier and validate it against human labels. Reports that mention migrants are more likely to contain hate speech than other reports. Hate speech concentrates in areas with recent demographic change (post-2010 arrivals) rather than in established migrant communities. The spatial analysis shows that hate speech hotspots coincide with neighborhoods where recent migrants comprise over a third of the population. Coldspots appear in high-education sectors with minimal recent migration. Reports with hate speech and reports that mention migrants receive more engagement, although their combination is not amplified further. These results show digital bordering on a citizen reporting platform: exclusionary discourse concentrates, and receives more engagement, in neighborhoods undergoing recent demographic change.

0.12

Measuring Decision-Scale Use in Tool-Augmented LLMs: A Contrastive Urban Benchmark

cs.IR ·2026-09-15 ·Ray Chen, Vivian Wong, Christan Grant
benchmark similarity 0.54
Abstract

Urban decision-support often asks whether activity is unusually high or low for a specific place, not which place has the larger raw count. Twenty pickups in a quiet neighborhood can be more abnormal than 180 at an airport. We introduce URBANCONTRASTIVEQA, a benchmark that asks whether tool-augmented language models can make this baseline-relative comparison. Each item pairs two urban situations from public mobility data in NYC, Chicago, and Seattle, labeled by how far current activity deviates from that place's historical baseline. We evaluate six instruction-tuned models under five tool-output formats. With only raw counts, models often pick the larger number even when it is less abnormal for its zone. Server-computed baseline scores and ordinal labels raise accuracy, but gains vary by model. For heterogeneous urban feeds, tool interfaces need to expose local baselines, not just activity volumes. We release the pair bank, labels, scoring scripts, and data card.

0.22