CS Paper Radar

CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems

Tania Chakraborty, Eylon Caplan, Zhaoqing Wu, Kevin Cushing, Han Qin, Shreya Havaldar, Dan Goldwasser

cs.CL ·submitted 2026-09-18 18:59 UTC · v1

Abstract

In recent years, there has been a surge of interest in Cultural NLP, with substantial efforts to create globally inclusive NLP systems. The rapid growth of literature in this field makes it difficult to track trends in methods and data resources. To address this, we analyze over 375 papers to answer three complementary questions: (1) What Cultural Capabilities (CCs) are being targeted in NLP systems? (2) How are cultural data resources being created? and (3) What methods are being used to improve the CCs of those systems? We discuss trends observed across the three questions, and identify relevant research gaps. To facilitate further research in this field, we release our full list of analyzed papers in the form of an interactive web interface, which includes a feature to allow researchers to add their work; we hope this facilitates future research and proves to be a valuable resource for the Cultural NLP community.

Comment
Accepted to NLP+CSS 2026
Journal ref
Proceedings of the Seventh Workshop on Natural Language Processing and Computational Social Science (2026), pp. 198-248
DOI
10.18653/v1/2026.nlpcss-1.14

Closest papers

Nearest neighbours by meaning across the whole index.

Supporting and Performing Culture from the Inside

cs.CL cs.AIcs.CY ·2026-09-26 ·Lea Frermann, Steven Bird
top venue similarity 0.71
Abstract · 9 pages, 1 figure, To appear in Findings of the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026), Budapest, …

Anthropology and related disciplines which study culture have often found it useful to consider their epistemological and methodological approaches in terms of emic versus etic. This is the distinction between the insider perspective, how the world is viewed by a member of the culture, versus the outsider perspective, the scientific cataloguing of cultural knowledge and practice. We adopt this framework to systematically analyse assumptions in recent research on culture in NLP along the full pipeline of task selection, data collection, system design and evaluation. We draw attention to the `culture of NLP' which shapes the research focus and approaches of our field, and suggest pathways towards a more culturally attuned AI.

0.39

Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn

cs.CY cs.CL ·2026-10-08 ·Andres Karjus
similarity 0.61
Abstract

Technologies like large language models make it easier to convert cultural material into analyzable variables, while LLM-driven agentic systems extend machine assistance to other parts of the research workflow. Rather than a full how-to guide or an exhaustive review of recent LLM use cases, this chapter looks at some crucial aspects of this new paradigm as well as the bigger picture. I argue that these technologies expand the scale, methodological range, and scope for delegation, while the basic logic by which those measurements support cultural claims remains mostly unchanged.

0.16

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

cs.AI ·2026-09-10 ·Aleksandra Urman, Elsa Lichtenegger, Salima Jaoua, Azza Bouleimen, Robin Forsberg +5 more
top venuebenchmark similarity 0.61
Abstract · Accepted to EMNLP 2026

Commercial text-to-image systems silently revise user prompts before generating images, a step users typically cannot disable or even see. Yet, existing audits of cultural bias examine only the final images and treat generation as a single pipeline, so they cannot tell where the bias originates. We introduce WORLDVIEW, a multilingual benchmark of 8,960 prompts across 15 languages and 31 language-context pairings. Using it, we audit the revision layer in three systems (DALL-E-3, Imagen-4, GPT-Image-1.5) through a three-step analysis of how heavily it marks each cultural context, whether it flattens that context into a narrow vocabulary, and whether that vocabulary is stereotypical. Relative to a no-context English baseline, the US is the least-marked context, while non-Western and non-Anglophone contexts are marked far more heavily, flattened into narrow vocabularies applied across topically diverse prompts, and reduced to recognizable cultural stereotypes. Comparing images from original versus revised prompts on models without a revision layer, we identify the layer itself as a previously undocumented, causal source of this stereotyping. To locate cultural bias, and fix it, we must audit the system as deployed, not the model alone.

0.50

Cultural Adaptation within Repeated Social Interactions

cs.CL ·2026-11-05 ·Chen Cecilia Liu, Roi Reichart, Anna Korhonen
similarity 0.60
Abstract

Much of human culture is tacit and is typically learned through situated social interaction. As LLMs are deployed as interactive agents across diverse communities, assessing their cultural competence demands moving beyond existing question-answering approaches, shifting from what they know to how they adapt. In this work, we broaden the scope of cultural adaptation in NLP by investigating whether LLMs can adapt through repeated interactions via a sandbox environment. By reframing cultural adaptation as a continuous process of norm assimilation through social interaction, our work demonstrates that memory mechanisms foster longitudinal learning across repeated interactions, facilitate transfer to different social settings, and enable multilingual norm assimilation across five languages. Together, our findings lay the groundwork for continuous, interaction-driven cultural adaptation in LLMs.

0.23

WikiOriginQA: Automated Construction of a QA Dataset with Knowledge Origins for Analyzing Cultural Bias

cs.CL ·2026-10-22 ·Kento Haneda, Yosuke Kishinami, Ryo Fujii, Keisuke Sakaguchi, Makoto Morishita
top venuedatasethot direction similarity 0.60
Abstract · Accepted to AACL-IJCNLP 2026 (9 pages, 2 figures, 10 tables)

Existing datasets on cultural knowledge have been typically created by human annotators familiar with each culture. However, the process requires considerable human effort, presenting a significant challenge to scalability. To address this challenge, we introduce WikiOriginQA, a QA dataset automatically constructed by objectively representing the origins of knowledge through the creation dates of different Wikipedia language editions. Experimental results with the created dataset confirm that LLM performance tends to be biased toward Anglophone cultures. Furthermore, the results suggest the importance of knowledge propagation into the Anglosphere. These findings demonstrate the validity of our automated approach, enabling cultural bias evaluations with superior scalability across diverse languages without extensive manual annotation.

0.53

CultureBot: A Framework for Retrieval-Augmented Exploration of Cultural Heritage Data

cs.CL ·2026-10-12 ·Vasileios Karampinis, Angelos Vlachos, Giorgos Filandrianos, Maria Lymperaiou, Paraskevi Tzouveli +2 more
similarity 0.60
Abstract

Digital cultural heritage collections encode rich relations among objects, places, periods, providers, images, and source institutions, yet users typically access them through keyword search and faceted browsing. We present CULTUREBOT, an interactive framework for natural-language exploration of cultural heritage collections that combines knowledge-graph-guided retrieval, lexical-semantic retrieval, and source-linked generation. CULTUREBOT maps user queries to structured catalogue relations, enriches retrieved records with textual evidence, and generates answers that link back to the underlying repository records. We instantiate the framework on 81,852 SearchCulture records and release an online demonstration. In an expert evaluation involving six cultural-heritage specialists, 55 persona-grounded queries, and 250 evaluations, the graph-guided system was rated significantly higher than two general-purpose assistants and a non-graph ablation, with the largest gains in evidence grounding, diversity, reasoning, and completeness. These results support graph-guided retrieval as a practical way to expose the relational structure of cultural collections through conversational access while preserving links to catalogue evidence.

0.10

AtlasNLP: A Country-Aware Atlas of Dataset Representation in NLP

cs.CL cs.AIcs.CY ·2026-08-31 ·Joan Nwatu, Tsedeniya Solomon Amare, Longju Bai, Bontu Fufa Balcha, Zayd Bashir +15 more
top venue similarity 0.59
Abstract · Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing

Understanding which countries are represented in NLP datasets is essential for identifying gaps, targeting data collection, measuring progress, and informing AI policy. However, geographic metadata is very rarely available, and country-level representation is often hidden behind broad language-level claims. We introduce AtlasNLP, a country-aware atlas of over 13,000 NLP dataset records across normalized NLP task categories, tracking both the populations represented and where datasets are produced. AtlasNLP includes AtlasNLP-Gold, a human-curated reference set, and AtlasNLP-Core, an ACL-derived large-scale collection. Using this resource, we show that (1) dataset coverage is highly uneven across countries and tasks; (2) dataset production and representation are geographically asymmetric; and (3) language coverage does not imply geographic representation. These findings reveal blind spots in current dataset documentation practices and motivate more explicit geographic metadata for country-aware NLP evaluation.

0.72

FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing

cs.CL ·2026-09-21 ·Yusser Al Ghussin, Eva Gavaller, Cristina España-Bonet, Josef van Genabith, Simon Ostermann
top venuebenchmarkdataset similarity 0.59
Abstract · accepted to EMNLP 2026 (Main)

Cultural evaluation coverage and robustness in language models are difficult to diagnose because pretraining corpora and cultural benchmarks are rarely indexed with comparable metadata. Benchmarks increasingly target culturally situated phenomena at the level of languages, regions, and locale-specific practices, while web-scale corpora are usually organized only by language. A shared culture-language-region layer makes these resources comparable, enabling audits of whether a target cultural phenomenon is represented in pretraining data, evaluated by benchmarks or both. To this end, we introduce FineWeb-CLaR, a large-scale annotated dataset derived from FineWeb and FineWeb-2 that places web documents on a shared culture-language-region axis for corpus auditing and benchmark alignment. FineWeb-CLaR annotates the full 30.9B-document collection from FineWeb and FineWeb-2 with URL-derived region labels and cultural-topic provenance. Our region resolver assigns a non-empty region to 25.61% of documents (7.92B). For cultural-topic analysis, we induce locale-specific topics and project them onto the 14 leaves of the Cultural Taxonomy of Liu et al. (2025), producing Locale Topic Distributions (LTDs) for corpus-side comparison. We also annotate 277 cultural NLP benchmarks with the same taxonomy, language coverage, and region coverage. Together, these resources enable direct comparison between corpus-side pretraining evidence and benchmark-side evaluation coverage.

0.36