CS Paper Radar

The Illinois Social Attitudes Aggregate Corpus (ISAAC): An Open Tool and Reproducible Pipeline for Analyzing Social Group Discourse at Scale

Babak Hemmatian, Sarah Hadjarab, Jessica Chen, Benedek Kurdi

cs.CL cs.SI ·submitted 2026-09-22 20:59 UTC · v1

Abstract

We introduce the Illinois Social Attitudes Aggregate Corpus (ISAAC), an open, modular, and accessible corpus of 527 million+ English-language Reddit posts selected for relevance to six key social group distinctions based on race, sexuality, age, ability, body weight, and skin tone, covering the 17-year period from 2007 to 2023. A multi-step, human-audited filtering pipeline was used to keep irrelevant content in the curated dataset below 10%, both overall and for each social group distinction. Each post was then algorithmically annotated with the user's estimated home region, along with a suite of validated off-the-shelf and custom semantic labels including moralization, sentiment, emotion, and linguistic generalization. We confirm the validity of the resulting corpus through convergent evidence linking ISAAC to macro-level societal trends, such as online search behavior, temporal spikes during major societal events (both nationally and regionally), and long-term shifts in public attitudes. By offering a unified, public infrastructure, ISAAC eliminates research fragmentation and enables seamless replication while supporting diverse empirical workflows at scale. Specifically, ISAAC allows investigators to perform cross-category comparisons, conduct high-precision tracking of long-term temporal shifts in social group discourse, and map spatial variation onto localized public opinion and policy outcomes. ISAAC's fully public, modular pipeline facilitates easy extension of the corpus to new platforms, languages, and social categories. To accommodate various research needs, ISAAC is accessible both without coding through a point-and-click website and labeler web-apps, and programmatically via an SQL playground, a Python package, and HuggingFace.

Comment
Submitted to Behavior Research Methods

Closest papers

Nearest neighbours by meaning across the whole index.

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments

cs.CL cs.AI ·2026-09-19 ·Jakob Morales, Monica Hegde, Fayeq Jeelani Syed
theory similarity 0.62
Abstract

Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstructured, and existing city-evaluation tools capture none of it. We present a pipeline and conversational system that combines geographic entity resolution, topic modeling, sentiment analysis, and Retrieval-Augmented Generation (RAG) over 22,788 chunks of YouTube transcripts and comments spanning 309 North American cities. Beyond the system itself, our contribution is a set of measurements about what happens when standard NLP components meet short, informal, geographically ambiguous text. A Twitter-tuned RoBERTa classifier outperforms a VADER lexicon baseline by 12.6 macro-F1 points (0.589 vs. 0.464; McNemar p = 0.0001), but both models collapse on the neutral class, which dominates urbanist comment traffic; annotators disagree on the same class (Cohen's kappa = 0.53). Dense retrieval beats a TF-IDF baseline at every cutoff (P@5 0.790 vs. 0.560), and video-level relevance proxies understate chunk-level precision by a wide margin (0.660 vs. 0.94 under human rating). For groundedness evaluation, we find BERTScore unusable when a multi-sentence generated summary is compared against a single short comment - scores are nearly flat regardless of relevance - and show that ROUGE-1-based groundedness is a paraphrase-driven lower bound rather than a hallucination rate. These findings generalize beyond the urbanist domain to any RAG system built over short user-generated documents.

0.21

The Infrastructure Divide: Analyzing Community Stance on Data Center Development via Reddit

cs.AI ·2026-11-06 ·Yoko Koyama, Gongfan Chen, Mansi Saxena
code/data similarity 0.61
Abstract · 42 pages, 7 figures

The rapid expansion of AI-driven data center construction has outpaced public engagement: an estimated $64 billion in U.S. data center projects were blocked or delayed by local opposition between May 2024 and March 2025, yet the concerns driving this resistance remain poorly characterized. Prior engagement methods such as surveys and hearings are introduced late in the planning process, and no study has systematically mined social media to measure community stance at scale. To address this gap, this study presents an LLM-powered opinion-mining framework and applies it to 798 Reddit posts and 102,328 associated comments spanning a decade. An open-source large language model, guided by a Chain-of-Stance prompting framework and three domain-specific labeling rules, classified stance at 83% of the human inter-reviewer agreement ceiling. Opposition dominated discourse volume rather than disapproval: against posts outnumbered favor posts 2.6:1 and generated 8.5 times more comments, and this gap widened significantly over 86 weeks. Topic modeling of opposition arguments resolved into four reproducible clusters, resource consumption and scarcity (42.8%), contested siting processes and secrecy (34.2%), political opposition to data centers (13%), and political and corporate accountability (8%). Engagement analysis revealed that posts with emotional or provocative political framing attracted the most engagement, while key technical concerns (e.g., water, power) were dispersed across lower-engagement comment threads. These findings give local leaders, developers, and policy makers a quantified, continuously updatable basis for prioritizing concerns and policy levers, supporting a shift from opposition to negotiated, verifiable partnership for data center development.

0.32

Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media

cs.SI cs.AIcs.CLcs.LG ·2026-08-18 ·Yijie Xu, Chao Wang, Hui Xiong
published similarity 0.59
Abstract · Accepted by ACM Transactions on Intelligent Systems and Technology

The rapid growth of social media has greatly influenced political discourse, highlighting the need to understand individual political ideologies and their temporal dynamics. This task faces challenges such as data scarcity, abundant non-political content, costly and bias-prone manual annotation, and difficulty in modeling future ideological inclinations. To address these issues, we propose TSN4PI, a unified framework for tracking the evolution of political ideologies on social media. It includes two core modules. The PIDN uses large language models with style transfer and unsupervised domain adaptation to enable robust ideology detection and filter irrelevant content from noisy, cross-domain data. The PIPN employs temporal graph neural networks to predict future ideological shifts, enabling comprehensive analysis of ideology presence, intensity, and evolution. We release two large-scale datasets for noncommercial research use to facilitate further work. Extensive case studies on multiple platforms (X and Truth Social) validate the effectiveness of TSN4PI and provide empirical insights into political polarization and the evolution of online ideologies. Our findings offer a nuanced perspective, advancing both methodological development and empirical understanding in this field.

0.26

Modeling Group Socialization in Online Communities

cs.SI cs.HC ·2026-10-16 ·Vinay Koshy, Iris Zhong, Karrie Karahalios, Benjamin Mako Hill, Amy X. Zhang
similarity 0.59
Abstract

Newcomers to online communities must learn a group's norms to participate successfully. This process is known as socialization, and has been the subject of considerable study in the online communities literature. Foundational work on group socialization in social psychology, however, suggests that socialization is actually a bidirectional process: individuals and communities adapt to each other's needs. In this work we develop a formal quantitative model of socialization, and present the first large scale empirical validation of the bidirectional socialization hypothesis using Reddit data. More specifically, we focus on linguistic socialization, and model users' comments in online communities as a mixture of in-group language and language from ``background'' communities they previously participated in. On a dataset of 112 subreddits (7.8 million tokens) find that our bidirectional model makes predictions that better generalize across users and time than two unidirectional socialization models. Furthermore, we conduct a qualitative analysis in which we demonstrate that our model is able to extract interpretable socialization patterns from the data that align with the existing literature. Specifically our model is able to learn that users conform more to group norms in topically niche communities with stricter content moderation rules, and that long time users conform more than newcomers. We emphasize that the claims made in this paper are explicitly falsifiable -- we are staking out a clear claim about what the socialization process looks like, and encourage future work to challenge our model.

0.19

Demographic Pluralism: Inference-Time Modeling of Pluralistic Human Preference Distributions

cs.AI cs.CY ·2026-09-29 ·Meng-Chen Wu, Qipin Chen, Ansh Jain, Tess Wood, Zhe Du +1 more
published similarity 0.58
Abstract

Large language models (LLMs) are increasingly used in culturally sensitive settings, where alignment requires representing diverse preferences within populations. Yet existing methods model populations at coarse demographic or community levels and overlook within-group variation. We introduce Demographic Pluralism, an inference-time framework that estimates population-level opinion distributions without opinion-distribution training data or task-specific fine-tuning by generating multiple perspectives within demographically grounded groups. Across four backbones on GlobalOpinionQA and VITAL, it reduces Jensen-Shannon distance by 8.4%-26.4% over Modular Pluralism. Among weighted, equal-weighted, and inverse-weighted aggregation, equal weighting performs best overall; group-level error also increases with group weight, helping explain weighted aggregation's weaker performance.

0.40

FUBU-EPSTEIN: A Large-Scale Twitter Dataset on the Jeffrey Epstein Case and Its Global Public Discourse (2019-2023)

cs.SI ·2026-08-10 ·Michael Kreil, Tristan Manfred Stöber, Daniel Thilo Schroeder
dataset similarity 0.58
Abstract

The criminal case of Jeffrey Epstein has generated a complex, long-running global discourse on digital platforms, characterized by punctuated attention shocks, conspiracy theories, and blame attribution. To facilitate the computational study of these dynamics, we introduce the FUBU-EPSTEIN dataset, a large-scale, multi-dimensional research corpus of 54.38 million Twitter statuses authored by 7.11 million users and collected between August 2019 and April 2023. The source corpus was captured continuously in near-real time and enriched with a directed social contact graph of 37.03 million edge rows and annotations from Qwen2.5-7B-Instruct covering sentiment, conspiracy and misinformation stance, toxicity, moral emotion, and related dimensions. For public distribution, we created a textless, de-identified derivative that retains one row for every deduplicated status, categorical and numeric annotations, coarse temporal information, and 46.15 million internal status relationships. It excludes tweet text, original post and user identifiers, handles, profile fields, exact timestamps, and reverse mappings. The resulting release supports longitudinal content and diffusion analyses while reducing disclosure and platform-content redistribution risks. To request access to raw data for collaborative research under ethical and legal safeguards, contact fubu.dataset@gmail.com.

0.04

Reddit Community Interventions and Cross-Platform Response: Migration and Policy-Response Discourse on Voat

cs.SI ·2026-09-04 ·Shahan Ahmed
similarity 0.58
Abstract

Platform moderation can disrupt online communities, but the responses that follow do not necessarily take the form of direct migration. Communities may relocate, reorganize, discuss moderation decisions, express censorship concerns, or continue activity on alternative platforms without clear evidence of user-level movement. This study examines Reddit community bans and quarantines and their relationship with activity and migration-related discourse on Voat. Using data from the Multi-Platform Aggregated Dataset of Online Communities (MADOC), we analyze interventions affecting FatPeopleHate, GreatAwakening, MillionDollarExtreme, and CringeAnarchy. We combine computational discourse screening with a stratified independent human-validation procedure and population-adjusted estimates across 90-day pre- and post-intervention windows. The results reveal heterogeneous cross-platform responses. FatPeopleHate experienced a substantial increase in overall Voat activity while the relative prevalence of policy-response and broader relevant discourse declined. CringeAnarchy showed declines in direct migration and policy-response discourse following its permanent ban, although some estimates were sensitive to uncertain human labels. GreatAwakening instead exhibited a modest increase in policy-response discourse without clear evidence of increased direct migration. These findings suggest that platform interventions do not produce a uniform migration process. Overall destination-platform activity and migration-related discourse may move in different directions, highlighting the importance of distinguishing behavioral migration from broader discussion of moderation, censorship, governance, and community rebuilding.

0.15

SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue

cs.CL ·2026-09-01 ·Stephanie Fong, Yiwen Jiang, Zimu Wang, Hongxi Yang, Yaling Shen +10 more
top venuebenchmarkhot direction similarity 0.58
Abstract · Paper accepted at EMNLP 2026

Large Language Models (LLMs) are increasingly used in advice seeking and decision making that may affect social judgements. Despite stigma's profound effects on people and communities, benchmarks remain scarce. Existing general-domain evaluations typically rely on static prompts and fixed-format tasks, overlooking conversational contexts and audience effects in everyday communication. To address these gaps, we introduce SDARE-Bench, the first scenario-based benchmark evaluating both stigma detection and open-ended response generation in LLMs, comprising 1,138 dyadic queries and 1,388 group dialogue. Empirical results across 8 LLMs consistently demonstrate poor identification of stigma components, especially in group dialogues. In open-ended response generation, stigma expression was substantially higher in group settings than in dyadic, with weaker resistance to stigma and more unrealistic advice. Responses were evaluated using a classifier trained on 1,392 human annotated responses. In constructed group pressure settings, stigma expression rates further increased to a striking average of 97.5%. Our findings identify stigma response as a recurring LLM safety vulnerability, especially in socially complex conversational contexts.

0.54