CS Paper Radar

Using LLMs to Mimic the Conversational Dynamics of Reddit Communities

Vedaant Jain, Yoshee Jain, Ishq Gupta, Aditi Shrivastava, Koustuv Saha, Eshwar Chandrasekharan

cs.HC ·submitted 2026-08-29 01:52 UTC · v1

Abstract

Online communities face a constant battle against toxicity and misinformation. While human moderators struggle to keep pace with the volume of content, LLMs offer a promising solution for automatically generating constructive responses and shaping online interactions. This paper preliminarily investigates if LLMs can mimic the communication styles of Reddit users using their comment history as context. We evaluate two prompting approaches: predicting a target comment and filling in masked comments. We find that LLMs outperform expectations at replicating comment structure and formality, but struggle to accurately capture nuanced emotions, e.g. understating joy and overstating anger. These findings highlight a promising direction for LLMs in guiding online conversations towards prosociality influencing emergent communication patterns and norms within the community. The results of our study inspire future work with more rigorous methods of evaluation to explore the LLMs' effectiveness across diverse online communities to better understand their broader societal impact.

Comment
5 pages, 2 tables, 1 figure

Closest papers

Nearest neighbours by meaning across the whole index.

The Radicalization Pipeline: Characterizing and Predicting Online Misogyny

cs.SI ·2026-11-09 ·Anna Bertani, Nathan Ratkiewicz, Alessandro Flammini, Filippo Menczer
similarity 0.68
Abstract

Social media platforms are known to shape and polarize user opinions and, increasingly, facilitate pathways toward ideological extremism. Among these trends, online misogynistic communities associ- ated with the incel (involuntary celibate) ideology have received growing scholarly attention. Previous work has primarily focused on ideological narratives and linguistic content within incel communities them- selves. However, much less is known about how user behaviors evolve over time, particularly before and after their engagement with incel spaces, and whether early signals can anticipate such transitions. In this study, we conduct a longitudinal analysis of Reddit users who participated in the r/incels community on Reddit. Our results show that engagement with the incel community is associated with a substantial in- crease in toxicity in both posts and comments, while hate increases particularly in posts after engagement. These changes extend beyond explicitly ideological communities: users who engage with the r/incels sub- reddit display elevated toxicity and hate speech even in subreddits related to leisure, entertainment, and everyday interests. In parallel, user activity shifts away from recreational and support-oriented communi- ties toward subreddits focused on social issues, indicating a broader reorientation of online participation. Finally, we show that future incel users can be identified with high accuracy prior to engagement using supervised machine learning models trained on linguistic, contextual, and interaction-based features. These findings suggest that online misogynistic radicalization follows detectable behavioral trajectories and diffuses across the broader social media ecosystem.

0.16

Do LLMs Change Their Minds Like Humans? Diagnosing Human--LLM Divergence in Single-Turn Persuasion Judgments

cs.CY cs.CL ·2026-08-30 ·Lin Chen, Yitong Chen, Yong Li
top venuecode/data similarity 0.63
Abstract

Large language models (LLMs) are increasingly deployed as proxies for human participants in social simulations, yet whether they update their beliefs in response to persuasive arguments, as humans do, remains poorly understood. We conduct a systematic comparison using a naturally occurring online persuasion corpus in which original posters explicitly verify whether a reply changed their view. Our results show that LLMs achieve only slight agreement with humans (Cohen's kappa ranging from 0.079 to 0.178). Content-level analyses show that humans and LLMs agree on the strongest persuasion cues but diverge on finer ones: humans are more swayed by novel content and assertive language, whereas LLMs favor topical similarity and surface-level formatting. At the level of persuasion strategy, LLMs underweight emotional appeals and overweight credibility signals relative to humans, while the type of proposition under debate exerts no measurable effect on the degree of divergence. Furthermore, switching from first-person role-playing to third-person observation shifts all models toward greater resistance to persuasion, with the effect varying across persuasion strategies and textual features. These findings highlight the risk of treating LLM judgments as faithful proxies for human belief updating and point to structural differences in how LLMs and humans process persuasive discourse. Our code is available at https://github.com/tsinghua-fib-lab/LLM-belief-update-cmv.

0.51

Intergroup Bias Predicts Expressions of Social Judgment and Empathy in the r/AmITheAsshole Reddit Community

cs.CL cs.SI ·2026-10-21 ·Yu Hou, Hal Daumé, Rachel Rudinger
published similarity 0.63
Abstract · ICWSM 2027

People share and understand others' experiences differently based on their social identities; often, people empathize more when the other person belongs to their ingroup compared to an outgroup. While this intergroup empathy gap is well-studied in social psychology, it remains unclear how it manifests in naturally occurring online social interactions. To this end, we measure how commenters express social judgments, as an indirect outcome of their understanding towards the posters, and empathy in text, based on whether commenters share the poster's gender or are of similar ages. We focus on posts where the poster self-reports these demographics, and analyze 126,716 comments associated with 36,163 posts from 18,111 commenters in r/AmItheAsshole, while controlling for commenter and poster group identities, post features (topic, length, and score), and both commenter- and post-level variance. Our results show that when commenters and posters are ingroup, in either gender or age, commenters are more likely to provide a Not the Asshole verdict and show greater text-based understanding as measured by LLMs. We also observe that older commenters behave differently from younger ones. Furthermore, in a subset of posts where the gender and age of the other party in the conflict are explicitly mentioned, we find that commenter-poster ingroup effects are moderated by the group relationships between the poster and the other party when commenters make social judgments. Our work highlights the importance of intergroup context and social group nuances in understanding online discourse.

0.31

Modeling Group Socialization in Online Communities

cs.SI cs.HC ·2026-10-16 ·Vinay Koshy, Iris Zhong, Karrie Karahalios, Benjamin Mako Hill, Amy X. Zhang
similarity 0.62
Abstract

Newcomers to online communities must learn a group's norms to participate successfully. This process is known as socialization, and has been the subject of considerable study in the online communities literature. Foundational work on group socialization in social psychology, however, suggests that socialization is actually a bidirectional process: individuals and communities adapt to each other's needs. In this work we develop a formal quantitative model of socialization, and present the first large scale empirical validation of the bidirectional socialization hypothesis using Reddit data. More specifically, we focus on linguistic socialization, and model users' comments in online communities as a mixture of in-group language and language from ``background'' communities they previously participated in. On a dataset of 112 subreddits (7.8 million tokens) find that our bidirectional model makes predictions that better generalize across users and time than two unidirectional socialization models. Furthermore, we conduct a qualitative analysis in which we demonstrate that our model is able to extract interpretable socialization patterns from the data that align with the existing literature. Specifically our model is able to learn that users conform more to group norms in topically niche communities with stricter content moderation rules, and that long time users conform more than newcomers. We emphasize that the claims made in this paper are explicitly falsifiable -- we are staking out a clear claim about what the socialization process looks like, and encourage future work to challenge our model.

0.19

Disentangling Threads: Exploring the Potential of LLM-Supported Discussion Forum Analysis for Community Insight

cs.HC ·2026-08-20 ·Tony W. Li, Zhiqing Wang, Thanh-Nha Tran, Yu-Chun Grace Yen, Steven P. Dow
published similarity 0.62
Abstract · Accepted to ACM Collective Intelligence Conference, 2026

Online discussion forums enable people from diverse backgrounds to share ideas, feedback, and perspectives. These organic discussions can help researchers understand communities' collective viewpoints, but insights are often difficult to uncover given their freeform reply structure. Large language models (LLMs) support qualitative text analysis but can misalign with researchers' analytical intent and miss key insights. To inform design considerations for forum sensemaking tools, we manually analyzed a forum discussion, synthesized an exploratory analysis framework from relevant literature, built a design probe, and interviewed 21 researchers to uncover perceived opportunities and barriers with LLM representations of collective discussions. We provide recommendations for community sensemaking tools to support flexible analytical goals grounded in raw user data and enable follow-up research processes, while balancing anonymous free expression with the desire for contextual information on commenters.

0.40

From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM

cs.SI cs.CLcs.CYcs.HC ·2026-09-20 ·Koustuv Saha, Eshwar Chandrasekharan
similarity 0.62
Abstract

Over twenty editions, the ICWSM community has examined social life online as platforms, interactions, and research methods have changed. What can this body of research tell us at this critical juncture, as AI increasingly reshapes how people communicate online? We analyzed 2,139 indexed contributions from 2007 to 2026, distinguishing topics identified through nonnegative matrix factorization from problem framings captured through explicit textual cues. We find that platform mentions shift from blogs toward Twitter and, more recently, Reddit. Online community research maintains a similar topic share (10.5% to 10.0%), but governance cues within it increase from 4.0% to 34.3%. Harm-related cues also increase after restricting abstracts to a fixed length. Our review also traces advances in sampling, measurement, and causal and experimental methods. We discuss how AI-mediated interactions complicate these questions and provide a reporting checklist to support research across changing platforms.

0.21

The Infrastructure Divide: Analyzing Community Stance on Data Center Development via Reddit

cs.AI ·2026-11-06 ·Yoko Koyama, Gongfan Chen, Mansi Saxena
code/data similarity 0.62
Abstract · 42 pages, 7 figures

The rapid expansion of AI-driven data center construction has outpaced public engagement: an estimated $64 billion in U.S. data center projects were blocked or delayed by local opposition between May 2024 and March 2025, yet the concerns driving this resistance remain poorly characterized. Prior engagement methods such as surveys and hearings are introduced late in the planning process, and no study has systematically mined social media to measure community stance at scale. To address this gap, this study presents an LLM-powered opinion-mining framework and applies it to 798 Reddit posts and 102,328 associated comments spanning a decade. An open-source large language model, guided by a Chain-of-Stance prompting framework and three domain-specific labeling rules, classified stance at 83% of the human inter-reviewer agreement ceiling. Opposition dominated discourse volume rather than disapproval: against posts outnumbered favor posts 2.6:1 and generated 8.5 times more comments, and this gap widened significantly over 86 weeks. Topic modeling of opposition arguments resolved into four reproducible clusters, resource consumption and scarcity (42.8%), contested siting processes and secrecy (34.2%), political opposition to data centers (13%), and political and corporate accountability (8%). Engagement analysis revealed that posts with emotional or provocative political framing attracted the most engagement, while key technical concerns (e.g., water, power) were dispersed across lower-engagement comment threads. These findings give local leaders, developers, and policy makers a quantified, continuously updatable basis for prioritizing concerns and policy levers, supporting a shift from opposition to negotiated, verifiable partnership for data center development.

0.32

Causal Language in Post Titles Shapes Deeper Topological Structures of Online Conversations

cs.SI ·2026-08-23 ·Zhuoyu Shi, Fred Morstatter
published similarity 0.62
Abstract · Accepted at CSCW 2026

Causal reasoning is fundamental to human understanding and information organization. People prefer causal explanations because they offer coherence, predictability, and a sense of control. Conversational structures shape how knowledge and perspectives are shared, validated, and amplified in networked publics. Understanding the structural effects of causal language can reveal pathways to fostering deeper, more meaningful interactions online. In this work, we investigate how causal language influences the topology and temporal evolution of discussion threads in online conversations with a dataset of 17 million posts across 200 subreddits in 2023 on Reddit. Our results show that causal language is consistently associated with deeper, more sustained conversations, with effects emerging early in the lifecycle of a thread, as demonstrated through a counterfactual experiment. Importantly, emotional responses do not differ substantially between causal language and non-causal language, suggesting that structural depth arises from framing itself rather than affective escalation. A lightweight qualitative analysis shows that causal framing titles prompt users to elaborate more with reasoning and contribute personal experiences, supporting deeper multi-turn exchanges. These findings suggest that causal language acts not merely as a stylistic device, but as a cognitively grounded and structurally influential signal that shapes the topological structures of online conversations.

0.41