CS Paper Radar

The Radicalization Pipeline: Characterizing and Predicting Online Misogyny

Anna Bertani, Nathan Ratkiewicz, Alessandro Flammini, Filippo Menczer

cs.SI ·submitted 2026-11-09 18:03 UTC · v1

Abstract

Social media platforms are known to shape and polarize user opinions and, increasingly, facilitate pathways toward ideological extremism. Among these trends, online misogynistic communities associ- ated with the incel (involuntary celibate) ideology have received growing scholarly attention. Previous work has primarily focused on ideological narratives and linguistic content within incel communities them- selves. However, much less is known about how user behaviors evolve over time, particularly before and after their engagement with incel spaces, and whether early signals can anticipate such transitions. In this study, we conduct a longitudinal analysis of Reddit users who participated in the r/incels community on Reddit. Our results show that engagement with the incel community is associated with a substantial in- crease in toxicity in both posts and comments, while hate increases particularly in posts after engagement. These changes extend beyond explicitly ideological communities: users who engage with the r/incels sub- reddit display elevated toxicity and hate speech even in subreddits related to leisure, entertainment, and everyday interests. In parallel, user activity shifts away from recreational and support-oriented communi- ties toward subreddits focused on social issues, indicating a broader reorientation of online participation. Finally, we show that future incel users can be identified with high accuracy prior to engagement using supervised machine learning models trained on linguistic, contextual, and interaction-based features. These findings suggest that online misogynistic radicalization follows detectable behavioral trajectories and diffuses across the broader social media ecosystem.

Closest papers

Nearest neighbours by meaning across the whole index.

Conspiracy and Environment Communities on Reddit Sort Along Different Demographic Axes

cs.CY cs.SI ·2026-09-28 ·Miguel Á. Sánchez-Cortés, Corrado Monti, Gianmarco De Francisci Morales
similarity 0.70
Abstract

The impact of online platforms in political mobilization is widely documented, yet it remains unclear how it affects different demographic groups. To shed light on this phenomenon, we examine two contrasting cases: engagement with environmental causes on one side, and with conspiracy theories on the other. Both are well represented on Reddit, allowing us to study the different origins of these groups using a network-based method. By inferring age, gender, affluence, and partisanship of Reddit users, we construct stratified transition networks to compare the entry pathways of different demographic groups toward these communities. We find that demographic differentiation operates differently in these two domains. Entry into conspiracy communities is primarily structured by gender and partisanship: masculine users disproportionately arrive through overtly political and alt-right spaces and share right-wing media sources, whereas feminine users more often pass through esoteric and spiritual subreddits before converging on r/conspiracy. In contrast, environmental communities are differentiated mainly by age and affluence. Affluent users tend to approach environmental subreddits via discussions of individual energy management, technology, and finance, while less affluent users arrive through protest-oriented and climate movement spaces. By comparing these two issue domains, the study shows that sociodemographic sorting does not operate uniformly across polarized topics. Instead, distinct demographic groups build their own paths, shaping both the routes through which they engage with political content and the informational ecosystems that sustain their engagement. Our approach, based on the attention-flow graph, refines our understanding of how different groups become embedded in online political communities.

0.26

Using LLMs to Mimic the Conversational Dynamics of Reddit Communities

cs.HC ·2026-08-29 ·Vedaant Jain, Yoshee Jain, Ishq Gupta, Aditi Shrivastava, Koustuv Saha +1 more
similarity 0.68
Abstract · 5 pages, 2 tables, 1 figure

Online communities face a constant battle against toxicity and misinformation. While human moderators struggle to keep pace with the volume of content, LLMs offer a promising solution for automatically generating constructive responses and shaping online interactions. This paper preliminarily investigates if LLMs can mimic the communication styles of Reddit users using their comment history as context. We evaluate two prompting approaches: predicting a target comment and filling in masked comments. We find that LLMs outperform expectations at replicating comment structure and formality, but struggle to accurately capture nuanced emotions, e.g. understating joy and overstating anger. These findings highlight a promising direction for LLMs in guiding online conversations towards prosociality influencing emergent communication patterns and norms within the community. The results of our study inspire future work with more rigorous methods of evaluation to explore the LLMs' effectiveness across diverse online communities to better understand their broader societal impact.

0.25

Reddit Community Interventions and Cross-Platform Response: Migration and Policy-Response Discourse on Voat

cs.SI ·2026-09-04 ·Shahan Ahmed
similarity 0.63
Abstract

Platform moderation can disrupt online communities, but the responses that follow do not necessarily take the form of direct migration. Communities may relocate, reorganize, discuss moderation decisions, express censorship concerns, or continue activity on alternative platforms without clear evidence of user-level movement. This study examines Reddit community bans and quarantines and their relationship with activity and migration-related discourse on Voat. Using data from the Multi-Platform Aggregated Dataset of Online Communities (MADOC), we analyze interventions affecting FatPeopleHate, GreatAwakening, MillionDollarExtreme, and CringeAnarchy. We combine computational discourse screening with a stratified independent human-validation procedure and population-adjusted estimates across 90-day pre- and post-intervention windows. The results reveal heterogeneous cross-platform responses. FatPeopleHate experienced a substantial increase in overall Voat activity while the relative prevalence of policy-response and broader relevant discourse declined. CringeAnarchy showed declines in direct migration and policy-response discourse following its permanent ban, although some estimates were sensitive to uncertain human labels. GreatAwakening instead exhibited a modest increase in policy-response discourse without clear evidence of increased direct migration. These findings suggest that platform interventions do not produce a uniform migration process. Overall destination-platform activity and migration-related discourse may move in different directions, highlighting the importance of distinguishing behavioral migration from broader discussion of moderation, censorship, governance, and community rebuilding.

0.15

Intergroup Bias Predicts Expressions of Social Judgment and Empathy in the r/AmITheAsshole Reddit Community

cs.CL cs.SI ·2026-10-21 ·Yu Hou, Hal Daumé, Rachel Rudinger
published similarity 0.63
Abstract · ICWSM 2027

People share and understand others' experiences differently based on their social identities; often, people empathize more when the other person belongs to their ingroup compared to an outgroup. While this intergroup empathy gap is well-studied in social psychology, it remains unclear how it manifests in naturally occurring online social interactions. To this end, we measure how commenters express social judgments, as an indirect outcome of their understanding towards the posters, and empathy in text, based on whether commenters share the poster's gender or are of similar ages. We focus on posts where the poster self-reports these demographics, and analyze 126,716 comments associated with 36,163 posts from 18,111 commenters in r/AmItheAsshole, while controlling for commenter and poster group identities, post features (topic, length, and score), and both commenter- and post-level variance. Our results show that when commenters and posters are ingroup, in either gender or age, commenters are more likely to provide a Not the Asshole verdict and show greater text-based understanding as measured by LLMs. We also observe that older commenters behave differently from younger ones. Furthermore, in a subset of posts where the gender and age of the other party in the conflict are explicitly mentioned, we find that commenter-poster ingroup effects are moderated by the group relationships between the poster and the other party when commenters make social judgments. Our work highlights the importance of intergroup context and social group nuances in understanding online discourse.

0.31

High prevalence of antagonizing rhetoric in trending topics on Twitter/X

cs.SI cs.CL ·2026-10-15 ·Armin Pournaki, Eckehard Olbrich
similarity 0.62
Abstract · 33 pages, 8 figures

Disagreement between political opponents is a central element of democracy. This disagreement can be voiced in different ways. An opponent can be antagonized, i.e. portrayed as an enemy that needs to be overcome, or they can be criticized, i.e. treated as a legitimate adversary with whom one can engage. While the latter is a fundamental part of democratic exchange, the former can be detrimental to public discourse. Political disagreement increasingly takes place on social media, where negativity towards political out-groups has been found to drive engagement. However, existing research has largely treated such negativity as a single dimension, leaving open whether it is antagonization or criticism that circulates on these platforms. This work addresses this gap by introducing a computational approach to detect these two types of rhetoric in text and identify its targets. On a corpus of over 17 million tweets from trending topics in the German Twittersphere, the method reveals that about a third of all tweets contain antagonizing rhetoric. Comparing tweets from trending topics to a random sample shows that the discourse in trending topics is systematically more antagonizing than ordinary Twitter communication. Combining antagonization detection with a large-scale estimation of users' political leaning, we find that right-leaning users employ antagonizing rhetoric significantly more than their left-leaning counterparts. Furthermore, both forms of oppositional rhetoric are strongly amplified within political camps, with multipliers retweeting them up to twice as often as tweets without oppositional rhetoric. Finally, patterns of antagonized targets reveal how different political camps construct their out-groups, with the right-wing populist party AfD and the Green party as the central antagonists of the opposing camps.

0.20

The Bureaucratization of the Internet: Analyzing the Diffusion of Governance Regimes on Reddit (2011--2023)

cs.SI ·2026-09-29 ·Katherine Van Koevering, Yuanhao Liu, Jon Kleinberg
similarity 0.62
Abstract

As online platforms scale, distributed communities must develop complex governance structures to maintain order. Reddit represents a unique experiment in this process: millions of subreddits manage their own digital commons, yet together they form an interconnected ecosystem of platform governance. Using a historical dataset of subreddit rules from 2011 to 2023, we apply computational methods to characterize that ecosystem and identify mechanisms driving change. We identify seven distinct governance regimes and document a platform-wide drift toward irreversible bureaucratization operating through two reinforcing dynamics: a ratchet effect among existing communities and a cohort shift in which new communities increasingly launch with pre-packaged regulatory frameworks. Using Dyadic Event History Analysis, we find that community scale is the dominant and universal predictor of rule adoption, independent of network exposure. Diffusion flows through two complementary channels: normative transmission via shared moderator networks and mimetic transmission among topically similar communities. However, mimetic copying is selective: it drives adoption of content rules addressing shared topical challenges while communities resist copying operational and behavioral rules. Additionally, communities with overlapping user bases differentiate rather than converge, consistent with ecological accounts of niche competition, and prestige-based contagion is firmly rejected. Together, these findings reveal decentralized platform governance as a stratified ecosystem in which lateral coordination, scale pressure, structural inertia, cohort effects, and episodic platform coercion jointly produce irreversible formalization with direct implications for platform management.

0.07

Unifying Models of Intergroup Hostility in Online Discourse

cs.CL cs.SI ·2026-09-17 ·Patrick Gerard, Julia Mendelsohn, Kristina Lerman
similarity 0.60
Abstract · 16 pages

Hostile rhetoric toward social groups can normalize exclusion and justify mistreatment, as well as contribute to rising polarization and political violence. Efforts to moderate hostile rhetoric in online speech draw on foundational theories in social and moral psychology, and political science. However, these theories were developed largely in parallel, often propose different and sometimes conflicting accounts of how hostility develops, and have rarely been tested against each other in real discourse. The result is a fragmented understanding of the rhetorical mechanisms of hostility, without a clear sense of how they appear, and relate to each other, in real-world discourse. Using 2.86 million posts from TikTok, Truth Social, and Twitter/X during the 2024 U.S. presidential election, we model the mechanisms of six foundational theories of intergroup hostility -- boundary construction, threat construction, scapegoating, negative evaluation, dehumanization, and action orientation -- within a common empirical framework to recover the broader organization of intergroup hostility rhetoric. Structurally, we find that boundary construction and threat construction anchor the system; temporally, we find that these mechanisms tend to follow a regular ordering: boundary construction, derogation, and action orientation tend to appear early; dehumanization and threat construction later; scapegoating latest. Mapping how these theoretical frameworks actually manifest in discourse bridges longstanding divisions across social science traditions and presents computational social science with a clearer empirical foundation for modeling intergroup hostility rhetoric beyond single-label detection.

0.31

"I Thought You Were The Uncensored Place": Norms, Rules, and Moderation in AI-Generated Sexual Content Communities

cs.CR ·2026-08-13 ·Lucy Qin, Jaron Mink, Elissa M. Redmiles
published similarity 0.59
Abstract · To appear at the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES) 2026

As AI-generated sexual content (AIG-SC) is increasingly produced, online communities have emerged to support creators' needs. To understand whether and how community governance attempts work to prevent abuse while supporting free expression, we interviewed 24 members and moderators of large AIG-SC online communities (10,000+ members) with stated rules against creating and sharing abusive content (e.g., AI-generated CSAM). Through in-depth interviews, we offer insight into: (1) how and why these communities form; (2) implicit community norms; (3) explicitly stated rules---and their operationalization via content moderation; and (4) tensions between community values and moderation that leave space for abusive behavior. Our findings reveal a complex picture: while many creators and communities have personal boundaries against abuse, advice and resources for creating any form of AI-generated sexual content are accessible to users regardless of their intentions. Further complicating community moderation are norms that center anti-censorship and non-judgment, which leave moderators to justify their actions using the limits of the law and terms of service. We end by reflecting on the ways in which technical, community, and legal governance may most effectively mitigate the production of abusive content.

0.50