CS Paper Radar

Outer Limits: An Experimental Approach to Controlled Content Manipulation within the Reddit Interface

Chenchen Mao, Hanjing Shi, Haiyan Jia, Daniel Unhuryan, Eric Baumer, Dominic DiFranzo

cs.HC cs.SI ·submitted 2026-08-10 18:32 UTC · v1

Abstract

Independent researchers often lack access to intervention capabilities for controlled experiments on live social media platforms. We present Outer Limits, a browser-based system for controlled content experiments within the existing Old Reddit interface, rather than in a reconstructed simulation. The system renders content locally, records study events, and contains configured voting and commenting actions so that neither constructed content nor experimental write interactions reach Reddit. In a 219-participant perceptual-fidelity study, ART ANOVAs found no significant Post Type, Participant Awareness, or interaction effects. Exploratory TOSTs met the d = plus-minus 0.50 equivalence criterion for the marginal contrasts and for Post Type within the forewarned subgroup. We also illustrate the system with a factorial study varying post frame, comment frame, and comment stance. Outer Limits combines three properties that the approaches considered here provide separately: precise control over experimental content, an existing platform interface, and containment of experimental content and interactions from the host community.

Closest papers

Nearest neighbours by meaning across the whole index.

Using LLM Agents to Evaluate Prosocial Interventions on Social Media Platforms

cs.SI cs.CL ·2026-11-01 ·Lucen Li, Erin Wertz, Muhammad Haroon, Anshuman Chhabra, Magdalena Wojcieszak
similarity 0.62
Abstract

Social media platforms are a primary source of information for many users. Although research explores various interventions to promote prosocial content or demote harmful content on platforms, there are few systematic methods for evaluating competing intervention designs before conducting costly human-subject experiments. We develop a simulation-based evaluation pipeline built on the OASIS framework. We generate 13,835 LLM-based agents, each with a unique profile. Over 20 time steps, we expose them to real-world Twitter/X posts and let them comment, like, repost, or follow. We use those agents to systematically evaluate three interventions that increase exposure to verified news: adding content, upranking content, and celebrity source cues. All interventions significantly increase news engagement, with upranking news to prominent feed positions producing the largest effects. These effects hold across agents' gender, age, and education levels. We validate our injection treatment results against a comparable human-subject study and find strong directional alignment and similar dose-normalized efficiency. Our results suggest that LLM-based agent simulations can support early-stage evaluation of platform interventions before human-subject deployment, and upranking may be more effective than news volume or source.

0.26

From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM

cs.SI cs.CLcs.CYcs.HC ·2026-09-20 ·Koustuv Saha, Eshwar Chandrasekharan
similarity 0.62
Abstract

Over twenty editions, the ICWSM community has examined social life online as platforms, interactions, and research methods have changed. What can this body of research tell us at this critical juncture, as AI increasingly reshapes how people communicate online? We analyzed 2,139 indexed contributions from 2007 to 2026, distinguishing topics identified through nonnegative matrix factorization from problem framings captured through explicit textual cues. We find that platform mentions shift from blogs toward Twitter and, more recently, Reddit. Online community research maintains a similar topic share (10.5% to 10.0%), but governance cues within it increase from 4.0% to 34.3%. Harm-related cues also increase after restricting abstracts to a fixed length. Our review also traces advances in sampling, measurement, and causal and experimental methods. We discuss how AI-mediated interactions complicate these questions and provide a reporting checklist to support research across changing platforms.

0.21

Open Platform Field Experiments: Expanding the Design Space of Experimental Research on Social Media

cs.CY cs.HCcs.SI ·2026-09-18 ·Jordi Guillem Condom-Tibau, Giovanni Puccetti, Clara Bacciu, Matteo Abrate, Stefano Cresci
similarity 0.60
Abstract

Despite a growing demand for causal evidence about social media, independent researchers remain severely constrained in their ability to conduct experiments directly on online platforms. To cope, multiple methodological workarounds have emerged - from controlled surveys and simulations to client-side overlays and platform partnerships - each requiring distinct trade-offs between desirable experimental properties. The recent emergence of open social media platforms offers a qualitatively different methodological opportunity. Here we propose a design space of social media experimentation and discuss Open Platform Field Experiments (OPFEs). OPFEs represent a distinct class of experimental approaches that enable independent researchers to directly intervene on functional platform components - such as clients, recommendation systems, and moderation services - within live social media environments. Through a comparative analysis of experimental archetypes, we show that OPFEs occupy a previously unexplored region of the design space. We then bridge theory and practice by characterizing the architectural and governance elements that enable OPFEs, mapping them onto Bluesky and the AT Protocol, and illustrating the end-to-end lifecycle of a complete OPFE design. Overall, this work establishes OPFEs as a practical methodological paradigm for independent, transparent, and ecologically grounded experimentation on open social media.

0.31

LongSocialBench: Do Long-Context LLMs Understand Online Discussion Threads?

cs.CL ·2026-10-02 ·Xinyi Liu, Rinat Khaziev, Dilek Hakkani-Tür, Tarek F. Abdelzaher
top venuebenchmark similarity 0.60
Abstract · Accepted to EMNLP 2026 Main Conference

Long-context LLMs can now ingest entire online discussion threads, but understanding their social discourse requires more than reading a long document: models must track parent-reply relations, turning points, scoped subtrees, cross-branch contrasts, and participant trajectories. To test this structure-aware social reasoning, we introduce LongSocialBench, a benchmark of 1,462 verified human-authored multiple-choice items drawn from 94 complete Hacker News, Stack Exchange, and Reddit r/ChangeMyView episodes, with a median length of approximately 73K tokens. Each item pairs a complete serialized discussion and reply structure with a four-option question, requiring models to recover structured social evidence. Released items are verified for answerability, option uniqueness, and evidence grounding. Across 18 models and 29 evaluation settings, current long-context workflows remain far below human performance. The best individual result comes from Claude-Opus-4.7, which reaches 63.0% when prompted to eliminate incorrect options before answering, compared with 72.4% for independent human readers. Averaged across all 18 models, the full-context Baseline scores 43.9%. Supplying the gold evidence scope raises this to 55.0%, showing that substantial errors remain even after the relevant thread region is identified. LongSocialBench shows that the missing capability is not context access or prompting alone, but social understanding over structured reply trees.

0.42

Counterfactual assessment of social media interventions by separating exposure from engagement

cs.CY physics.soc-phcs.SI ·2026-10-27 ·Tommaso Pisani, Pietro Gravino, Giulio Prevedello
similarity 0.59
Abstract

Social media interventions are usually evaluated in individual-level experiments, which are costly to scale and often miss collective effects. We propose the Exposure--Engagement model, whose parameters separately control what social media users are exposed to (recommendation) and how they engage (behaviour). After fitting it to the Italian Twitter debate (2018--2022), we validate it at individual and collective levels. We simulate behavioural interventions (prebunking and accuracy prompts), calibrated on effect sizes, and a recommender-system intervention (chronological feed), comparing effects on engagement, attention diversity, and segregation. All three reduce engagement. Behavioural interventions slightly reduce diversity, leaving segregation unchanged, whereas the chronological feed increases diversity and reduces segregation. For these interventions, changing recommendation does more for the debate's structure than changing behaviour. We design a recommender-system intervention that increases engagement and diversity while reducing segregation, although with about a tenth of the chronological feed's gains, showing the framework's potential for pro-social intervention design.

0.34

Reddit Community Interventions and Cross-Platform Response: Migration and Policy-Response Discourse on Voat

cs.SI ·2026-09-04 ·Shahan Ahmed
similarity 0.59
Abstract

Platform moderation can disrupt online communities, but the responses that follow do not necessarily take the form of direct migration. Communities may relocate, reorganize, discuss moderation decisions, express censorship concerns, or continue activity on alternative platforms without clear evidence of user-level movement. This study examines Reddit community bans and quarantines and their relationship with activity and migration-related discourse on Voat. Using data from the Multi-Platform Aggregated Dataset of Online Communities (MADOC), we analyze interventions affecting FatPeopleHate, GreatAwakening, MillionDollarExtreme, and CringeAnarchy. We combine computational discourse screening with a stratified independent human-validation procedure and population-adjusted estimates across 90-day pre- and post-intervention windows. The results reveal heterogeneous cross-platform responses. FatPeopleHate experienced a substantial increase in overall Voat activity while the relative prevalence of policy-response and broader relevant discourse declined. CringeAnarchy showed declines in direct migration and policy-response discourse following its permanent ban, although some estimates were sensitive to uncertain human labels. GreatAwakening instead exhibited a modest increase in policy-response discourse without clear evidence of increased direct migration. These findings suggest that platform interventions do not produce a uniform migration process. Overall destination-platform activity and migration-related discourse may move in different directions, highlighting the importance of distinguishing behavioral migration from broader discussion of moderation, censorship, governance, and community rebuilding.

0.15

"If It Looks Like a User": Measuring Real-Time Moderation Effects via Social Media Simulation

cs.SI cs.CYcs.MA ·2026-08-17 ·Enrico Verdolotti, Gianluca Nogara, Luca Luceri, Silvia Giordano
publishedtheory similarity 0.58
Abstract · 15 pages, 4 figures, 2 tables. Accepted for presentation at the Social Simulation Conference (SSC) 2026

Agent-based social media simulators offer a controlled environment to study content moderation, yet their value hinges on how faithfully they reproduce real platform dynamics. We develop a calibrated extension of SimSoM, an agent-based model of information diffusion on social networks, grounded in a real-world dataset of online vaccine discourse during the COVID-19 pandemic. Our approach replaces ad-hoc parametrisations with empirically fitted distributions, optimised via CMA-ES (Covariance Matrix Adaptation Evolution Strategy) and validated against real data across temporal, distributional, and structural dimensions. Using this validated simulator, we provide three key contributions. First, we show that the calibrated model reproduces key statistical signatures of the empirical data, including activity distributions, post/reshare ratios, and temporal patterns. Second, we apply established misinformation-spreader detection and prevention methods to both empirical and simulated data, progressively removing top-ranked users and showing that the resulting decline in low-quality content is consistent across the two. Third, comparing static (retroactive) and dynamic (in-simulation) moderation across 30 network realisations, we show that static evaluation significantly overestimates the effectiveness of user bans for the most effective detectors: when moderation is applied in real time, compensatory resharing by the remaining users dampens the expected reduction in low-quality content, so static estimates should be read as an upper bound. These findings highlight the necessity of simulation-based evaluation for content moderation policies and contribute a reusable, empirically grounded simulation framework.

0.26

Using LLMs to Mimic the Conversational Dynamics of Reddit Communities

cs.HC ·2026-08-29 ·Vedaant Jain, Yoshee Jain, Ishq Gupta, Aditi Shrivastava, Koustuv Saha +1 more
similarity 0.58
Abstract · 5 pages, 2 tables, 1 figure

Online communities face a constant battle against toxicity and misinformation. While human moderators struggle to keep pace with the volume of content, LLMs offer a promising solution for automatically generating constructive responses and shaping online interactions. This paper preliminarily investigates if LLMs can mimic the communication styles of Reddit users using their comment history as context. We evaluate two prompting approaches: predicting a target comment and filling in masked comments. We find that LLMs outperform expectations at replicating comment structure and formality, but struggle to accurately capture nuanced emotions, e.g. understating joy and overstating anger. These findings highlight a promising direction for LLMs in guiding online conversations towards prosociality influencing emergent communication patterns and norms within the community. The results of our study inspire future work with more rigorous methods of evaluation to explore the LLMs' effectiveness across diverse online communities to better understand their broader societal impact.

0.25