CS Paper Radar

Open Platform Field Experiments: Expanding the Design Space of Experimental Research on Social Media

Jordi Guillem Condom-Tibau, Giovanni Puccetti, Clara Bacciu, Matteo Abrate, Stefano Cresci

cs.CY cs.HCcs.SI ·submitted 2026-09-18 10:43 UTC · v1

Abstract

Despite a growing demand for causal evidence about social media, independent researchers remain severely constrained in their ability to conduct experiments directly on online platforms. To cope, multiple methodological workarounds have emerged - from controlled surveys and simulations to client-side overlays and platform partnerships - each requiring distinct trade-offs between desirable experimental properties. The recent emergence of open social media platforms offers a qualitatively different methodological opportunity. Here we propose a design space of social media experimentation and discuss Open Platform Field Experiments (OPFEs). OPFEs represent a distinct class of experimental approaches that enable independent researchers to directly intervene on functional platform components - such as clients, recommendation systems, and moderation services - within live social media environments. Through a comparative analysis of experimental archetypes, we show that OPFEs occupy a previously unexplored region of the design space. We then bridge theory and practice by characterizing the architectural and governance elements that enable OPFEs, mapping them onto Bluesky and the AT Protocol, and illustrating the end-to-end lifecycle of a complete OPFE design. Overall, this work establishes OPFEs as a practical methodological paradigm for independent, transparent, and ecologically grounded experimentation on open social media.

Closest papers

Nearest neighbours by meaning across the whole index.

Outer Limits: An Experimental Approach to Controlled Content Manipulation within the Reddit Interface

cs.HC cs.SI ·2026-08-10 ·Chenchen Mao, Hanjing Shi, Haiyan Jia, Daniel Unhuryan, Eric Baumer +1 more
similarity 0.60
Abstract

Independent researchers often lack access to intervention capabilities for controlled experiments on live social media platforms. We present Outer Limits, a browser-based system for controlled content experiments within the existing Old Reddit interface, rather than in a reconstructed simulation. The system renders content locally, records study events, and contains configured voting and commenting actions so that neither constructed content nor experimental write interactions reach Reddit. In a 219-participant perceptual-fidelity study, ART ANOVAs found no significant Post Type, Participant Awareness, or interaction effects. Exploratory TOSTs met the d = plus-minus 0.50 equivalence criterion for the marginal contrasts and for Post Type within the forewarned subgroup. We also illustrate the system with a factorial study varying post frame, comment frame, and comment stance. Outer Limits combines three properties that the approaches considered here provide separately: precise control over experimental content, an existing platform interface, and containment of experimental content and interactions from the host community.

0.38

Participant-Mediated Collection of Sensitive Digital Trace Data: The CANDOR Research Infrastructure

cs.HC cs.CY ·2026-09-15 ·Andrew Zhao, Rijul Magu, Ekta Raj, Teresa Elinjikkal, Munmun De Choudhury
similarity 0.60
Abstract

Digital trace data provide rich measures of behavior in everyday settings, but the research ecosystem supporting their collection is constrained by declining platform API access and a historical reliance on publicly observable data. Participant-mediated data donation offers a complementary approach in which individuals contribute selected portions of their own digital histories to research. Such data can include longitudinal and non-public behavior, span multiple platforms and modalities, and be linked to independently collected study measures, enabling study designs that are difficult to implement using public social media data alone. These opportunities also introduce methodological challenges around participant control, data minimization, heterogeneous platform exports, privacy, and governance, particularly when semantic or multimodal content is necessary to study the construct of interest. We present CANDOR (Collecting and Analyzing Networked Data for Open Research), an end-to-end infrastructure for participant-mediated collection and governance of sensitive digital trace data. CANDOR supports participant-directed selection of platforms, data types, and temporal ranges; modular platform- and modality-specific parsing and de-identification; linkage to independent study measures; and protected processing, storage, and access. We derive design requirements for this class of research and compare CANDOR with existing data donation infrastructures, identifying how different approaches support participant control, data minimization, scientifically necessary data richness, study-design flexibility, and governance. Together, this work provides a methodological and infrastructural framework for using participant-contributed digital traces in behavioral research, particularly when the data needed to address a scientific question are longitudinal, non-public, multimodal, or sensitive.

0.43

Reclaiming the social in social media

cs.SI cs.CYcs.HC ·2026-09-28 ·Luca Benn, Moritz Merz, David Grüning
position similarity 0.59
Abstract · 7 pages, 1 figure

Concerns about polarization, antisocial behavior, and mental health have broadly led to two responses to social media: adapting platforms through moderation and prosocial design, and restricting access to these platforms through age limits and comparable measures. Both address consequences of social media while leaving the attention-driven architecture intact. We argue that the harms commonly attributed to social media arise not from technologies supporting social connection but from their implementation within the attention economy. In response, we ask what a digital social environment built for genuine human connection would look like. From four principles - Purpose, Alignment, Transparency, and Access - we can derive four technical properties that fulfill these principles: Operator Blindness, Algorithmic Sovereignty, Operational Parity, and Verifiability. To the best of our knowledge, no deployed alternative satisfies all four. We propose an architecture that does, making the attention economy not just discouraged but structurally impossible. We explain how the resulting user experience refocuses on each user's individual social environment and differs from that of current platforms.

0.21

From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM

cs.SI cs.CLcs.CYcs.HC ·2026-09-20 ·Koustuv Saha, Eshwar Chandrasekharan
similarity 0.58
Abstract

Over twenty editions, the ICWSM community has examined social life online as platforms, interactions, and research methods have changed. What can this body of research tell us at this critical juncture, as AI increasingly reshapes how people communicate online? We analyzed 2,139 indexed contributions from 2007 to 2026, distinguishing topics identified through nonnegative matrix factorization from problem framings captured through explicit textual cues. We find that platform mentions shift from blogs toward Twitter and, more recently, Reddit. Online community research maintains a similar topic share (10.5% to 10.0%), but governance cues within it increase from 4.0% to 34.3%. Harm-related cues also increase after restricting abstracts to a fixed length. Our review also traces advances in sampling, measurement, and causal and experimental methods. We discuss how AI-mediated interactions complicate these questions and provide a reporting checklist to support research across changing platforms.

0.21

Middleware for Feed Recommendation in Practice: How Feed Creators Build, Maintain, and Sustain Custom Feeds on Bluesky

cs.HC ·2026-09-11 ·Tony Zhou, Leijie Wang, Amy X. Zhang
similarity 0.57
Abstract

Scholars have long proposed third-party middleware as an alternative to centralized algorithmic feeds: feeds built and distributed by independent feed creators. This vision saw no large-scale instantiation until Bluesky, a decentralized microblogging platform, introduced custom feeds in 2023. Although central to the middleware ecosystem, we know little about how feed creators understand their role, build feeds, and sustain them. Through interviews with n = 26 feed creators and third-party developers of feed-building tools, and analysis of n = 88,302 custom feeds, we identify two creator orientations---utility-providing and community-building. Additionally, creators struggle to maintain feeds that fully realize middleware ideals: they lack granular interaction data, receive little feedback, and lack technical expertise to act on either. Finally, creators sustain their feeds as unpaid hobbyists with little platform support and are divided on whether to monetize beyond covering costs. We conclude with design and policy implications for strengthening the middleware feed ecosystem.

0.25

The Bureaucratization of the Internet: Analyzing the Diffusion of Governance Regimes on Reddit (2011--2023)

cs.SI ·2026-09-29 ·Katherine Van Koevering, Yuanhao Liu, Jon Kleinberg
similarity 0.56
Abstract

As online platforms scale, distributed communities must develop complex governance structures to maintain order. Reddit represents a unique experiment in this process: millions of subreddits manage their own digital commons, yet together they form an interconnected ecosystem of platform governance. Using a historical dataset of subreddit rules from 2011 to 2023, we apply computational methods to characterize that ecosystem and identify mechanisms driving change. We identify seven distinct governance regimes and document a platform-wide drift toward irreversible bureaucratization operating through two reinforcing dynamics: a ratchet effect among existing communities and a cohort shift in which new communities increasingly launch with pre-packaged regulatory frameworks. Using Dyadic Event History Analysis, we find that community scale is the dominant and universal predictor of rule adoption, independent of network exposure. Diffusion flows through two complementary channels: normative transmission via shared moderator networks and mimetic transmission among topically similar communities. However, mimetic copying is selective: it drives adoption of content rules addressing shared topical challenges while communities resist copying operational and behavioral rules. Additionally, communities with overlapping user bases differentiate rather than converge, consistent with ecological accounts of niche competition, and prestige-based contagion is firmly rejected. Together, these findings reveal decentralized platform governance as a stratified ecosystem in which lateral coordination, scale pressure, structural inertia, cohort effects, and episodic platform coercion jointly produce irreversible formalization with direct implications for platform management.

0.07

Improving social media for democratic discourse

cs.CY cs.HC ·2026-10-07 ·Fan Cheng, Amirhossein Farzmahdi, Pinyuan Feng, Kedar Garzón Gupta, Trenton Jerde +6 more
similarity 0.55
Abstract · 55 pages. White paper presenting a modular set of mechanisms for designing social media to support democratic discourse

Social media have expanded opportunities for communication and political participation, but today's dominant platforms are optimized primarily for engagement and advertising revenue, contributing to concerns about polarization, misinformation, social isolation, and loss of civility. We explore how social media might instead be deliberately designed to support democratic discourse, collective deliberation, and collective intelligence. Drawing on literature across computer science, psychology, political science, and related fields, we present a modular collection of mechanisms that could be implemented individually or in combination. These include user-controlled and open recommender systems, tools for exposure to diverse perspectives, new forms of cognitive and epistemic feedback, collaborative and AI-assisted fact-checking, privacy and visibility controls, mechanisms for improving civility and evidentiary integrity, and reputation systems that reward high-quality participation. The proposals are intended both as a practical menu of design possibilities and as a starting point for broader interdisciplinary discussion about digital public spaces designed around democratic values rather than engagement alone.

0.11

A Leader-Driven Open Collaboration Platform for Exploring New Domains

cs.HC ·2026-09-21 ·Michael Weiss, Ibrahim AbuAlhaol, Mohamed Amin
publishedhighly cited similarity 0.54
Abstract · 4 pages. Author's version of the paper published at OpenSym '16

This paper describes the design and initial evaluation of a leader-driven open collaboration platform for exploring new domains. The goal of this platform is to enable the collaboration of subject matter experts across knowledge boundaries. Traditionally, new domains are explored from within a single specialist or a focused group perspective. However, this often introduces bias. Collaboration helps reduce such bias by providing access to a broader range of information sources, increasing the chances for producing new insights in a new domain. However, it also introduces a new problem: variance between the contributions made. Variance makes it difficult to produce a coherent document. In this paper, we report on our observations from developing an initial prototype of the open collaboration platform, and derive propositions about how leader-driven open collaboration helps reduce bias while containing variance.

0.58