CS Paper Radar

It Takes Three to Converse: Empirical Observations on How the Developer, the Convener and the Participant Shaped 119 Polis Conversations

Lodewijk Gelauff

cs.CY cs.HC ·submitted 2026-08-28 14:24 UTC · v1

Abstract

Polis is a popular democratic innovation tool that allows asynchronous citizen engagement through atomic statements: short statements that together describe a complex question, inviting the citizen to vote Agree or Disagree on each. This paper uses 119 conversations with 100 or more participants and an extensive data export, drawn from a wider set of 271 collected processes. The paper asks what determines the output of such a process. Three parties shape the result. The developer of the platform has made important design choices that restrict the outcome: the number of groups the platform is able to report (restricted to 2--5) and which statements are prioritized. The convener defines the assignment: the initial statements that set the tone, the policy that accepts or rejects new statements and who can be invited. Finally, the participant works within these boundaries. With access to less than half of the generated statements, they end up responding to more statements when their conversation seems to have an achievable number of statements to complete, than when they are presented with more statements. Due to choices such as warm path clustering, the exported resulting clustering cannot be reproduced based on the voting data. Conveners may want to re-analyse their own conversations once the process is closed, to consider the data in its entirety, and make their own analysis priorities explicit.

Closest papers

Nearest neighbours by meaning across the whole index.

Technology-Supported Moderation in Online Deliberation

cs.CY ·2026-10-13 ·Lodewijk L. Gelauff, Ashish Goel, Sukolsak Sakshuwong
published similarity 0.64
Abstract · Book chapter, to appear in "Democratizing Tech Governance: Empowering the Public's Voice Through Deliberative Democracy" (preliminary title)…

Mini-publics are an increasingly popular family of democratic innovation to broaden citizen engagement. However, convening a representative sample in person is resource-intensive, and requires significant organizational efforts to coordinate travel, venue logistics, and facilitator training. This chapter outlines the design and development of the Stanford Online Deliberation Platform, initially tailored for Deliberative Polling, building upon insights from in-person moderation in that setting, but supporting a broader range of methods and approaches in the deliberative space. The platform supports structured conversations for small groups (ideally 8-15 people) with automated moderation functionality, enabling the groups to assume ownership of the deliberative conversation rather than relying on a moderator persona. We describe the platform's architecture and key design decisions, including the deliberation flow, room assignment, speaker management, speaking nudges, agenda management, outcome development, and real-time monitoring. Between its inception in 2018 and 2025, the platform has facilitated over 30,000 unique participants engaging in deliberations; we catalog 54 deliberations with at least 100 participants up to December 2025, spanning a diverse range of languages, countries, and topics. Finally, we establish a standardized vocabulary for future analyses by defining the terminology employed in the platform's data and documenting significant software revisions over time.

0.26

Auditing Political Alignment in LLM Assistants: Engagement, Stance, and User Identity

cs.CL cs.AIcs.CY ·2026-09-19 ·Joan C. Timoneda
similarity 0.62
Abstract · 51 pages, 6 figures. Preregistered; registration at doi:10.5281/zenodo.21135155

LLM-based AI systems answer political questions for hundreds of millions of people. Current audits measure what they say to an average user, but their behavior is dynamic. I argue that their political behavior is a set of policies over whom to answer, what to say, and whether to engage at all, conditional on the topic and what the system knows about the user. I call these policies the system's speech regime, which is how a developer settles the tradeoff between answering, accommodating the user, and refusing, each of which carries a cost that varies by topic. I derive a typology of five regimes from two dimensions, engagement and stance. I test six AI systems (OpenAI, Anthropic, xAI, Google, Mistral, DeepSeek) in a preregistered experiment of 7,500 multi-turn conversations that randomly assign the user's political identity across five topics: abortion, Catalan independence, climate change, Nazism, and a zero-stakes control (pineapple on pizza). Two LLM judges from different developers score every answer, validated against human coding, and refusal is treated as an outcome rather than missing data. Every system accommodates the user on the control topic, showing that political restraint is a policy. On contested topics the systems fall into different regimes: on abortion, GPT engages and mirrors every user, Gemma refuses everyone, Claude answers strongly conservative users 35 percent of the time and almost no one else, and Grok accommodates conservatives only. On settled topics such as climate change and Nazism, five systems hold firm for every user. The systems also infer the user's overall ideology, so accommodation can spill over to topics not yet discussed. A comparison of two Grok releases shows the regime changing between versions in a way current audits miss. Speech regimes matter for alignment research and for polarization, political knowledge, and the quality of democracy.

0.26

Public Perceptions of Public Participation in Local Government Mediated through a GenAI Tool

cs.CY ·2026-11-05 ·Jason Yan, Yanna Krupnikov, Nicholas Weber, Sabina Tomkins
hot direction similarity 0.62
Abstract

City council meetings offer a site for direct democracy through public comment periods. Yet, this process can lack transparency, and research on local political participation has documented that people who speak at public meetings are often unrepresentative of their communities. However, a lack of representation does not establish whether other people view these participants as advocates for their concerns. In fact, little is known about how they are perceived. To address this gap and improve transparency into this democratic process, we built a generative AI (GenAI) tool, VoicesView, that allows individuals to retrieve and read public comments. We deploy this tool, along with a novel survey, in a study with 72 participants in Ann Arbor, Michigan, and Seattle, Washington, in order to understand people's perceptions of public commenters. We find that participants generally viewed public commenters favorably, and that these views became more positive after using VoicesView. For example, the share who agreed that public commenters advocate for issues they care about rose from 49% to 62%. Knowledge of how public comment works in their city was moderate and also improved: the proportion of participants who correctly answered a procedural knowledge question about council meetings increased from 53% to 74%. Participants viewed public commenters more favorably than local government, yet their sense of being heard by local government also grew: agreement that their own voice is heard rose from 28% to 46%. These findings suggest that giving residents opportunities to engage with and learn from records of local political participation can foster positive civic outcomes.

0.32

Templated or fully synthetic? Prompt construction as a confound in measuring LLM political stance beyond writing assistance

cs.CL cs.CY ·2026-08-11 ·Ilias Chalkidis
position similarity 0.61
Abstract

Political stance detection in LLMs has long been dominated by closed-ended, multiple-choice political survey questions---originally designed for humans, and thus lacks the realism and nuance of human-AI interactions in the wild, while also being susceptible to sandbagging. The recent IssueBench framework substantially mitigates these limitations with templated prompts anchored in real-world chat logs. Given the rise in non-work-related use of GenAI assistants, we extend IssueBench beyond writing assistance to include two additional tasks, information seeking and opinion sharing. We argue that templated prompts still lack the nuance of real ones, especially for open-ended tasks, and remain recognisable as evaluation artefacts. We propose the use of fully synthetic (LLM-generated) prompts, produced under detailed instructions with real prompts as seeds. We assess the ecological validity of real, templated, and LLM-generated prompts in a small-scale study covering 3 highly contested policy issues and 3 recent geopolitical conflicts. Human and LLM annotators rank LLM-generated prompts as no less realistic than real ones and clearly more realistic than templated ones, and find that they carry their intended intent and stance more clearly; the LLMs separate templated prompts from the other two far more sharply than the humans do. In a case study, templated and LLM-generated prompts yield systematically different stance estimates for the same model, most visibly under neutral framings, where templated prompts overstate the model's leaning in the direction encoded by the topic-and-stance text (filler) slotted into their templates.

0.04

From Opinions to Commitments: Unstable Assignments and Silent Choices in AI-Mediated Proposals

cs.AI cs.HC ·2026-11-03 ·Sachit Mahajan, Javier Argota S{á}nchez-Vaquerizo, Arthur Capozzi, Dirk Helbing
similarity 0.61
Abstract

Large language models (LLMs) are increasingly being used to turn citizens' opinions into collective proposals. These proposals can make assignments: who should act, what must be done, how much one should spend and by when. However, if the assignments change when the same opinions are processed again, publishing a single proposal can hide alternatives that participants never get to see. We examined this issue in four LLM mediators (three open-weight and one commercial) using opinions from DeliberationBank and Polis. For each task, a mediator drafted a proposal from thirty opinions five times, varying either the random seed or the order of the opinions. In 17% of five-run sets from the open-weight mediators and 20% from the commercial one, some runs contained assignments while others did not. Reordering the opinions changed the assignments almost as often as replacing them with opinions from different citizens. Three human annotators confirmed that the detected differences between runs were real, although the LLM judge overstated how often they occurred. Substantial variation remained under four safeguards: temperature zero, a commercial mediator, draft selection, and draft merging. The mediator's objective also shaped representation: prompts seeking agreement covered minority positions much less often than prompts asking to describe differences. A single proposal can therefore obscure choices in both the assignments it proposes and the views it excludes. We propose audits that make alternative assignments visible and disclose the objective behind each proposal.

0.19

What Makes an Initial Reaction Ready for Discussion?: Multi-Persona AI Support for Stance Reflection and Writing

cs.HC ·2026-08-24 ·Sky Shih-Kai Hong, Mu-Tien Kuo, Wei-Ji Chen, Dennis Wang
published similarity 0.61
Abstract · 5 pages, 3 figures, 2 tables. Accepted to TAICHI 2026 (https://taichi2026.taiwanchi.org/program)

An initial reaction to a social or community issue can feel meaningful before it is ready to become a message: people still need to clarify the claim, anticipate audience risks, and decide how much reasoning should become visible to others. We present StanceLab, a prototype for preparing a stance before entering a discussion. The prototype compares a three-persona mode, where an Interviewer, Mentor, and Opponent respond in parallel to help users diagnose and revise a stance, with a standalone LLM mode. In a formative within-subject pilot with six participants and 12 task sessions, every session produced a short final message in the notepad. The pilot revealed two design requirements: persona roles should diagnose useful blind spots or objections, and parallel responses need coordination support. We propose a future diagnosis-and-writing workflow that turns persona-based reflection into selective, audience-aware final messages.

0.38

Fair Feed Ranking for Participatory Budgeting

cs.CY cs.IR ·2026-09-24 ·Carina I. Hausladen
publishedpositioncode/data similarity 0.59
Abstract · 8 pages, 2 figures, 2 tables. Published at GoodIT '26, the International Conference on Information Technology for Social Good, Pisa, Italy, …

In large-scale participatory budgeting, citizens cannot inspect the full proposal pool, so the order in which proposals are shown becomes a form of agenda-setting power. We argue that fair exposure should therefore be treated as a democratic-design goal. We study Consul Democracy, a widely deployed open-source digital-democracy platform, and show that its proposal feeds are typically ordered by popularity, recency, or comment activity. Building on this diagnosis, we propose FairFeed, a feed-ranking design for PB that uses transparently declared preferences, boosts under-exposed proposals, and admits a rate-limited reject channel for crowd-sourced vetting. We evaluate the design in a simulation anchored in Munich's 2025 PB process and compare it with random, newest, and most-commented feeds. In this simulation, FairFeed broadens proposal discovery, distributes visibility more evenly across the eligible pool, increases cross-cutting support, and improves resistance to manipulation relative to comment-based ranking. We conclude by outlining the human-subjects evaluation needed to test whether onboarding can recover voter preferences accurately enough for deployment in practice.

0.49

When Should AI Chime In? Benchmarking Timely Contribution of Proactive Agents in Multi-Party Chat

cs.AI ·2026-10-19 ·Ruotong Wang, Brian S. Yu, Xinyi Zhou, Joseph Chee Chang, Pao Siangliulue +3 more
benchmark similarity 0.59
Abstract

Proactive agents can support group collaboration by surfacing useful information without waiting to be asked, but even relevant contributions can be disruptive if poorly timed. In this work, we isolate the timing question: given a fixed candidate contribution such as a clarification or relevant fact, when should an AI agent chime in? We introduce PITCH (Proactive Intervention Timing in CHat), to our knowledge the first benchmark with large-scale human judgments of proactive agent timing collected from participants in the same unscripted multi-party conversations they took part in. To collect high-quality judgments, we design a novel interface in which 2-4 people chat synchronously, author candidate AI contribution messages, place their own and others' contributions into the chat history, and then deliberate as a group about the best placement for each message. PITCH contains 384 candidate contributions and 1,091 judgments, each marking an ideal turn, an acceptable window, or that a contribution should not appear, from 89 participants engaged in 35 conversations. Evaluating 15 models across 28 configurations, we find that while models can place contributions well when given the entire conversation history, they systematically chime in too early when asked to decide live as the conversation unfolds: best-turn accuracy falls from 57.8% to 19.0%, with nearly half of placements occurring before every participant's acceptable window. In comparison, lay humans deciding live are more accurate (23.7% vs 19.0%), and fewer of their placements are premature (39.7% vs 46.4%). Model reasoning traces show that 93% of intervention justifications cite relevance, while almost none consider waiting. By providing a human-grounded benchmark, our work reveals gaps in agents' ability to integrate into group settings and points towards proactive agents that can reason explicitly about appropriate timing.

0.11