CS Paper Radar

Appearing Legitimate is Not Enough: Interrogating Synthetic Agents in Representational Processes through a Participatory Design Lens

Aditya Nayak, Aditi Vashistha, Alissa Centivany, Aakash Gautam

cs.HC cs.CY ·submitted 2026-08-17 20:14 UTC · v1
publishedposition

Abstract

Synthetic agents built atop LLM-based foundation models are gaining popularity as substitutes for human participants across research contexts, including user-testing, market-research, computational social science, surveys, and qualitative research. We are also witnessing an extension of synthetic agents into experimental implementations of policy consultation, jury deliberation, humanitarian diplomacy, and similar contexts where human participation and representation are central to the perceived legitimacy of the institutional processes. The value of participation extends beyond informational contributions and consensus generation; participation is a necessary, legitimizing condition for democratic political institutions and processes. Treating synthetic agents as human substitutes raises serious political, representational, and ethical concerns. Participatory Design's modes of engagement --- probing, priming, understanding, and generating --- offer helpful tools for engaging with representational questions of personhood. We apply the lens to three case studies of synthetic agents substituting for personhood at varying representational scales: local policy, enterprise jury deliberation, and global diplomacy. We argue that legitimacy and personhood are integral and mutually constitutive while identifying the ethical, representational, and methodological risks of using synthetic agents in representational processes. We conclude by proposing soft and hard boundaries for designing oversight on LLMs and synthetic agents in representational processes.

Comment
13 pages total, 4 figures, accepted to the 9th AAAI Conference on AI, Ethics, and Society (AIES 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

New Conditions for Philosophers to Catch the Wave of Citizen Deliberation in the Age of Artificial Intelligence in advance

cs.AI ·2026-09-14 ·Bernard Reber
publishedhot direction similarity 0.64
Abstract

Powerful technologies labeled ``AI''-without sufficient epistemic caution-are already reshaping political and private life, bringing both new dangers and new opportunities for citizen participation. These range from electoral and legislative engagement to the most ambitious form: political co-creation through citizens' assemblies. Large Language Models (LLMs) could support such processes through moderation, translation, facilitation, summarization, and writing assistance. But this potential remains largely unrealized. The Democratic Commons project takes a fundamentally interdisciplinary approach-from philosophy to computer science-to evaluate LLMs against five proposed democratic principles. At its core, the project is driven by the question of political bias: under what conditions can LLMs be used democratically within forms of citizen participation that are them- selves still largely experimental? Addressing these socio-technical questions requires grounding in political theory and, more broadly, in philosophy-disciplines that provide the normative frameworks without which the democratic evaluation of AI systems cannot be mean- ingfully conducted.

0.44

The Deliberative Deficit: An Empirical Critique of LLMs in Democratic Discourse

cs.MA cs.AIcs.CY ·2026-08-10 ·Maurice Flechtner
publishedposition similarity 0.62
Abstract · 10 pages, archival publication at AIES 2026

LLMs are increasingly deployed in settings that require collective reasoning on complex, value-laden problems. Confidence in these deployments rests largely on benchmarks for verifiable tasks (mathematics, coding, coordination games), yet many of these applications concern problems where no objectively correct answer exists and where decision quality instead depends on integrating pluralistic perspectives to find mutually acceptable solutions. We argue that LLM reasoning capacity on this class of problems cannot be fully inferred from verifiable-task benchmarks, and that procedural evaluations of LLM discourse (respectfulness, justification, engagement) are systematically insufficient. We apply the Deliberative Reason Index (DRI), a measure developed in political science and validated across citizen assemblies, as a tool for evaluating reliable group-level reasoning on pluralistic, non-verifiable problems. Synthesizing recent evidence across 1,980 five-agent LLM runs on 12 citizen-assembly topics across 11 frontier model configurations, we find that LLM groups produce discourse with procedural quality comparable to human deliberation, while gains in intersubjective consistency are small, topic-dependent, and concentrated on tractable rather than ethically contested questions. LLM groups exhibit roughly one-third the perspective diversity of human assemblies and reverse the human convergence pattern: human deliberation decreases dispersion as diverse views synthesise, whereas LLM deliberation increases it. Engineering diversity through persona prompting does not restore the human dynamic but inverts which component of deliberative reasoning is updated. Our conclusion is constraining rather than prohibitive: LLMs can function as tools supporting human reasoning on pluralistic problems, but current evidence does not license treating them as autonomous deliberative agents.

0.58

Templated or fully synthetic? Prompt construction as a confound in measuring LLM political stance beyond writing assistance

cs.CL cs.CY ·2026-08-11 ·Ilias Chalkidis
position similarity 0.62
Abstract

Political stance detection in LLMs has long been dominated by closed-ended, multiple-choice political survey questions---originally designed for humans, and thus lacks the realism and nuance of human-AI interactions in the wild, while also being susceptible to sandbagging. The recent IssueBench framework substantially mitigates these limitations with templated prompts anchored in real-world chat logs. Given the rise in non-work-related use of GenAI assistants, we extend IssueBench beyond writing assistance to include two additional tasks, information seeking and opinion sharing. We argue that templated prompts still lack the nuance of real ones, especially for open-ended tasks, and remain recognisable as evaluation artefacts. We propose the use of fully synthetic (LLM-generated) prompts, produced under detailed instructions with real prompts as seeds. We assess the ecological validity of real, templated, and LLM-generated prompts in a small-scale study covering 3 highly contested policy issues and 3 recent geopolitical conflicts. Human and LLM annotators rank LLM-generated prompts as no less realistic than real ones and clearly more realistic than templated ones, and find that they carry their intended intent and stance more clearly; the LLMs separate templated prompts from the other two far more sharply than the humans do. In a case study, templated and LLM-generated prompts yield systematically different stance estimates for the same model, most visibly under neutral framings, where templated prompts overstate the model's leaning in the direction encoded by the topic-and-stance text (filler) slotted into their templates.

0.04

Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experiments

cs.MA cs.CYstat.ME ·2026-08-13 ·Ho Ting Hung, Nachiket Midha, Victor Y. Wu, Yiwen Zhang
similarity 0.60
Abstract

Despite growing interest in using LLMs to add robustness or reduce data-collection costs in survey experiments, their efficacy in conjoint design---an increasingly popular method in political science---remains underexplored. This paper addresses that gap by investigating whether synthetic agents can reproduce the multi-dimensional human preference patterns that conjoint is designed to capture. It replicates published conjoint studies and compares the results generated by synthetic agents with original human data along three dimensions: representational correspondence, inferential correspondence, and procedural stability. Our analysis evaluates the alignment of choice distributions as well as the statistical and substantive similarity of estimates, and the results are uneven across these dimensions and studies replicated. This implies that the validity of synthetic participants should be considered claim-dependent and hierarchical. Reproducing a figure or obtaining strong sign agreement is evidence of similar aggregate outputs, but not enough to support replacing human respondents. Our results suggest that the discipline as a whole must first map this innovation's boundaries across various levels before considering synthetic agents a robust substitute for human samples.

0.04

Large Language Models and Augmented Democracy

cs.CY cs.CLcs.CR ·2026-10-03 ·Jairo Gudiño-Rosero
similarity 0.60
Abstract · PhD thesis, Center for Collective Learning (Toulouse School of Economics), 2026. 149 pages, 28 figures

Artificial intelligence enables computational agents to represent political preferences and take part in collective decision-making. In this thesis, I investigate the opportunities and challenges of digital twins (DTs) based on Large Language Models (LLMs) as intermediaries in augmented democracy, focusing on individual preference representation, collective representation of political organizations, and the vulnerability of those representations to attackers. First, using data from an online experiment in Brazil, I examine whether personalized DTs can predict citizens' preferences for unseen policy proposals. Second, I extend the DT framework from individuals to political organizations. Using Swiss parliamentary data, I build topic-specific knowledge graphs from lawmakers' legislative records and connect them to LLM-based lawmaker agents, which are organized into party-level DTs representing collective positions. Agentic deliberation among these agents tests whether aggregated party representations capture a broader range of intra-party perspectives than official party communications. Finally, I study the vulnerability and robustness of LLM-mediated deliberation against prompt-injection attacks that amplify viewpoints, suppress opinions, or redirect consensus. Using data from a 2023 deliberative experiment in the United Kingdom, I analyze how attack effectiveness varies with the distribution of opinions and rhetorical strategies, and evaluate a pipeline combining injection detection, structured opinion representations, and reinforcement learning to improve resistance. These findings characterize the opportunities and challenges of LLM-based digital twins in augmented democracy, stressing accurate preference representation, faithful aggregation, and robustness to strategic interaction.

0.14

Political sense-making in "individual" human-technology-world relations: the case of LLM-generated autobiographies

cs.HC ·2026-10-23 ·Anthony Longo, Olya Kudina
similarity 0.60
Abstract · Reference: Longo, A., and Kudina, O. (in press). "Political sense-making in 'individual' human-technology-world relations: the case of LLM-g…

As AI systems increasingly mediate how people describe, recognize, and present themselves, their politics cannot be reduced to what remains hidden inside the "black box." This chapter argues that AI's political significance emerges within technologically, intersubjectively, and temporally mediated interpretive practices. Bringing Arendt's political philosophy into conversation with Gadamerian hermeneutics, the chapter develops a postphenomenological relational-temporal account of political sense-making across Human-Technology-World relations. Against the charge that postphenomenology remains individualistic and using the case of LLM-generated biographies, the chapter shows how seemingly private human-LLM encounters are worldly and collective. When users ask systems such as ChatGPT to describe them, they do not simply receive algorithmic representations. They interpret, contest, edit, share, and publicly test these descriptions. In doing so, people move interpretively among affective resonance, friction, public re-articulation, and the sedimentation of meaning. This means that the so-called "micro-level" of postphenomenological analysis is already saturated with publicity: affective uptake becomes communicable, reflection becomes accountable, and uses sediment into shared standards of appearance. Simultaneously, we show that once mediation is treated as relational and temporal, the political is not an add-on at the "macro" level; it is intrinsic to the very movement through which technologies amplify and reduce, stabilize and unsettle, and thereby compose a shared world in which judgment can take place. The chapter finishes by discussing several design and policy implications for AI of such political foregrounding in postphenomenology.

0.21

From Simulated Citizens to Simulated Deliberation: Challenges in Representation and Interaction

cs.AI ·2026-09-07 ·Chaemin Jang, Junsik Min, Jaewoo Choi, Donggyu Lee, Haiin Lee +7 more
similarity 0.59
Abstract

Can LLM agents simulate how a real public would deliberate? For such simulations to be meaningful, agents must reflect the population's opinions, and their views must be shaped by what others say during discussion. We evaluate these requirements across six LLMs using national surveys, controlled deliberation experiments, and a real deliberative poll. Comparing census-grounded Korean personas against national surveys, we find that agents often produce overly concentrated opinions and fail to reliably reproduce demographic differences. During simulated deliberation, agents exchange arguments, respond to one another, and frequently change positions. Yet similar changes occur even when agents cannot see one another's contributions, while simply restating their starting positions sharply reduces movement. We further test whether these limitations persist in a real-world setting, using agents constructed from actual respondents in the 2017 Shin-Kori deliberative poll. Even with real respondent profiles, agents fail to reproduce the panel's initial opinion distribution or how its opinions change across survey waves. Our findings show that generating deliberative discussions, representing public opinion, and reproducing interaction-driven opinion change are distinct capabilities. These results suggest a different potential role for LLM deliberation: surfacing arguments and perspectives, rather than simulating a real public.

0.19

AI Should Facilitate Democratic Deliberation at Scale

cs.HC cs.AIcs.CLcs.CY ·2026-09-17 ·José Ramón Enríquez, Jiaxin Pei, Alex Pentland
top venueposition similarity 0.59
Abstract · 15 pages, 2 figures, ICML 2026

AI systems can strengthen democracy by supporting deliberation at scale by addressing cognitive, social, platform-design, and market-driven frictions, while preserving human agency. Unlike proposals such as liquid democracy that restructure representation through vote delegation, in this position paper, we argue that AI-assisted deliberation offers a more promising path by lowering barriers to meaningful engagement without substituting machine judgment for human choice. Drawing on evidence from online deliberation platforms and experimental research, we identify four guiding principles: preserving agency and autonomy, encouraging mutual respect, promoting equality and inclusiveness, and augmenting rather than substituting active citizenship. We also address critical challenges, including alignment, sycophancy, training bias, and over-reliance on AI systems. We call on the machine learning community to develop deliberation-focused AI systems evaluated not on engagement metrics but on their capacity to facilitate informed, representative, and friction-robust discourse.

0.41