CS Paper Radar

Exploring Collaborative Debating Models for the future of science

Zeki C. Seskir

cs.CY physics.soc-phcs.DL ·submitted 2026-10-30 20:54 UTC · v1

Abstract

AI is expanding what researchers can produce. A substantial increase in scientific output would also change how that work is organised and distributed, as earlier shifts in the scale of science have done. This paper develops a thought experiment around Collaborative Debating Models (CDMs), topic-focused environments where researchers work with AI and one another to pursue questions and maintain an evolving account of their field. Individual contributions would remain attributable as ongoing debate and further analysis change the shared account. The paper considers how journals could evolve into these gathering places and how different forms of ownership would shape scientific agendas and the support for continuing work. CDMs could connect participants to remote laboratories and other research services to conduct new studies, with shared repositories making the resulting data available for further inquiry. The proposal links expanded scientific production to collective interpretation through continuing assessment and revision, while leaving room for disciplinary differences in how contributions are reviewed and recognised.

Comment
15 pages

Closest papers

Nearest neighbours by meaning across the whole index.

Symposium: Trust via Auditable Records for Communities of AI Scientist Agents

cs.AI ·2026-08-20 ·Dexter Pratt
similarity 0.63
Abstract

Symposium is a formal framework and practical implementation to record the operation of AI agents deployed by small scientific research communities. Symposium provides long-term, immutable histories of agent-driven research activity, leaving auditable trails of analyses, hypotheses, data, and scientific discourse. This shared record of published artifacts enables agents to build on prior work and preserves the evidence researchers and agents need to make purpose-dependent trust assessments. Symposium captures scientific argument, including structured claims, fine-grained evidence citations, assumptions, and explicit declarations of what material may and may not be used as evidence. Symposium differs from AI co-scientist agents or integrated AI research environments; it is a framework that separates a scientific community's durable history from the agents and other systems that operate on that history. It assumes that a community will use diverse AI systems in a rapidly evolving environment. A working implementation of the publication infrastructure, agent prompt components, and documentation are provided to enable users to rapidly set up and run their own Symposium community.

0.23

Gricea: An Open Science Platform for Conversational AI Research

cs.HC cs.AI ·2026-09-18 ·Nikhil Sharma, Yunlin Gong, Xinyang Cheng, Ziang Xiao
similarity 0.63
Abstract · 19 pages, 3 figures, 4 tables. Pre-print

We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing various open-ended research questions. Together, these findings demonstrate Gricea's support for constructing, reproducing, and extending CAI studies through shared research artifacts, enabling cumulative knowledge building through open science.

0.27

Scientific Liquidity Agents: An Agent-Based Model of Knowledge Arbitrage in Scientific Communities

cs.MA cs.AIcs.SI ·2026-11-02 ·Koutian Wu, You Liu, Yue Liu, Zhiping Li, Ergan Shang
code/data similarity 0.62
Abstract · First version on Zenodo, December 8, 2025: https://zenodo.org/records/17861999

Scientific knowledge gains new uses when ideas, methods, and results move between research contexts. Understanding this process requires a model of both specialized knowledge production and the intermediary activities that connect it. We introduce Scientific Liquidity Agents (SLA), an agent-based model of knowledge arbitrage in scientific communities. SLA represents domain specialists and epistemic arbitrageurs within a shared environment of research problems, researcher interactions, and scientific artifacts. Individual decisions connect to collective state through a belief-desire-intention architecture, a prerequisite-based problem graph, a dynamic interaction network, and a persistent publication registry. The framework makes researcher roles and knowledge-transfer frictions explicit, providing a process-oriented account of scientific production and exchange. Two exploratory simulations with 10 and 18 agents produce 68 and 274 registered papers. In the smaller run, arbitrageurs take part in 16 of the 26 contact pairs that join this community into one connected component, while topical similarity alone splits it into seven. The same run yields three similarity edges, 26 contact pairs, and two coauthorship pairs, so measured community structure depends on what counts as a link. Paper production is abundant, but no recorded replication succeeds, which places the bottleneck in verification rather than production. Solved-problem sets correspond to the prerequisite reachability of the disciplines represented in each community. SLA makes knowledge liquidity, the movement and reuse of artifacts across domains, a quantity that agentic science can simulate and measure.

0.27

DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents

cs.HC cs.AI ·2026-09-24 ·Heechan Lee, Juhyeon Choi, Tae Soo Kim, Juho Kim, Joseph Seering
similarity 0.62
Abstract

In open-ended problem solving, collaborators often rely on discussion to surface concerns, challenge perspectives, and refine shared work as it evolves. While AI agents are increasingly used as discussion partners, existing multi-agent systems place a heavy burden on users to initiate and carefully orchestrate the discussions. We present DocuTeam, a mixed-initiative multi-agent discussion system in which both users and agents can initiate and steer conversations. Agents monitor document changes to proactively start and redirect discussions as the work evolves, while users can flexibly shape the conversation or adopt agent ideas. In a within-subjects study (N=20), participants using DocuTeam produced outcomes rated significantly more novel, relevant, and specific than with a baseline without any increase in cognitive load. Rather than using agents for one-off idea sourcing, participants engaged in an iterative refinement loop in which document changes prompted agent reactions, which led users to revisit and further develop their work.

0.07

LLMs and the Organization of Scientific Work

cs.CY ·2026-11-02 ·Stefano Bianchini, Georgiana-Ioana Coroama
similarity 0.60
Abstract

The advent of large language models (LLMs) represents a technological revolution for science. Their diffusion may reshape not only how scientists conduct research, but also how they organize their work within teams. Here, we develop a conceptual framework in which LLMs expand individual capabilities across a range of research activities, reducing reliance on complementary human inputs within tasks and facilitating a more specialized division of labor among team members. We further propose that teams' history of collaboration may constrain their ability to reorganize in response to the new technological capabilities. Using CRediT contribution statements from approximately 120,000 PLOS ONE articles published between 2018 and 2025, we investigate changes in the division of labor within scientific teams following the release of ChatGPT in late 2022. We document three main findings. First, participation in scientific tasks falls below its previous trajectory, particularly in conceptualization, execution, and writing. Second, researchers become more specialized, exhibiting narrower task portfolios and less overlap in their contributions with co-authors. Third, these changes are concentrated among newly formed teams, whose members have no prior collaboration ties, whereas established teams, whose members have all collaborated previously, exhibit considerably greater organizational inertia. Our findings suggest that, in the wake of LLM diffusion, scientific work is being reorganized around greater individual autonomy and an increasingly specialized division of labor within teams.

0.22

Designing Human-AI Collaborative Science: The 9A Framework

cs.HC ·2026-10-16 ·Zihan Zheng, Linyue Pan, Xin Lan
similarity 0.59
Abstract · 19 pages, 2 figures, 2 tables

Artificial intelligence (AI) for Science is often described as a progression from human-directed assistance toward increasingly autonomous AI scientists. Human-AI collaboration offers a further mode in which human and AI contributions substantively shape scientific reasoning, judgments, and the course of inquiry. Existing research addresses work allocation, human-AI coordination, and system evaluation, but how these aspects interact to shape collaborative scientific systems remains insufficiently articulated. We develop the 9A Framework for Human-AI Collaborative Science (HACS) to connect these considerations across three layers. The organization layer specifies what scientific activities are required (Activity), who performs them (Actor), and who holds authority over consequential decisions (Authority). The coordination layer addresses how participants access relevant research information (Awareness), how scientific work advances through iterative proposal, execution, examination, revision, and resolution (Accountability), and when collaborative arrangements should be adjusted (Adaptability). The evaluation layer establishes what constitutes effective system performance (Achievement), how comparisons can be designed to identify the effects of organizational and coordination choices (Attribution), and what evidence supports the resulting conclusions (Assurance). Together, these layers frame HACS as a system-design problem, providing a basis for designing collaborative scientific workflows and for empirically comparing their effectiveness.

0.27

Puzzles to Paradigms: A Survey of Human--Agent Collaboration in Scientific Innovation

cs.HC cs.AI ·2026-08-31 ·Zhenni Liang, Haoxuan Zhang, Haihua Chen, Ting Xiao, Junhua Ding +1 more
top venuesurveycode/data similarity 0.58
Abstract · Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026. 25 pages, 2 figures, 5 tables

Agentic AI systems are increasingly embedded in scientific workflows, including literature synthesis, hypothesis generation, tool use, writing, and peer review. However, existing surveys and evaluations often emphasize task performance while underexamining how humans and agents coordinate under different epistemic conditions of scientific work. This survey introduces CSCW$\times$Kuhn, a coordination-aware framework that connects computer-supported cooperative work dimensions with distinct scientific contexts. Using this framework, we synthesize recent human--agent systems and benchmarks to examine how coordination demands and failure risks may vary across contexts. Our synthesis identifies five recurring failure modes: procedural drift, grounding substitution, evaluative flattening, proxy optimization, and epistemic black-boxing, and argues for evaluations that move beyond task accuracy and toward grounding, provenance, disagreement preservation, and long-horizon scientific reliability. Our corpus and coding artifact are available at https://github.com/jenlia024/CSCWxKuhn-artifact.

0.55

Beyond Better Ideas: How Human-AI Collaboration Shapes Scientific Ideas and Human Perceptions

cs.HC ·2026-10-22 ·Qian Chen, Saatvik Pradhan, Janice Ahn, Berk Atil, Angkai Li +5 more
similarity 0.57
Abstract · 23 pages, 10 figures, 9 tables

As AI increasingly becomes a collaborator in scientific research, its impact may extend beyond improving ideas to reshaping how they are evaluated, attributed, and perceived by humans. Yet existing research has largely examined these dimensions in isolation. We present a unified empirical study of Human-AI scientific ideation, investigating two complementary perspectives: i) how AI collaboration shapes scientific ideas and their evaluation, and ii) how firsthand collaboration reshapes human perceptions of AI. Through a shared experimental setting involving Human-AI and Human-Human research teams, human and LLM evaluators, collaboration-provenance analysis, and participant surveys, we uncover several counterintuitive findings. First, AI collaboration shows no significant advantage in human-evaluated idea quality, while iterative revision consistently improves quality. Second, AI judges can approximate human scores yet disagree on idea rankings; notably, an AI judge favors AI-assisted proposals without a corresponding advantage in human evaluations. Third, collaboration provenance remains only partially detectable, revealing substantial overlap between Human-AI and Human-Human scientific outputs. Finally, firsthand AI collaboration is associated with greater perceived usefulness but smaller efficiency gains than expected, suggesting a nuanced recalibration of human expectations. Overall, our findings challenge the notion that AI's value in scientific ideation lies primarily in producing better ideas, revealing instead its broader influence on scientific creation, evaluation, attribution, and human perceptions.

0.10