CS Paper Radar

Tracing high-profile attention to questionable research as a case for funder due diligence

Federica Silvi, Leslie D. McIntosh

cs.DL cs.SI ·submitted 2026-08-31 11:24 UTC · v1

Abstract

When questionable research has entered the scientific record, it stands the same chance as other literature of shaping national and international policy, clinical guidance, and research and development activities. This study uses a known authorship-for-sale network identified in August 2022 to examine whether questionable research influences policy, patents, and clinical guidelines, and whether its authors continue to secure funding and publish after exposure. Across nearly 2,000 publications in our dataset, 57 were cited in policy documents, 12 in clinical guidelines, and 480 in patents. Nearly a quarter of these publications are linked to one or more grants: funding that could otherwise have supported rigorous, ethical science. Among the 278 authors we traced, publishing and funding continued well after the PNN's public exposure in 2022: over 90% continued publishing, and 23% were linked to a grant. As our findings show, the participants of paper mills and authorship-for-sale networks can still inform policy and clinical practice and support their authors' career progression even after the questionable practices behind them are exposed. We present a case for funders to consider authorship and network structure as part of a holistic due diligence process, alongside metrics such as citation counts and attention data.

Comment
40 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

The Hidden Costs of Gatekeeping in Open Science: Quasi-Experimental Evidence from arXiv's Endorsement Policy Tightening

cs.SI cs.DL ·2026-10-25 ·Wenchang Wang
hot direction similarity 0.62
Abstract · 9 pages, 3 figures, 8 tables. Prepared for submission to The Web Conference 2027

Preprint servers and open science platforms have become core infrastructure through which scientific knowledge circulates on the Web, greatly facilitating the dissemination and diffusion of online scientific information. Yet to safeguard content quality, many of these platforms rely on existing members to vouch for newcomers; how such network-mediated gatekeeping reshapes entry barriers across different scientific communities remains systematically underexplored. To address this, I examine the potential unequal impacts of this mechanism through arXiv's tightening of its endorsement policy in early 2026. Using the metadata of three million arXiv papers and the co-authorship networks of each research community, I compare the influx and dynamics of first-time submitters before and after the policy across eight disciplines. The findings show that the policy reduced the entry of new authors, and this reduction was concentrated in fields where co-authorship ties are sparse, while fields with dense collaboration networks were largely spared. A comparison with a parallel preprint server in biology suggests that this likely reflects a shift in where researchers choose to post rather than a decline in research activity. These findings demonstrate that the network structure of a scientific community shapes who can enter online scientific production, advancing our understanding of how the Web's open knowledge infrastructure shapes inequality in the diffusion of science.

0.39

When disclosure rules are not enough: authorial warrant and judgment in ai-supported scholarship

cs.CY ·2026-10-23 ·Marcin Mirończuk
published similarity 0.59
Abstract

Editorial policies increasingly require authors to disclose substantive uses of generative AI, but such requirements commonly focus on whether, where, and how a model was used. Even function-specific disclosure may locate a model in the research or writing process without showing how its outputs entered scholarly judgment, how they were evaluated, or whether contributors can reconstruct the relevant reasoning and defend resulting claims without treating those outputs as sufficient justification. Drawing on research ethics, AI disclosure policy, human-model interaction, and researcher formation, this article argues that disclosure documents model use, whereas responsible use requires claim-level authorial warrant: a contributor's capacity to understand, justify, and defend claims within their contribution. The article distinguishes cognitive delegation, in which model outputs shape substantive choices, interpretations, or justifications, from routine delegation, which does not ordinarily bear on the substance of judgment. Its conceptual contribution is to link the epistemic role of outputs that shape judgment to the function-appropriate evaluation required to justify decisions and retain warrant for resulting claims. It then repurposes disclosure categories as a claim-sensitive ex ante heuristic, mapping six recurrent research functions to risks, forms of oversight, and formative questions for recognising cognitive delegation and selecting function-appropriate evaluation. The article contributes to the ethics of information technology by clarifying when AI-supported scholarship remains under responsible human judgment and when cognitive delegation threatens the epistemic basis of authorship.

0.24

What It Costs to Trust a Source: A Reproducible Method for Institutional Assessment of Author Disambiguation

cs.DL ·2026-10-29 ·Simon Porter
similarity 0.57
Abstract

Records of research outputs are curated with care by universities, and the effort is shaped by the external sources from which candidate records are drawn. The curation required before the author identities in such sources can be trusted is examined, and a reproducible method for estimating its cost is set out. Four tests are described; two can be run on public data alone, and two are conducted against an institution's own curated record, taken from Symplectic Elements Discovery portals. The method is demonstrated on OpenAlex and Dimensions across 30 institutions. Of the publications attributed to matched researchers, 50.4\% were confirmed by the institutional record for OpenAlex and 69.6\% for Dimensions, and fewer trusted researcher profiles were retained from OpenAlex at a matched confidence threshold in each of the 30 institutions. Carried through to effort, integrating OpenAlex requires 1.5 times the person-days of review and entry of Dimensions even when each feed is filtered at the threshold that minimises the amount of review required.

0.27

Who Wrote It Is Not Enough: Detecting Who Contributed the Insight

cs.CL ·2026-10-05 ·Zhuoyang Zou, Abolfazl Ansari, Jiaxi Yang, Delvin Ce Zhang, Qian Chen +2 more
similarity 0.56
Abstract

As LLMs increasingly assist scientific writing and peer review, detecting who wrote the text is no longer sufficient: we need to determine who contributed the underlying insight. We introduce Insight Provenance, the task of identifying whether a review insight originates from a human, an LLM, or their hybrid contribution. We construct InsightProv-v0 from 4,057 scientific papers and 12,660 human reviews, simulating different levels of LLM involvement with GPT-4o, Gemini, and DeepSeek and annotating provenance at the sentence level. We show that strong performance on raw data can be misleading, as models exploit linguistic and textual-authorship shortcuts that degrade substantially under progressively debiased evaluation. We therefore propose a two-stage adversarial framework that suppresses shortcut signals while preserving provenance-relevant information. Beyond detection, extensive analyses reveal what makes intellectual authorship identifiable: paper grounding and neighboring review context provide complementary provenance signals, while human, hybrid, and AI insights systematically differ in their information sources and failure modes. Most strikingly, AI insights predominantly remain close to generic or paper-provided information, whereas human insights more often introduce external knowledge and independent judgment. These findings suggest that while wording can be rewritten by an LLM, the provenance of an idea leaves a deeper and more persistent signal.

0.14

Mentorship resources and citation-elite journal publication trajectories after training: Evidence from bioscience mentor-mentee networks

cs.DL cs.SI ·2026-09-11 ·Hao Zeng, Yi Bu, Qingshan Zhou, Hongkan Chen
similarity 0.56
Abstract

Mentorship provides mentees with knowledge, collaborators, and reputation, but when do these resources support scholarship beyond training? Using 239,931 bioscience mentor-mentee pairs from the Academic Family Tree (1800-2020) linked to OpenAlex metadata, we examine this question through mentees' publication in citation-elite journals, identified by three source-level citation indicators. We distinguish training-period mentor and peer resources from post-graduation topic and coauthorship network continuity. Analyses combine trajectory comparisons, three propensity-score matching designs, PPML, two-part model and non-overlapping landmarks relating continuity in post-graduation years 1-3 to publication outcomes in years 4-10 and 6-20. Citation-elite journal publishing during mentorship is positively associated with later publishing, but correlates differ by career stage. Close mentor collaboration and larger peer group size characterize training-period publishing, whereas both are negatively associated with post-graduation publication probability and intensity. Early topic and network continuity are positively associated with later output in landmark analyses; across extended conventional windows, topic continuity becomes less favorable, consistent with later agenda broadening. Network continuity shows the most stable positive association with publication intensity. The findings suggest a stage-dependent resource-conversion process: training resources may facilitate entry into citation-elite journal publishing, whereas sustained output is associated with how intellectual and relational ties are retained or reconfigured.

0.22

Science Utopia? Closed-Loop LLM Simulation of Academic Research Ecosystems

cs.CL cs.AIcs.CY ·2026-10-01 ·Yiqiao Jin, Yiyang Wang, Lucheng Fu, Bing He, Siheng Xiong +6 more
code/data similarity 0.55
Abstract · https://ahren09.github.io/ScienceUtopia/

Scientific progress emerges from a longitudinal ecosystem in which researchers, institutions, funding agencies, collaboration networks, and the scientific literature co-evolve. As AI becomes increasingly involved throughout the scientific research cycle, understanding these interconnected and evolving processes becomes increasingly important. We introduce SciUtopia, a persistent, closed-loop LLM-agent simulation framework for studying academic research ecosystems. SciUtopia models interconnected scientific processes such as research-direction choice, collaboration, submission, peer review, resubmission, citation, funding, and researcher attrition, while maintaining evolving states across simulated years. Its configurable institutional mechanisms and information channels provide a controlled testbed for matched counterfactual experiments and targeted interventions. Across 61 simulation worlds, SciUtopia simulates over 40,000 researchers from 8,000 institutions, producing around 400,000 publication decisions and 1.2 million LLM-generated peer reviews. Using these longitudinal simulations, we find that rejection-driven resubmission substantially amplifies reviewer burden beyond population growth alone, cautious exploration balances citation impact with career success and long-term topic diversity, and resource inequality can emerge even without detectable cumulative advantage from narrowly winning early funding. Code is available at https://github.com/Ahren09/ScienceUtopia.

0.27

LLM Signals in Funded Grants: Evidence from International Funding Agencies

cs.DL ·2026-09-03 ·M. Z. Naser
similarity 0.55
Abstract

The release of ChatGPT in November 2022 introduced a writing tool of unprecedented fluency into the daily routines of researchers across the sciences. Prior work has measured what follows in journal abstracts and in peer reviews by documenting an upward shift in the frequency of words and short phrases that large language models (LLMs) tend to overproduce. However, a much less-examined question concerns whether the same shift extends to grant proposals, the documents through which researchers compete for public funding, and, in particular, to the subset of proposals that succeed. Such a distinction is important to note because funded grants represent decisions to allocate public research resources, and because the proposing population spans every scientific discipline in which a country supports research. This brief report draws on an analysis of 221,425 funded grant abstracts from three major science-funding agencies in two countries: the U.S. National Science Foundation (NSF), the U.S. National Institutes of Health (NIH), and UK Research and Innovation (UKRI). The window covers late 2017 through mid-2026, providing roughly 5 years of pre-ChatGPT baseline and 3.5 years of post-release observation in each corpus.

0.26

The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing

cs.AI cs.CL ·2026-09-07 ·Chenguang Wang, Ming Li, Adebayo Braimah, Chenrui Fan, Tuo Wang +4 more
positionhighly cited similarity 0.54
Abstract

Generative and agentic AI are reshaping both the production and evaluation of scientific research. These developments are often studied separately, as questions of how AI can produce research and how AI can review it. We argue that this separation misses an increasingly important feature of scholarly publishing: changes on one side alter the incentives, constraints, and behavior of the other. We synthesize 230 scholarly publications and institutional records using a taxonomy of six connected dynamics: production scaling, evaluation automation, evaluation manipulation, defense mechanisms and policy responses, evasion and side effects, and long-horizon ecosystem feedback. The literature shows an emerging progression in which cheaper and faster research production increases pressure on evaluation, AI-mediated evaluation becomes more scalable and repeatable, participants can exploit evaluator regularities, and institutions respond with technical safeguards and policy controls. These responses can in turn induce evasion, redistribute errors and workload, and shape the scholarly records reused by future research and evaluation systems. Evidence is strongest for production and evaluation at scale, reproducible manipulation, and institutional response, while post-policy adaptation and artifact-level long-horizon feedback remain less directly observed. This systems view shifts attention from isolated AI capabilities toward how scholarly actors and AI systems adapt to one another over time.

0.52