CS Paper Radar

Analysis of Potential Generative AI Use in Abstracts of KAKENHI-Funded Projects

Hitoshi Koshiba, Miki Ida-Kimura

cs.DL ·submitted 2026-08-21 02:14 UTC · v1

Abstract

This study analyzes the extent to which abstracts of projects funded under the Scientific Research (C) category of the Grants-in-Aid for Scientific Research (KAKENHI) were classified as AI-generated. The analysis covers projects funded over the five-year period from FY2022 to FY2026. The number of abstracts classified as AI-generated began to increase in FY2025, and approximately 20% of the abstracts were classified as AI-generated in FY2026. Although the proportions varied to some extent, abstracts classified as AI-generated were observed in many review categories. These findings indicate that the use of generative AI has begun to spread across many research fields represented in Scientific Research (C).

Comment
14 pages, 7 figures, Earlier Japanese version submitted to Jxiv

Closest papers

Nearest neighbours by meaning across the whole index.

Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use

cs.HC cs.AI ·2026-09-14 ·Daniele Veri'
hot direction similarity 0.56
Abstract · 21 pages, 4 figures, 4 tables

Researchers assessing competent generative-AI use at work must choose among self-reports, objective tests, and measures of oversight and reliance. We conducted a structured, seeded review of 24 focal empirical publications, starting from the 2024 COSMIN-based review and adding a targeted update through 17 August 2026. We grouped the measures into four domains: knowledge and use, epistemic oversight, reliance calibration, and operational control of tool-using agents. In an exploratory meta-analysis, we pooled three direct subjective-objective correlations from one research program (REML r = .055; Hartung-Knapp 95% CI [-.047, .156]; combined reported N = 2,765). We could not resolve a discrepancy between the largest study's reported correlation and p-value, leaving its weight uncertain. Adding a synthetic mean of 12 cross-factor correlations from a fourth study gave r = .079 (95% CI [-.025, .181]). This sensitivity analysis concerns a broader comparison. From this small evidence base, we cannot establish a population correlation, validate workplace cutoffs, or justify substituting self-ratings for performance scores. We identified tests of foundation knowledge (AICOS-S and GLAT) and measures of verification, reliance, trust, and dependency. We found no validated individual-level instrument in the focal corpus that tests the full combination of agent scope, permissions, recovery, state isolation, independent review, and evidence-based closure; some cover subsets. We propose a four-layer workplace battery with non-compensatory decision rules, but have not tested its thresholds or whether it improves on other assessment approaches.

0.37

Generative AI Expands the Intellectual Reach of Course Based Undergraduate Research Experiences (CUREs)

cs.AI cs.HC ·2026-08-27 ·Aditi Babar, Kristin J. Davin, Alex Dornburg
similarity 0.56
Abstract

Course-based undergraduate research experiences (CUREs) broaden access to authentic scientific inquiry through responsive instructor support as research problems become increasingly complex. Generative artificial intelligence (GenAI) may extend this support by providing individualized assistance that can adapt as student needs change. However, how embedding GenAI within a CURE to provide support across the research process impacts student inquiry, collaboration, and scientific reasoning remains unresolved. Here we use longitudinal qualitative data collected across three semesters of a bioinformatics and genomics CURE to show that GenAI expanded the intellectual reach of the research experience in three distinct ways. First, personalized, on-demand scaffolding allowed students to move beyond the boundaries of instructor expertise and transform their own interests into researchable inquiry, with all teams developing distinct self-directed projects rather than selecting instructor-provided topics. Second, GenAI became part of the distributed cognitive system of research teams, helping novice researchers communicate and coordinate across differentiated expertise without eliminating specialization. Third, expanded capability did not replace the need for disciplinary judgment. Students increasingly validated, revised, or rejected AI-generated contributions, such that research independence emerged through retained intellectual responsibility. Together, these findings suggest that GenAI can extend the reach of CUREs by expanding what novice researchers can investigate, how they can collaborate, and the level of responsibility they can assume while preserving human judgment central to authentic scientific inquiry.

0.20

LLM Signals in Funded Grants: Evidence from International Funding Agencies

cs.DL ·2026-09-03 ·M. Z. Naser
similarity 0.54
Abstract

The release of ChatGPT in November 2022 introduced a writing tool of unprecedented fluency into the daily routines of researchers across the sciences. Prior work has measured what follows in journal abstracts and in peer reviews by documenting an upward shift in the frequency of words and short phrases that large language models (LLMs) tend to overproduce. However, a much less-examined question concerns whether the same shift extends to grant proposals, the documents through which researchers compete for public funding, and, in particular, to the subset of proposals that succeed. Such a distinction is important to note because funded grants represent decisions to allocate public research resources, and because the proposing population spans every scientific discipline in which a country supports research. This brief report draws on an analysis of 221,425 funded grant abstracts from three major science-funding agencies in two countries: the U.S. National Science Foundation (NSF), the U.S. National Institutes of Health (NIH), and UK Research and Innovation (UKRI). The window covers late 2017 through mid-2026, providing roughly 5 years of pre-ChatGPT baseline and 3.5 years of post-release observation in each corpus.

0.26

Open Science, Closed Models: How Funding Shapes AI in Science

cs.DL ·2026-09-21 ·Ana Trišović, Janakan Sivaloganathan
published similarity 0.53
Abstract · Accepted to AAAI/ACM Conference on AI, Ethics and Society (AIES) 2026

How funding shapes AI engagement in science is poorly understood despite its structural importance. We analyze 104,226 papers (2018-2025), linking funding acknowledgments to how each paper engages with foundation models: whether it extends a model (fine-tunes or builds on it), uses one without modification, or references models only peripherally. We report three findings. First, both private and public funding are associated with greater AI engagement. Public funding is associated with more off-the-shelf and open-weight use, while private funding is associated with greater model extension. Industry cloud credits are associated with less open-weight use, consistent with greater reliance on closed models. Second, industry involvement is associated with model extension, suggesting that corporate resources reach science through coauthorship, though this channel is concentrated in Computer Science and Global North collaborations. Third, the gap across research systems is not one of AI adoption but of control. Off-the-shelf use is rising across fields and country groups, and the least publicly funded group, the Global South, now has the highest share of API-only engagement (0.4% to 10.0% of engaged papers). China shows the opposite profile: the highest public-funding share and lowest API-only engagement, with extension remaining stable as it declines across the Global North. Standard capacity indicators show convergence in AI adoption even as dependence on proprietary infrastructure diverges.

0.23

The Gold Rush in AI4Math, II: What are signatures of AI-assisted Proofs?

cs.AI stat.AP ·2026-11-05 ·Yuanchuan Guo, Jiashun Jin, Zheng Tracy Ke, Bingcheng Sui
similarity 0.53
Abstract · 31 pages, 15 figures

The growing use of AI in mathematics raises a question: can we detect AI involvement in proofs, separately from AI assistance with writing? Historical arXiv papers, recent papers disclosing substantive AI use, and manuscripts released by OpenAI provide a rich empirical basis for studying this question. However, several challenges remain: lack of matched case-control pairs; potential incompleteness of disclosure; and lack of ready-to-use features designed to capture signals of AI involvement in proofs. To address these challenges, we construct five cohorts comprising 8,281 papers by combining existing manuscripts with those we produced using generative AI. These cohorts span different levels of AI involvement and include matched pairs of papers addressing the same research problems. We then introduce ProofTrace, a framework that represents each paper as a graph of immediate proof support (GIPS) and extracts interpretable features of mathematical organization. Our study yields three discoveries. First, principal-component projections of our features reveal a qualitative gradient of AI involvement, where AI-reworded papers remain close to human papers, the two AI-generated cohorts depart in broadly shared directions, and papers disclosing substantive AI use occupy intermediate positions which shifts toward AI-generated cohorts over time. Second, we identify recurring signatures of AI-generated proofs, such as fewer externally cited results, greater reliance on intermediate conclusions, and altered graph connectivity; many of these signatures persist under controls for research field, manuscript length, or graph size. Finally, in a separate detection experiment, ProofTrace distinguishes human-written papers from those disclosing substantive AI use. Its performance remains stable under AI rewording, whereas the performance of state-of-the-art text-based detectors declines sharply.

0.22

Orchestrating GenAI for Interdisciplinary Research

cs.HC ·2026-09-24 ·Shirley Anugrah Hayati, Moyan Zhou, Patricia Anugrah Setiani, Ruizi Wang, Joseph Chee Chang +1 more
similarity 0.53
Abstract

As researchers tackle interdisciplinary problems, they face the need to deepen expertise in primary areas while rapidly acquiring knowledge in secondary domains. Generative AI (GenAI) is increasingly positioned to meet this need, from general-purpose chat assistants to Deep Research tools marketed as autonomous research agents. Prior work has examined how researchers use GenAI to support single-discipline or general research tasks. However, we know little about the goals and GenAI practices in interdisciplinary research. We conducted a longitudinal study and semi-structured interviews with 15 interdisciplinary researchers to examine how interdisciplinary researchers actually orchestrate GenAI. Findings show that researchers leaned on GenAI to fill knowledge gaps while maintaining epistemic agency for novelty discovery. We also uncovered an expertise paradox: GenAI outputs were hardest to verify when most needed. Our empirical insights motivate GenAI designs that calibrate verification to researchers' expertise, nudge toward cross-domain synthesis, and adapt prompting and outputs to disciplinary conventions.

0.33

Beyond Better Ideas: How Human-AI Collaboration Shapes Scientific Ideas and Human Perceptions

cs.HC ·2026-10-22 ·Qian Chen, Saatvik Pradhan, Janice Ahn, Berk Atil, Angkai Li +5 more
similarity 0.52
Abstract · 23 pages, 10 figures, 9 tables

As AI increasingly becomes a collaborator in scientific research, its impact may extend beyond improving ideas to reshaping how they are evaluated, attributed, and perceived by humans. Yet existing research has largely examined these dimensions in isolation. We present a unified empirical study of Human-AI scientific ideation, investigating two complementary perspectives: i) how AI collaboration shapes scientific ideas and their evaluation, and ii) how firsthand collaboration reshapes human perceptions of AI. Through a shared experimental setting involving Human-AI and Human-Human research teams, human and LLM evaluators, collaboration-provenance analysis, and participant surveys, we uncover several counterintuitive findings. First, AI collaboration shows no significant advantage in human-evaluated idea quality, while iterative revision consistently improves quality. Second, AI judges can approximate human scores yet disagree on idea rankings; notably, an AI judge favors AI-assisted proposals without a corresponding advantage in human evaluations. Third, collaboration provenance remains only partially detectable, revealing substantial overlap between Human-AI and Human-Human scientific outputs. Finally, firsthand AI collaboration is associated with greater perceived usefulness but smaller efficiency gains than expected, suggesting a nuanced recalibration of human expectations. Overall, our findings challenge the notion that AI's value in scientific ideation lies primarily in producing better ideas, revealing instead its broader influence on scientific creation, evaluation, attribution, and human perceptions.

0.10

Interpreting Paper-to-Patent Citations in AI-Related PMC Articles

cs.DL ·2026-10-13 ·Haowei Li, Yi Bu
similarity 0.52
Abstract · 28 pages, 3 figures, 6 tables

Paper-to-patent citations connect scientific and technological documents, but their interpretability depends on how patents are used in the citing text. This study examines citation contexts and paper-level outcome associations in AI-related articles in PubMed Central (PMC). Screening 189,073 articles identified 746 with explicitly tagged patent references (0.395%), including 713 with 1,544 identifiable in-text patent-citation instances. Three large language models classified these instances by represented content, motivation, textual position, and evaluative stance. Regression models examined associations among these dimensions, and propensity-score-matched regressions compared patent-citing papers with XML-screened controls. Background-oriented citations were predominantly neutral and introductory, whereas adoption-oriented citations were more closely associated with methodological positions and supportive evaluations. These patterns suggest heuristic configurations of contextualization, operationalization, and problematization, although classification overlap and exclusion of rare categories limit their interpretation. In matched samples, the patent-citing indicator was associated with lower scholarly-citation measures and more citations received from patents. These associations are observational, not causal. Together, these findings show that paper-to-patent citations encode heterogeneous forms of engagement with patented technology and should be interpreted as selective bibliographic signals rather than direct indicators of technology-to-science knowledge transfer or research value.

0.23