CS Paper Radar

The AI research space shapes country academic performance

Siyi Zhou, Tianxing Pan, Qing Ke

cs.SI physics.soc-ph ·submitted 2026-11-08 22:41 UTC · v1

Abstract

Recent advances in Artificial Intelligence (AI) have demonstrated great potential across diverse domains, prompting increasing attention to understanding the AI ecosystem. As knowledge production is often perceived as a process of connecting existing pieces of knowledge, mapping the interconnections of AI knowledge is crucial for unraveling the dynamics of scientific production in AI. However, maps created so far have fallen short of capturing knowledge relatedness, focusing instead on citation relationships between subfields. Here, we build an AI research space by connecting pairs of AI research topics based on their proximity measured through author-topic coupling. Projections of country level performances onto the space reveal that countries exhibit distinct baskets of specializations. We further examine the role of the structure of the AI research space in the scientific development of nations. We find that countries are more likely to gain specialization in topics that have high proximity to already specialized neighbor topics, and that publications whose topics align more with the developed topics in the country are more likely to become high impact. Our results highlight the AI development gaps across nations and the path-dependence in the development induced by the AI research space.

Closest papers

Nearest neighbours by meaning across the whole index.

Scientist World: Grow a Research World for AI-Scientists

cs.AI cs.CLcs.LG ·2026-11-05 ·Taiming Lu, Sachin Konan, Zhuang Liu
similarity 0.69
Abstract

AI-Scientists arrived, but a world for them to grow in did not. Human scientists take theirs for granted $-$ centuries of open problems and shared ideas, waiting in the scientific literature. To AI-Scientists, that world is readable but not runnable, so we build Scientist World for them: every research paper becomes an executable environment. Our autonomous pipeline extracts each paper's open-ended research question and reproduces its proposed method as the baseline; an AI-Scientist entering the environment is evaluated against what the human authors achieved. We release the first 1,000 verified environments. With the world as an evaluation, we found that frontier AI-Scientists can already surpass the human researchers 74% of the time. As a record of how AI does science, it contains 6,400 hours of research traces, with every idea, experiment, failure, and success. As a training ground, we are able to raise (+158%) a small model to match frontier models in research ideation. At last, AI-Scientists' own world has arrived, grown from and growing with science itself.

0.10

IdeaTaste: Do LLMs Share the Research Taste of Human Researchers?

cs.CL ·2026-11-02 ·Shanshan Zhong, Chen Xu, Jingjie Ning, Zhengzhong Liu, Aviral Kumar +1 more
benchmarkcommunity pick similarity 0.65
Abstract

Research taste, the judgment of what to read, which problems to pursue, and which methods to try, increasingly shapes the work of AI scientists, yet it remains far less understood than their ability to execute research. We introduce IdeaTaste, a benchmark that scores an LLM by how closely the research proposals it writes from a literature snapshot frozen at 2025 match the work the same communities published in 2026. Our experiments span six contemporary language models and four research areas from established to emerging fields, covering more than 90{,}000 proposals in total. LLM agents fall well short of human communities in both the literature they cite and the ideas they state, reaching about 26\% of the human level on citation matching and only 18\% on idea matching. Their populations can cite as diversely as a community and take up its tasks and methods, yet rarely arrive at the concrete approaches and research plans it pursues. Neither richer field context nor larger populations substantially close this gap. In blinded expert review, AI proposals trail the 2026 papers least in presentation and most in expected success, echoing their gap in concrete approaches, and those whose ideas no human paper shares fare worst, suggesting weaker directions rather than overlooked opportunities. These results indicate that the main bottleneck in AI research taste lies less in finding the directions a community works on than in turning them into the concrete approaches it goes on to pursue. We release IdeaTaste as an open, continuously updated leaderboard (https://cxcscmu.github.io/IdeaTaste) that benchmarks contemporary AI proposals against future publication cycles.

0.28

Embedding or bridging? AI4Science teams differ more in knowledge recombination than in problem novelty

cs.CE cs.DL ·2026-11-17 ·Yun Fu, Jielan Ding
similarity 0.64
Abstract · 21 pages, 8 figures, 43 references

AI for Science (AI4Science) is reshaping scientific research, yet how the organization of AI-related and domain-scientific work relates to different dimensions of research performance remains poorly understood. We analyze 489,409 AI4Science articles published between 1990 and 2025, identifying seven affiliation-based organizational configurations comprising three forms of embedding and four forms of cross-unit bridging. Focusing on 2006-2025, we examine two dimensions of research performance: knowledge creation, characterized by scientific problem novelty and knowledge-recombination breadth, and research impact, assessed through journal placement and citation impact. We find that organizational configurations differ only modestly in problem novelty but substantially in knowledge-recombination breadth. Cross-unit bridging is consistently associated with broader knowledge recombination, particularly in AI-oriented bridging, without a corresponding advantage in problem novelty. However, greater recombination breadth does not necessarily align with stronger research impact. Science-oriented and Multi-orientation bridging exhibit the most consistent positive associations with JCI Q1 journal placement and citation impact, although neither shows a statistically significant adjusted advantage in publication in the Elite-4 journals (Nature, Science, Cell, and PNAS). These research-impact differences remain largely intact after accounting for problem novelty and recombination breadth. Our findings reveal that organizational configurations are associated with distinct patterns of knowledge creation and research impact, rather than a single hierarchy of research performance. The results highlight the importance of considering organizational arrangements in relation to specific scientific objectives, rather than assuming that any one configuration is universally superior.

0.23

Tree-of-Ideas: Automated Research Ideation via Cross-Trajectory Reasoning over Scholarly Evolution

cs.AI ·2026-08-11 ·Xun Li, Yiying Yang, Pengtao Li, Xiao Yao, Suyu Liu +6 more
similarity 0.64
Abstract

Effective research ideation requires moving beyond a static understanding of prior work to trace how research problems and solutions evolve across the literature. Existing methods either treat papers as unstructured context or model scholarly evolution as isolated citation chains, overlooking interactions among research trajectories. We propose Tree-of-Ideas (ToI), a two-stage framework. EvoTrace reconstructs branching scholarly trajectories from citations, tracking evolving methods, resolved problems, and gaps. EvoAgent then reasons across trajectories to identify convergent problems and complementary solutions, generating grounded research ideas. Across six AI research topics, ToI achieves the highest score among automatic methods (6.27 vs. 5.36 for the strongest baseline on a 10-point scale), with strong Novelty (6.36) and Groundedness (7.00). Also, its score approaches that of human-paper references (6.29), demonstrating the value of cross-path evolutionary reasoning.

0.34

Has Scientific Talent Shifted from Depth to Breadth?Evidence across Papers, Knowledge Inputs, Careers, and Teams

cs.DL cs.AIcs.HC ·2026-09-13 ·Xiaoshn Nee, Haobo Zhong, Xiaomin Ni
similarity 0.64
Abstract

Generative artificial intelligence raises a central question for scientific training and organization. Is research shifting from deep specialization toward broad individual knowledge? We examine this proposition across papers, cited knowledge, contributor histories, and teams using 47,959 articles from six fields over 2010-2025, 51,736 resolved cited works, and chronologically reconstructed prior publication histories for 1,754 randomly selected index contributors. From 2010 to 2022, team size increased by an estimated 37.3% (95% confidence interval [34.4%, 40.3%]), while paper topic breadth declined by 0.0144 on a 0-1 hierarchical distance scale. Cited knowledge was stable to modestly broader, revealing a divergence between focused outputs and the reach of knowledge inputs. Established contributors' prior breadth increased by 0.0190 [-0.0078, 0.0459] by 2019-2022, within a +/-0.05 equivalence bound assessed in sensitivity analysis. In mature citation windows, one standard deviation of focal depth was associated with 8.2% higher 1 + FWCI [1.9%, 14.9%]; average breadth and interaction associations were smaller under the specified equivalence bounds. Post-2022 deviations from earlier trends were not systematic, and recent changes did not vary clearly with baseline AI intensity across 83 subfields. The findings support a differentiated structure of scientific expertise in which focused individual accumulation coexists with expanding collaboration and sustained access to diverse knowledge inputs.

0.27

Can AI be a 'Researcher Without Borders'? Auditing Bias in AI-Assisted Social Science Research about China and the US

cs.CY ·2026-11-10 ·Yuan Zhang, Thales Bertaglia, Ralph Schroeder
benchmark similarity 0.62
Abstract

Although large language models have demonstrated strong performance on algorithmic and mathematical tasks, their suitability as social science research assistants remains unclear, particularly because many social science questions lack agreed-upon, quantifiable benchmark answers. Evaluating this suitability is important since researchers and students increasingly rely on AI to generate research ideas. When questions concern the countries in which models were developed, bias may be exacerbated: Do AI models favour the countries where they were developed or the social theories associated with those countries' scholarly traditions? Such biases could distort research findings, undermine scientific credibility, and distort findings when they are disseminated to the public. To investigate whether models exhibit country-focused bias in social science research, we designed a benchmarking task requiring AI to write short essays on social science questions in relation to the US and China as well as some broader social science questions. We varied three conditions: question type (cross-country comparisons, country-specific questions, and general questions); model (two US-developed, two China-developed, and one Europe-developed model); and prompting modality (a base essay-writing request, a researcher identity, a US researcher identity, and a Chinese researcher identity). Responses were manually annotated for bias and source use by two researchers with experience in social science in relation to China and the US. Our analyses show that, on the whole, US and Chinese models and the European one are not politically biased but differ in the sources they cite. Still, some comparative questions favour one country over another, and this tendency is more pronounced for certain questions. These findings suggest that researchers and students should exercise caution when using AI for social science research.

0.35

Are We Just Applying LLMs? What SE Research Studies, Underexplores, and Could Do Next in the LLM Era

cs.SE ·2026-11-03 ·Zeinadsadat Saghi, Sadra Sabouri, Souti Chattopadhyay
similarity 0.61
Abstract

Is AI taking over software engineering research? By 2025, AI appeared in more than half of the research-track papers at ICSE, FSE, and ASE. Yet ubiquity alone cannot show whether AI expanded the publication portfolio, displaced other work, or redirected the intellectual agenda. We investigate this shift through a census of 4,790 research papers (three SE conferences; 2018--2026) and free-form responses from 244 SE researchers discussing the future of the SE research community (ICSE 2026 FoSE survey). We found that while AI is taking over, it is not simply replacing non-AI research; it is unevenly reorganizing SE research around its capabilities. AI accounted for 93.1% of publication growth, but expansion in some venues and problem areas concealed contraction in others. The LLM wave also changed the field's tools more than its problem boundaries: 92.6% of LLM-wave AI papers revisit established SE problems, while most new problems arise from the introduction of LLMs in the SE process themselves. Engagement with AI remains predominantly downstream: 95.7% of AI papers apply AI or evaluate and support its use, while only 4.3% interrogate the paradigm or develop alternatives. The FoSE survey reveals a similar imbalance between recognition and response. AI-driven change was the second-most frequent concern about the field's future 20.2%, yet only 7.0% of responses mentioned AI when researchers were asked to identify one change the community should make. Together, our findings reveal a field reorganizing an inherited agenda around AI faster than it is questioning that reorganization. We discuss how SE can respond by building cumulatively across technological waves, strengthening evaluation and assurance, developing SE-native foundations, and studying software engineering in an AI-transformed world.

0.32

Large Language Models Extend Known Research But Do Not Create New Research Directions

cs.AI ·2026-10-12 ·Zhihua Liu, Kurt Butler, Damian Machlanski, Danilo Bueno, Sotirios A. Tsaftaris
similarity 0.61
Abstract

The success of autonomous research systems relies on the quality of the scientific hypotheses they generate. Recent studies report that human reviewers often rate LLM-generated ideas as more novel than those from human experts, raising hope that AI can accelerate scientific discovery. Yet it is unclear whether these models can do more than extend existing knowledge. Can LLMs drive genuine innovation by revealing new research directions, or are they limited to repeating and recombining what science already knows? This unresolved question lies at the heart of discussions about AI and the future of science. To address this, we distinguish two types of novelty: distance, which measures how far a hypothesis lies from existing work, and direction, which captures whether the hypothesis pursues new lines of inquiry beyond those already present. These two measures diverge sharply for LLM-generated work. We represent scientific papers in a shared conceptual space using a pretrained scientific-paper embedding model. Within this space, we embed 26.9 million human-authored papers across 1,325 research topics in six natural-science fields and 524,308 LLM-generated hypotheses from eight models. Distance is measured using existing metrics. To quantify direction, we introduce the orthogonal novelty score (ONS). LLMs consistently generate ideas more distant from existing work than human-authored papers, up to 16\% further when the LLM is given the papers farthest from the centre of the topic. However, LLM hypotheses have a 15--23\% lower median ONS than published papers from the same topic. Thus, LLMs move further from what is already known, but remain within established directions. This pattern persists across changes in various configurations. As a result, LLMs excel at extending the frontier but the creation of new directions is still led by human scientists.

0.29