CS Paper Radar

FutureLens: Longitudinal Topic Patterns in Scholarly Text and Future-Work References

Ibrahim Al Azher, Hamed Alhoori

cs.DL cs.AIcs.IR ·submitted 2026-10-09 09:50 UTC · v1

Abstract

Future-work statements offer a record of the questions researchers choose to leave open. Using them to describe a field, however, requires separating thematic change from changes in document coverage, topic assignment, and scholarly writing. FutureLens examines these measurement issues in a recovered snapshot of 5,655 ACL papers published during 2012--2022, including 4,005 with supplied future-work reference text. We compare non-negative matrix factorization (NMF) and latent Dirichlet allocation (LDA), aggregate topic presence at the paper level, and examine normalized prevalence, exploratory trend statistics, assignment stability, and agreement between input-derived text and references. Across available seeds, NMF has higher mean normalized pointwise mutual information (0.1387 versus 0.1280) and higher pairwise assignment stability, while LDA has greater keyword diversity (0.8900 versus 0.7750). Seed-zero results show increasing prevalence of broad model-training and question-related vocabulary, alongside substantial citation and document-structure content. Mean input/reference topic-set overlap is 0.5191 for NMF and 0.4924 for LDA; temporal rank agreement varies widely and does not imply agreement in prevalence levels. These findings support a descriptive account of the available corpus, with explicit qualifications for missing references, incomplete runs, and unverified reference provenance. The contribution is an empirical measurement study of longitudinal scholarly signals, not a new topic-modeling algorithm or a forecasting system.

Comment
10 pages, Accepted at AI4SciSci 2026 (3rd International Workshop on Artificial Intelligence for the Science of Science), co-located with ACM/IEEE-CS JCDL 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Mapping the Afterlife of Future Work Statements in NLP Research

cs.CL ·2026-11-13 ·Claudiu Creanga, Ioana-Roxana Boriceanu, Ana Sabina Uban, Liviu P Dinu
dataset similarity 0.69
Abstract

Future work statements are one of the few places in scientific papers where authors explicitly describe what they think should happen next. We study what happens to such statements after publication. We construct a dataset of 72,070 future work items extracted from 23,113 ACL Anthology papers published between 1979 and 2025, categorize them by type, retrieve candidate follow-up papers through citation-based and content-based search, and use LLM-based judgments to assess whether later papers pursue the proposed directions. Using this resource, we analyze patterns across time, venues, categories, themes, and authors. We find that many items are later addressed, often within a few years, with clear differences across types and themes and a largely community-driven pattern. Our results suggest that future work statements provide useful evidence for studying how research directions develop in NLP. To support further research, we release our dataset at: https://doi.org/10.5281/zenodo.20385239.

0.22

KnowMe Paper Radar: Lightweight Discovery of Promising Papers in the Age of Autoresearch

cs.AI cs.IR ·2026-11-18 ·Zhuo Chen, Jian Wang, Jinjie Gu, Lijun Wu
code/data similarity 0.63
Abstract · Ongoing work. 67 pages with 34 figures and 37 tables. Project website: https://hackerchenzhuo.github.io/knowme-research-ai/en/ GitHub: https…

The growing volume of topically similar papers makes it difficult to identify new work that can offer useful research insights or methodological guidance. We present KnowMe Paper Radar, a lightweight discovery tool that combines multiple sources of evidence into personalized reading priorities. Users specify topics, priorities, exclusions and dates; the system brings together topical relevance, recency, author research histories, collaboration paths and direction-specific institutional context. By exposing each score component and its supporting sources, KnowMe helps readers select promising papers for their current questions and discover relevant work beyond familiar authors. Automatic acquisition, version merging and graph-cache reuse keep this workflow convenient without large language model (LLM) inference during ordinary use. Experiments on 174,640 acquired records show more than threefold faster repeated context preparation, while cached abstracts improve normalized discounted cumulative gain at rank 10 (NDCG@10) from 0.412 to 0.598 on expert-judged retrieval tasks. Complementary analyses examine how the same accumulated records support semantic retrieval, research-history modeling and literature-grounded planning. A browser interface and a structured command-line interface (CLI) make these capabilities available to both researchers and research agents, positioning KnowMe as a practical upstream tool for literature-informed recursive self-improvement (RSI) workflows.

0.41

The conservative turn in science: The changing character of knowledge recombination

cs.SI cs.DL ·2026-09-08 ·Cheng Zhang, Xinkun Liang, Yi Bu, Hongkan Chen
similarity 0.58
Abstract

This study examines how the dominant mode of cross-disciplinary knowledge combination has changed over time. It addresses a limitation of existing studies that document declining disruptiveness at the level of individual works but do not reveal whether the mechanisms of cross-disciplinary knowledge flow have themselves shifted. Drawing on 56 million publications and 816 million citations from OpenAlex (1960-2025), the study classifies cross-disciplinary citations into five types based on the set relationship between the subfield portfolios of citing and cited publications and introduces a semantic-distance measure derived from SPECTER-v2 embeddings of publication abstracts. It subsequently demonstrates that cross-disciplinary citations have shifted markedly away from configurations with no shared disciplinary ground toward types built on partially overlapping knowledge bases, a reorientation further reflected in a steady decline in average semantic distance between citing and cited fields. This shift co-occurs with a diffusion of brokerage positions across the network and a greater reliance on older literature, consistent with a system that has become broader and more decentralized in its interdisciplinary reach. Finally, this study discusses the implications of these findings for science policy and for the design of cross-disciplinary funding mechanisms.

0.08

In-Context Learning Before Specialisation: Theory of Learning in a Solvable Topic Model

cs.LG cs.AIstat.ML ·2026-10-15 ·Francesco Cagnetta, Casper L. Christensen
similarity 0.58
Abstract

Sequence models can generalise in fundamentally distinct ways: extrapolating structures seen in training, or using their prompt to adapt to novel tasks. The prevailing strategy determines how the model behaves beyond its training distribution, controlling potential capabilities and risks. Recent work has characterised many different strategies theoretically, and empirically described the transition between them as the quality and quantity of pretraining data vary. However, there is no learning theory for this competition, hence no fundamental understanding of \textit{why} one solution might be favoured over another. Here we provide such a theory in a solvable topic model---documents drawn from a finite mixture of latent topics, mirroring the heterogeneity of modern pretraining data. The dataset comes with two distinct solutions: a specialised predictor, that stores the finite topic mixture, and an in-context one, optimal for topics never seen during training. Our theory predicts their emergence at distinct sample complexities: the in-context predictor is available early, while the specialised one emerges only after the training tokens outnumber the parameters of the data-generating process. Trained transformers reproduce both scales and the separating crossover in remarkable agreement with the theory, with no fitted parameters.

0.20

Citations Are Late: Reading epistemic instability from what papers believe, years before the citation graph catches up

cs.DL ·2026-10-05 ·Andrey Ustyuzhanin, Ekaterina Trofimova, Denis Zuenko
hot direction similarity 0.57
Abstract

Paradigm shifts in science are visible in what researchers assert and contest before they are visible in the citation graph. We ask whether a cheap, content-level signal of epistemic instability, derived from the changing distribution of stated modelling beliefs in paper abstracts, can anticipate a paradigm shift earlier than the dominant citation-based disruption index (CD5). On the displacement of recurrent networks by Transformers in NLP, a pre-registered content signal crosses its detection threshold in 2016-Q1, whereas a real-time CD5 monitor cannot even observe the 2017 breakthrough until 2022-Q2, since CD5 needs a five-year forward-citation window: a lead of about 25 quarters. The flat citation baseline is not an artifact of one index, as our CD5, a reference-normalised variant, and an authoritative precomputed index all sit near zero across the shift. The lead is also not a faster proxy: at equal latency the signal beats the content competitors tested, including a learned CD-from-text model and an embedding disruption measure, and the decomposition sees what a keyword cannot (keyword-blind AUC of about 0.9, reproduced on human labels). The lead over CD5 is an observability lead. Which signal carries it depends on the shift: belief adoption in NLP, contestation and applicability stress in vision. Measured against the breakthroughs themselves, the signal leads by five quarters in NLP and is contemporaneous in computer vision.

0.28

InsightRAG: Aggregating Distributed Scholarly Judgments for Scientific Survey Generation

cs.AI cs.DL ·2026-10-20 ·Yuquan Lin, Wenshuo Zhang, Yilin Ye, Shuchang Xu, Zhao Chen +2 more
similarity 0.57
Abstract

The rapid growth of scientific literature makes survey writing increasingly challenging, motivating automatic survey generation. Yet, existing systems must search an open space of papers and an open space of concepts with no trace of how the community itself has navigated them, leading to incomplete scope, weak taxonomies, and unreliable citations. Our core insight is that author-written Related Work sections contain the human judgments needed to address both limitations: authors curate the citations relevant to their contributions and explain how the cited works relate, yielding paths for scope reconstruction and relational evidence for organization. We propose InsightRAG. Its insight-guided retrieval follows author-supported citation relations to reconstruct a verified research scope and structure the resulting relational evidence. It aggregates these judgments under a minimum-conflict objective into a taxonomy that reflects recurring author-written perspectives in the retrieved literature, guides generation, and bounds each section's evidence. Results on ten topics show gains in scope reconstruction, taxonomy quality, citation support, and reference reliability.

0.21

Do Network Mechanisms in Science Vary Across Research Topics? Contextual Relational Hyperevent Models for Large-Scale Bibliometric Data

cs.DL cs.SIstat.ME ·2026-11-19 ·Jürgen Lerner, Mark Wittek, Raphael Heiberger
similarity 0.57
Abstract

Collaboration and citation networks in science are shaped by well-documented mechanisms such as preferential attachment, gender homophily, and self-citation. Whether these mechanisms operate uniformly across research areas, however, is rarely tested, because statistical network models that estimate several mechanisms jointly are difficult to apply to large bibliometric data and to compare across subnetworks. We introduce contextual relational hyperevent models (C-RHEMs), which extend relational hyperevent models by allowing network effects to vary across research topics within a single model. C-RHEMs treat each publication as one event linking its authors to its references, accommodate reference lists spanning several topics, and scale to hundreds of thousands of publications on standard hardware. In a second step, meta-analysis and meta-regression quantify heterogeneity in topic-specific effects and relate it to topic characteristics. We illustrate the approach with about 590,000 oncology publications from the PubMed Knowledge Graph, assigned to 32 OpenAlex research topics. We find that preferential attachment, gender homophily, and self-citation vary substantially across topics, with between-topic standard deviations of 30 to 70 percent of the corresponding pooled effects. Topic age, size, and gender composition account for between a third and two-thirds of this variation: older topics exhibit stronger preferential attachment, self-citation, and gender homophily, and topics with a higher share of male authors exhibit stronger self-citation. The results caution against treating network mechanisms estimated on pooled data as uniform, and C-RHEMs offer a scalable way to study how they differ across research areas.

0.23

Tracing the Influence of Retrieved Literature on Scientific Ideation in LLMs

cs.CL ·2026-10-28 ·Zhipin Wang, Koel Dutta Chowdhury, Christoph Leiter, Steffen Eger
similarity 0.56
Abstract · Updated preprint. Under review

Large language models (LLMs) are increasingly used to generate research ideas from scientific literature. Existing systems combine literature retrieval with search, generation, and refinement, making it difficult to determine how the retrieval strategy itself shapes the ideas generated. We isolate this contribution by comparing five retrieval strategies and a No Literature baseline under a shared generation protocol, using 45,000 ideas across 15 machine learning topics and ten open-weight models. Relative to no literature basline, all five retrieval strategies reduce diversity among ideas generated from the same set of papers by $5.6\%$--$17.9\%$, while most increase diversity by $10.2\%$--$18.1\%$ when ideas from different sets are pooled. Effects on idea quality and novelty are modest on average but vary across topics. We further apply a JSD-based attribution method to trace the influence of individual input papers on each idea's motivation, core idea, approach, and validation. In $79.3\%$ of ideas, only one or two distinct papers receive the highest attribution scores across these four parts. These leading sources often recur across ideas generated from the same set of papers, and groups with more varied source attribution contain more diverse ideas ($r=0.70$). These findings motivate various sets of literature and the use of attribution to guide the choice of sources for subsequent ideas.

0.14