CS Paper Radar

Life after delisting: tracking the publication output and citation impact of Scopus-discontinued journals with OpenAlex

Álvaro Cabezas-Clavijo, Fernando Sánchez-Pita

cs.DL ·submitted 2026-10-08 10:57 UTC · v1

Abstract

Selective databases such as Scopus periodically re-evaluate the titles they index and remove those that no longer meet their quality criteria. Once a journal is removed, its subsequent output is no longer recorded, and the consequences of this process have therefore received little attention. This study analyzes the publication output and citation impact of 514 sources delisted from Scopus between 2018 and 2024, based on 678,162 documents retrieved from OpenAlex over a window of three years before and after delisting. Differences between periods are tested with the Wilcoxon signed-rank test for paired samples, globally and by geographic region, field of knowledge and SJR quartile. Output grows until the year of delisting and falls sharply afterwards. The median annual output per journal drops from 35 to 22 documents (-37.1%; p < 0.001; r = 0.30), 61.7% of journals publish less, and 84 (16.3%) have no documents recorded in OpenAlex after delisting. Citations per document, measured over a three-year window, barely change when each journal is compared with itself (-2.4%; p = 0.079), and journals are almost evenly split between those whose impact falls and those whose impact holds steady or rises. The results indicate that delisting makes these journals less attractive as publication venues but does not penalize the citation of the work they publish to the same extent, which raises concerns from a research integrity perspective.

Closest papers

Nearest neighbours by meaning across the whole index.

Assessing the Reliability of Longitudinal Bibliometric Rankings under Incomplete Citation Histories

cs.DL ·2026-11-12 ·João Paulo Papa
similarity 0.66
Abstract · 20 pages, 2 figures. Software available at https://doi.org/10.5281/zenodo.24170285

Longitudinal bibliometric analyses rely on annual citation histories, yet missing annual observations are frequently difficult to distinguish from true zero-citation years. We present a reproducible case-study framework for auditing citation-history gaps, tracing retrieval provenance, and quantifying the sensitivity of longitudinal indicators and rankings to explicit missing-data assumptions. The case study comprises 595 consolidated publications derived from 616 Google Scholar article records, and examines the completed calendar years 2024-2025. Three scenarios are compared: strictly observed annual counts (A), hypothetical zeros for internal gaps only (B), and hypothetical zeros for all missing years within a valid publication interval (C). The number of publications with computable growth and acceleration indicators increases from 196 (A) to 257 (B) and 490 (C); the corresponding counts for a revival indicator are 131, 152, and 177. Although the ordering of publications eligible under both compared scenarios is unchanged (Spearman and Kendall correlations equal to 1.0), complete-ranking positions and Top-K membership may change markedly. In particular, acceleration exhibits a Jaccard overlap of 0.563 at K=50 between A and C, while revival exhibits 0.667 at K=10. These findings demonstrate that unchanged indicator values and perfect correlations on a common subset do not guarantee stable rankings when eligibility changes. The zero assignments are hypothetical sensitivity assumptions, not evidence of provider semantics. The results are descriptive and based on a single researcher profile. A reusable Google Scholar Tracker software workflow supports the audit and sensitivity analysis; version 1.8.5 is publicly available on GitHub and archived on Zenodo (DOI: 10.5281/zenodo.24170285).

0.49

Can open citation data detect citation stacking? An audit against Clarivate's journal suppressions

cs.SI ·2026-11-07 ·Hossein Mohasel Arjomandi
code/data similarity 0.57
Abstract · 18 pages, 7 figures, 2 tables. Submitted to Scientometrics. Data and code: https://github.com/HosseinMA96/citation-stacking-open-data

Clarivate suppresses journals from the Journal Citation Reports when self-citations or concentrated citations from another journal ("citation stacking") distort their Journal Impact Factor. Its data are closed. Yearly journal citation networks were built from the OpenCitations snapshot of January 2024 (1.96 billion citations; 85,437 journals) and compared with Clarivate's suppression lists for data years 2015-2023, collected from primary sources. Where reference lists are present, open data reproduce Clarivate's published self-citation shares within ten points for 36 of 50 journals. The failures follow publishers that do not deposit references with Crossref, which also hides several stacking donors. Biodiversity data downloads registered with DataCite inflate naive impact-factor numerators of taxonomy journals. The leading open method, CIDRE, detects none of 15 named Clarivate pairs: it drops large donor journals, and lowering its donor threshold merges the pairs into large groups. A recipient-centric reading of CIDRE's own test flags stacking-listed journals 6 to 14 times more often than other journals, depending on consensus level, and 5 to 7 times more often than size-matched controls, sometimes years before the listing. At equal flag rate it finds more listed journals than a plain 43% donor-share rule (10 vs 3 of 28), and about as many as a rule with a citation floor. A prospective check on the 2024-2025 lists agrees in direction but is not significant (one of six). Flagged pairs show more citations per citing paper and weaker topical similarity than matched pairs. Open audits are feasible if coverage gaps are reported.

0.39

Do links to retracted papers predict future retractions? An out-of-sample test on the open biomedical citation graph

cs.SI ·2026-11-07 ·Hossein Mohasel Arjomandi
code/data similarity 0.56
Abstract · 16 pages, 3 figures, 2 tables. Data: doi:10.5281/zenodo.23874477. Code: https://github.com/HosseinMA96/retracted-neighbours-open-data

Tools that screen manuscripts for research-integrity problems flag papers that cite retracted work, and retrospective studies report that such papers are retracted more often. This study tests the signal prospectively on open data. Predictors were computed on the January 2024 OpenCitations graph using the retractions known at that date, frozen, and compared with retractions in the Retraction Watch database from February 2024 to October 2026. The design was pre-specified. Among 10.5 million biomedical papers published 2015-2023, 2.1% cited a paper already retracted, and 4,323 were retracted later (0.041%). Citing a retracted paper raised the later retraction rate from 0.035% to 0.27% with one such reference; excluding reviews (post hoc), it rose to 2.3% with five or more. Within journal and publication year the odds ratio was 2.99 (95% CI 2.73-3.27), and 3.03 when reference-list length was also held fixed (post hoc), so the signal is not explained by retraction waves in journals or by long reference lists. As a screen it is weak: 0.9% of the 1,000 highest-ranked papers were retracted later (2.2% with reviews set aside, post hoc), and 84% of later retractions cite no retracted paper. When the time point was moved into the late-2023 retraction wave, the journal's own retraction rate became the far better screen. NIH-funded papers cited already-retracted work as often as other papers in the same journal and year. Links to retracted papers are a useful flag but not a screen on their own.

0.42

A Graph Approach to the Academic Publishing Network: A Heterogeneous Model and Structural Screening over OpenAlex Open Data

cs.SI cs.DLstat.AP ·2026-08-11 ·Robert Šamárek, Radek Martinek
code/data similarity 0.52
Abstract

The academic publishing ecosystem is a vast, heterogeneous network of works, authors, institutions, journals, and topics. Traditional scientometrics reduces it to isolated tabular indicators (h-index, Impact Factor) that ignore topological context and are not designed to capture coordinated illegitimate practices. Building on our companion review, which proposed graph analysis of publishing integrity, this paper implements that approach. We define a heterogeneous multivariate graph model over OpenAlex open data (seven node types, seven edge types) and a methodology based on projections (citation and co-authorship networks), interpretable structural metrics, community detection, and three screening detectors of anomalous publishing patterns. We deliberately avoid binary classification: detectors return ranked candidates with explicit structural evidence for human assessment. On the institutional corpus of VSB - Technical University of Ostrava (2020-2025) with its one-hop citation neighbourhood, community detection recovers real research groups, centralities identify cross-disciplinary bridges, and the screenings flag dense co-authorship cliques, locally closed citation loops, and thematically isolated venues. On a second, venue-centric corpus with external ground truth (journals delisted by Scopus and DOAJ) and size-matched controls, a naive case-control design yields seemingly strong but spurious detectors (a prominence confound), whereas after matching the only robust signal is the breadth of disciplinary scope (AUC 0.70); an open graph-based prestige measure (PageRank over the journal citation network) tracks a JIF proxy while being an order of magnitude more resistant to citation gaming than count-based indicators. We release the method as the open-source library apnet with a reproducible CLI workflow and a web interface; the analysis runs on commodity hardware in minutes.

0.20

Citations Are Late: Reading epistemic instability from what papers believe, years before the citation graph catches up

cs.DL ·2026-10-05 ·Andrey Ustyuzhanin, Ekaterina Trofimova, Denis Zuenko
hot direction similarity 0.51
Abstract

Paradigm shifts in science are visible in what researchers assert and contest before they are visible in the citation graph. We ask whether a cheap, content-level signal of epistemic instability, derived from the changing distribution of stated modelling beliefs in paper abstracts, can anticipate a paradigm shift earlier than the dominant citation-based disruption index (CD5). On the displacement of recurrent networks by Transformers in NLP, a pre-registered content signal crosses its detection threshold in 2016-Q1, whereas a real-time CD5 monitor cannot even observe the 2017 breakthrough until 2022-Q2, since CD5 needs a five-year forward-citation window: a lead of about 25 quarters. The flat citation baseline is not an artifact of one index, as our CD5, a reference-normalised variant, and an authoritative precomputed index all sit near zero across the shift. The lead is also not a faster proxy: at equal latency the signal beats the content competitors tested, including a learned CD-from-text model and an embedding disruption measure, and the decomposition sees what a keyword cannot (keyword-blind AUC of about 0.9, reproduced on human labels). The lead over CD5 is an observability lead. Which signal carries it depends on the shift: belief adoption in NLP, contestation and applicability stress in vision. Measured against the breakthroughs themselves, the signal leads by five quarters in NLP and is contemporaneous in computer vision.

0.28

Mentorship resources and citation-elite journal publication trajectories after training: Evidence from bioscience mentor-mentee networks

cs.DL cs.SI ·2026-09-11 ·Hao Zeng, Yi Bu, Qingshan Zhou, Hongkan Chen
similarity 0.51
Abstract

Mentorship provides mentees with knowledge, collaborators, and reputation, but when do these resources support scholarship beyond training? Using 239,931 bioscience mentor-mentee pairs from the Academic Family Tree (1800-2020) linked to OpenAlex metadata, we examine this question through mentees' publication in citation-elite journals, identified by three source-level citation indicators. We distinguish training-period mentor and peer resources from post-graduation topic and coauthorship network continuity. Analyses combine trajectory comparisons, three propensity-score matching designs, PPML, two-part model and non-overlapping landmarks relating continuity in post-graduation years 1-3 to publication outcomes in years 4-10 and 6-20. Citation-elite journal publishing during mentorship is positively associated with later publishing, but correlates differ by career stage. Close mentor collaboration and larger peer group size characterize training-period publishing, whereas both are negatively associated with post-graduation publication probability and intensity. Early topic and network continuity are positively associated with later output in landmark analyses; across extended conventional windows, topic continuity becomes less favorable, consistent with later agenda broadening. Network continuity shows the most stable positive association with publication intensity. The findings suggest a stage-dependent resource-conversion process: training resources may facilitate entry into citation-elite journal publishing, whereas sustained output is associated with how intellectual and relational ties are retained or reconfigured.

0.22

Behind the Paper Explosion: Author Growth and Widening Gaps in Computer Science

cs.DL cs.CY ·2026-10-29 ·Jiayi Li, Bowen Niu, Bingsheng He, Zhaomin Wu
similarity 0.50
Abstract · 12 pages, 9 figures

The rapid growth of computer science (CS) papers increases the work needed to review research and find relevant studies. The growing use of AI tools in scientific writing makes it increasingly important to identify the authors behind this growth. Previous studies have tracked publication growth and followed researchers' careers, documenting the increasing number of authors and the many researchers who publish only briefly. However, annual averages of papers per author reflect different sets of researchers and may hide changes among the same authors. This study addresses this gap by linking individual changes to overall CS paper growth using arXiv, DBLP, and conference submission records for 2010-2025. With each paper divided equally among its authors, the total paper count equals the number of authors multiplied by their average papers per author. This relationship provides a decomposition of the two contributions of paper growth. This decomposition attributes nearly all growth in CS paper volume to an increase in the number of publishing authors. The analysis of author numbers further distinguishes expansion through new and returning arXiv authors from the replacement of authors no longer publishing there. Changes in who publishes also affect the average, motivating comparisons of the same authors over time within groups with similar past paper counts. This comparison identifies substantial replacement within the growing author group. New authors average fewer papers under this counting method, keeping the overall average nearly unchanged despite increases among authors who published in both years. Moreover, statistics show that these increases are uneven, with widening gaps even among authors who previously published similar numbers of papers. These findings provide insights into peer review, community participation, researcher evaluation, and equity within the CS community.

0.33

Large scientific teams are more, not less, disruptive

cs.DL physics.soc-ph ·2026-10-05 ·Junming Huang, Yu Xie
similarity 0.48
Abstract · 34 pages, 14 figures

Modern science has moved decisively toward larger and more collaborative research teams. Yet an influential 2019 study reported that small teams are more disruptive than large teams, a conclusion difficult to reconcile with both the well-known trend toward increasing collaboration and the disproportionately large teams behind widely recognized disruptive research, such as work that has been awarded Nobel Prizes. Here we show that the reported disruptive advantage of small teams is largely an artifact of measurement rather than a fact about teams. Analyzing about 60 million scientific publications, we find that larger teams cite more references and that the standard disruption index declines mechanically as reference lists lengthen. Equalizing reference-count distributions across team sizes reverses the negative gradient within the index's own framework. Evaluating each paper against one reference at a time yields a reference-robust measure that distinguishes recognized breakthroughs from ordinary papers more sharply and more consistently than the standard disruption index across six independently curated benchmarks, including the Nobel Prize. Under this validated measurement, scientific disruption increases with team size across four scientific domains and in every decade from the 1970s to the 2010s. For scientific publications, we conclude that larger teams are more, not less, disruptive.

0.43