CS Paper Radar

Theses by publication in Spain: output, authorship and integrity concerns

Álvaro Cabezas-Clavijo, Nazaret Barriga, Rafael Repiso

cs.DL ·submitted 2026-11-18 12:45 UTC · v1

Abstract

Theses by publication are accepted in most Spanish universities, yet there is little empirical evidence on the scientific output that supports them or on the role doctoral candidates play in that output, and it is not even possible to determine what share of all theses defended in the country follow this format. To address this gap, we analysed a sample of 338 theses by publication defended in Spain in 2025 and 2026, identified in the Teseo database and downloaded in full text. On average, each thesis included 4.0 works, of which 3.0 were articles indexed in Scopus, and 61.1% of these articles appeared in first-quartile SJR journals. The doctoral candidate was first author in 81.1% of the articles and held an intermediate position in 12.1%, while 17 candidates (5.4%) were not first or sole author of any article in their compendium. As for publication venues, MDPI was the main publisher, with 23.2% of the articles, and 40.6% of the candidates published at least one work from their compendium with it. Overall, 45.4% of the candidates used so-called grey publishers, such as MDPI or Frontiers, at least once, and for almost 10% of them these publishers were the only outlet for the compendium. We also detected other infrequent but questionable practices, such as the inclusion of works published in journals delisted from Scopus or in special issues guest-edited by the candidates themselves, works still under review, and articles included in two different theses. Taken together, these results point to the need to clarify regulations on theses by publication, in particular regarding the candidate's authorship of the works linked to the thesis and the quality criteria required of publication venues. Theses by publication should also be identified in a standardised way in official registers, so that they can be retrieved and monitored.

Comment
Spanish version at https://hdl.handle.net/10481/116957

Closest papers

Nearest neighbours by meaning across the whole index.

What It Costs to Trust a Source: A Reproducible Method for Institutional Assessment of Author Disambiguation

cs.DL ·2026-10-29 ·Simon Porter
similarity 0.51
Abstract

Records of research outputs are curated with care by universities, and the effort is shaped by the external sources from which candidate records are drawn. The curation required before the author identities in such sources can be trusted is examined, and a reproducible method for estimating its cost is set out. Four tests are described; two can be run on public data alone, and two are conducted against an institution's own curated record, taken from Symplectic Elements Discovery portals. The method is demonstrated on OpenAlex and Dimensions across 30 institutions. Of the publications attributed to matched researchers, 50.4\% were confirmed by the institutional record for OpenAlex and 69.6\% for Dimensions, and fewer trusted researcher profiles were retained from OpenAlex at a matched confidence threshold in each of the 30 institutions. Carried through to effort, integrating OpenAlex requires 1.5 times the person-days of review and entry of Dimensions even when each feed is filtered at the threshold that minimises the amount of review required.

0.27

Assessing the Reliability of Longitudinal Bibliometric Rankings under Incomplete Citation Histories

cs.DL ·2026-11-12 ·João Paulo Papa
similarity 0.50
Abstract · 20 pages, 2 figures. Software available at https://doi.org/10.5281/zenodo.24170285

Longitudinal bibliometric analyses rely on annual citation histories, yet missing annual observations are frequently difficult to distinguish from true zero-citation years. We present a reproducible case-study framework for auditing citation-history gaps, tracing retrieval provenance, and quantifying the sensitivity of longitudinal indicators and rankings to explicit missing-data assumptions. The case study comprises 595 consolidated publications derived from 616 Google Scholar article records, and examines the completed calendar years 2024-2025. Three scenarios are compared: strictly observed annual counts (A), hypothetical zeros for internal gaps only (B), and hypothetical zeros for all missing years within a valid publication interval (C). The number of publications with computable growth and acceleration indicators increases from 196 (A) to 257 (B) and 490 (C); the corresponding counts for a revival indicator are 131, 152, and 177. Although the ordering of publications eligible under both compared scenarios is unchanged (Spearman and Kendall correlations equal to 1.0), complete-ranking positions and Top-K membership may change markedly. In particular, acceleration exhibits a Jaccard overlap of 0.563 at K=50 between A and C, while revival exhibits 0.667 at K=10. These findings demonstrate that unchanged indicator values and perfect correlations on a common subset do not guarantee stable rankings when eligibility changes. The zero assignments are hypothetical sensitivity assumptions, not evidence of provider semantics. The results are descriptive and based on a single researcher profile. A reusable Google Scholar Tracker software workflow supports the audit and sensitivity analysis; version 1.8.5 is publicly available on GitHub and archived on Zenodo (DOI: 10.5281/zenodo.24170285).

0.49

Latin American Studies since the 1980s: From Apocalyptic Dreams to Assimilationist Consolidation

cs.DL cs.CL ·2026-11-09 ·Thiago Dumont Oliveira, Juan Grigera, Pedro Mendes Loureiro
similarity 0.50
Abstract

We investigate how Latin American Studies (LAS) has evolved since 1982 in three leading LAS journals. Using network analysis, text mining, and bibliometrics, we trace transformations in disciplinary positioning, authorship, and citation patterns. Our main claim is that LAS has undergone an assimilationist consolidation. The field is now institutionally recognisable, with core LAS journals occupying central positions in disciplinary networks and acting as bridges across fields. Yet this consolidation has reinforced hierarchies privileging Anglophone academic norms. Journals based in Latin America, once central, have been marginalised. The share of Latin American authors has grown, but their profiles converge towards Northern standards.

0.34

On some unresolved issues in aggregate level comparative research evaluation

cs.DL ·2026-10-16 ·Paul Donner
unusual similarity 0.49
Abstract

This short conceptual paper recalls to the attention of the scientometrics community some long-standing open methodological problems and proposes new directions that might be taken in renewed engagements with them. These problems are the differential dependency of the global reference score on the included units' observed scores and the dilution of impact measurement accuracy due to collaboration, which causes a global convergence in country citation impact due to international collaborative research. Advantages and disadvantages of existing and new solutions are discussed.

0.27

Foreign-trained faculty and the collaborative organization of high-impact U.S. science

cs.DL ·2026-09-30 ·Erjia Yan, Chaoqun Ni, Xiang Zheng, Weiye Gu
similarity 0.47
Abstract

Internationally mobile scientists are central to national research and innovation systems. We link faculty rosters from the Academic Analytics Research Center to OpenAlex publication records for 2011-2020, yielding more than 12 million faculty-publication observations for 236,394 tenure-system faculty at more than 300 major U.S. universities. Foreign-trained faculty, defined by a terminal degree awarded outside the United States, constitute about 11% of the observed faculty workforce but account for 13-14% of publications and 14-16% of top-1% cited elite output. We find that this elevated representation in elite output is closely related to their organizational embeddedness: when faculty are compared within the same institution, scientific domain, rank, and year, the difference in elite output narrow substantially while overall productivity and collaboration differences persist within those settings. In addition, foreign-trained faculty enter each publication year with larger and broader prior collaboration networks, and collaborator reach is more strongly associated with subsequent elite output. By contrast, although raw topic breadth is greater among foreign-trained faculty, after accounting for prior publication volume, we find that their topic breadth is slightly narrower and more cognitively concentrated. These findings recast international training in the lens of scientific capacity and organizational integration in that internationally accumulated scientific capabilities become embedded in institutions and relationships through which research is organized and produced.

0.18

Jev-as-a-Judge for Brazilian Portuguese Information Retrieval: Relevance Assessment and Reranking

cs.IR ·2026-10-16 ·Leandro Carísio Fernandes, Jayr Pereira
similarity 0.47
Abstract

This study investigates Jev, a System One model designed for fast, structured decision-making, in information retrieval. We use Jev-as-a-judge to generate relevance judgments for four Brazilian Portuguese IR collections covering different domains and compare them with the official relevance judgments of each collection. We also evaluate Jev as a reranker. For relevance assessment, exact agreement ranged from 52.9% to 64.9%, while quadratic weighted Cohen's kappa ranged from 0.52 to 0.82. Most disagreements involved adjacent relevance levels, with at least 94.5% of annotations matching exactly or differing by only one relevance level. Despite differences at the individual query--document level, Jev-generated qrels produced similar retrieval system rankings, with Kendall's tau ranging from 0.90 to 0.93 for NormasTCU and Ulysses-RFCorpus across the two evaluation metrics. For reranking, Jev reordered the top 1,000 BM25 candidates for each of the 50 Quati test queries, increasing nDCG@10 from 0.3329 to 0.6331 (+90.2%) and MRR from 0.6852 to 0.9033 (+31.8%). These findings support Jev as a relevance assessor and show improved ranking effectiveness over BM25 in the evaluated reranking setting.

0.27

Where Do Highly Cited Scientists Stand? A Multi-Dimensional Analysis of Positional Distribution in the Top 2% Ranking

cs.DL ·2026-11-17 ·Yuehai Li, Zuguang Gu
similarity 0.47
Abstract

The Top 2% Scientists list is widely used. Yet current applications either only count the number of scientists in different units or criticize the list's validity as a measure of individual impact. We introduce positional enrichment, a scale-free framework that compares observed to expected counts across percentile bins on the list, revealing where a unit's scientists tend to sit along the list rather than how many it contributes. Applying positional enrichment to the 2026 single-year list, we show that countries, institutions, and research subfields each fall into a consistent pattern of three groups with Head-, Middle-, and Tail-enriched profiles. Subfield profiles are globally stable, whereas countries and institutions are heterogeneous across subfields. National and institutional differences are therefore compositional. Therefore, the reason of a country or institution sitting near the head of the list is unlikely its scientists performing better within the same subfields, while it holding more of the subfields that sit near the head. Academic age adds an independent dimension, with stronger enrichment toward the head after 25 years and exceptions in fast-moving subfields such as artificial intelligence. We show the ranking is not a flat ordering of individual influence but a subfield-organized stratification.

0.18

A Graph Approach to the Academic Publishing Network: A Heterogeneous Model and Structural Screening over OpenAlex Open Data

cs.SI cs.DLstat.AP ·2026-08-11 ·Robert Šamárek, Radek Martinek
code/data similarity 0.46
Abstract

The academic publishing ecosystem is a vast, heterogeneous network of works, authors, institutions, journals, and topics. Traditional scientometrics reduces it to isolated tabular indicators (h-index, Impact Factor) that ignore topological context and are not designed to capture coordinated illegitimate practices. Building on our companion review, which proposed graph analysis of publishing integrity, this paper implements that approach. We define a heterogeneous multivariate graph model over OpenAlex open data (seven node types, seven edge types) and a methodology based on projections (citation and co-authorship networks), interpretable structural metrics, community detection, and three screening detectors of anomalous publishing patterns. We deliberately avoid binary classification: detectors return ranked candidates with explicit structural evidence for human assessment. On the institutional corpus of VSB - Technical University of Ostrava (2020-2025) with its one-hop citation neighbourhood, community detection recovers real research groups, centralities identify cross-disciplinary bridges, and the screenings flag dense co-authorship cliques, locally closed citation loops, and thematically isolated venues. On a second, venue-centric corpus with external ground truth (journals delisted by Scopus and DOAJ) and size-matched controls, a naive case-control design yields seemingly strong but spurious detectors (a prominence confound), whereas after matching the only robust signal is the breadth of disciplinary scope (AUC 0.70); an open graph-based prestige measure (PageRank over the journal citation network) tracks a JIF proxy while being an order of magnitude more resistant to citation gaming than count-based indicators. We release the method as the open-source library apnet with a reproducible CLI workflow and a web interface; the analysis runs on commodity hardware in minutes.

0.20