CS Paper Radar

Gender and the Production of Research Impact

Sanger Wagner, Charles Rahal, Melinda C. Mills

cs.DL stat.AP ·submitted 2026-08-26 21:22 UTC · v1

Abstract

Evaluating the impact of scientific research beyond academia --- on policy, health, the economy, and cultural life --- has become a cornerstone of science policy and research-funding allocation worldwide. Yet which researchers produce the research underpinning this impact, and how this production is shaped by gender, remains poorly understood. We combine structured and unstructured records from the United Kingdom's latest Research Excellence Framework, the largest national research assessment currently in operation, with large-scale bibliometric data to quantify gender differences among the researchers underpinning documented impact. Women account for 38.16% of these contributors: underrepresented overall, but with a consistently higher share than in research-output authorships (33.63%), both overall and across all four REF panels. Impact production is also strongly gendered across domains: women are better represented in case studies concerning education, health, cultural, and civil-society impact, whereas those concerning commercialisation pathways such as patenting and manufacturing remain dominated by men. These findings reveal critical inequalities across the pathways that connect research to impact beyond academia, offering crucial evidence for policymakers and academic institutions aiming to build more equitable and representative systems for evaluating scientific contributions.

Closest papers

Nearest neighbours by meaning across the whole index.

Gender Stereotypes Make Women Invisible: The Presence of Female Scientists in the Media

cs.DL ·2026-08-24 ·Maider Eizmendi-Iraola, Simón Peña-Fernández
publishedhighly cited similarity 0.63
Abstract · 15 pages, 4 figures, 1 table

Interest in the situation of women scientists has increased in recent years. Scientific institutions and governmental authorities have launched initiatives to promote science as a vocation among women. Within this context, the effort made by the media in disseminating role models is of vital importance. The aim of this research is to analyse the presence of women scientists in the media, and to conduct an appraisal of the status granted to them and the image conveyed about them. To this end, we analysed the content published on the websites of the regional newspapers Berria, Gara, El Correo and Diario de Navarra between 2014 and 2019 citing women scientists and researchers (N = 2362). The results indicate that presence is greater in quantitative terms, as is the prominence given to them in headlines. However, the disciplines in which they practise and the stereotypes which are conveyed shape their image, which in the case of STEM areas emphasise their role as carers and their singularity in the scientific field.

0.69

The Legibility Gap: How Gender Equity Interventions Redistribute Recognition Across Cultures

cs.DL cs.CYphysics.soc-ph ·2026-08-21 ·Binglu Wang, Jose Cervantez, Jiahui Xue, Katherine L. Milkman, Dashun Wang
similarity 0.59
Abstract

Efforts to promote gender equity in science increasingly rely on name-based inference to quantify representation and guide policy and behavior. Yet linguistic cues that signal gender vary across cultures and are often obscured when names are transliterated into English. Here we identify a pattern we call the "legibility gap": when gender is inferred from names, equity interventions systematically benefit women whose names signal gender while bypassing those whose names lose such cues in translation. Using both observational and experimental evidence, we show how this gap reshapes recognition in science. Analyzing citation diversity statements-an emerging practice in which authors report the algorithmically estimated gender composition of their reference lists-we find that papers that include this practice cite women more frequently, but the gains accrue almost entirely to authors with gender-signaling Western names. By contrast, women whose names lose gender cues in English transliteration, predominantly those with East Asian names, receive fewer citations in these same papers. Two preregistered experiments (N = 2,250) corroborate this pattern and identify its mechanism: linguistic legibility, not cultural unfamiliarity, determines who is recognized as a woman and who benefits from policies designed to support women in science. Overall, these findings expose a previously unrecognized layer of inequity embedded in global equity infrastructures. As science becomes increasingly global and equity efforts increasingly algorithmic, the legibility gap reveals how uneven identity recognition reshapes fairness. In global systems of recognition, equity depends not only on whether policies are effective on average, but also on whether they are equitable across cultures.

0.14

Does ChatGPT score research quality differently by gender?

cs.DL ·2026-08-10 ·Kayvan Kousha, Mike Thelwall
similarity 0.55
Abstract

Large Language Models (LLMs) are being considered for research evaluation, raising concerns about the introduction of AI bias. This study investigates whether ChatGPT research quality scores differ by first-author gender using 89,744 journal articles from the UK Research Excellence Framework (REF) 2021. Author information was withheld from ChatGPT to avoid direct gender bias. Nevertheless, male first-authored papers had slightly higher ChatGPT scores in most Units of Assessment (UoAs), especially in health, science and engineering-related subjects, and this pattern was often stronger for ChatGPT than for REF scores, based on a departmental-level proxy. Rank-based ChatGPT gains relative to REF scores were also more favourable for male first-authored papers in most UoAs, although the differences were generally small. Gender differences were not evident for solo research in the social sciences, arts and humanities, however. The male-favouring pattern for first-authored research was not explained by gender differences in writing styles, at least as reflected in abstract complexity. Some ChatGPT-REF differences may also reflect the departmental averaging process used to generate the REF proxy scores. Average ChatGPT scores may differ by first-author gender indirectly through other factors, such as field, topic, method, journal context or authorship structure. Thus, this is an additional reason to be cautious with AI-based research evaluation.

0.38

Where Do Highly Cited Scientists Stand? A Multi-Dimensional Analysis of Positional Distribution in the Top 2% Ranking

cs.DL ·2026-11-17 ·Yuehai Li, Zuguang Gu
similarity 0.52
Abstract

The Top 2% Scientists list is widely used. Yet current applications either only count the number of scientists in different units or criticize the list's validity as a measure of individual impact. We introduce positional enrichment, a scale-free framework that compares observed to expected counts across percentile bins on the list, revealing where a unit's scientists tend to sit along the list rather than how many it contributes. Applying positional enrichment to the 2026 single-year list, we show that countries, institutions, and research subfields each fall into a consistent pattern of three groups with Head-, Middle-, and Tail-enriched profiles. Subfield profiles are globally stable, whereas countries and institutions are heterogeneous across subfields. National and institutional differences are therefore compositional. Therefore, the reason of a country or institution sitting near the head of the list is unlikely its scientists performing better within the same subfields, while it holding more of the subfields that sit near the head. Academic age adds an independent dimension, with stronger enrichment toward the head after 25 years and exceptions in fast-moving subfields such as artificial intelligence. We show the ranking is not a flat ordering of individual influence but a subfield-organized stratification.

0.24

Patterns of Research Funding Across Research Subjects: The Case of NSERC

cs.DL ·2026-08-11 ·Rabeeh Parhizkari, Gita Ghiasi
similarity 0.52
Abstract

Funding agencies aim to maximize scientific output from the resources they allocate, a goal that may inadvertently reinforce cumulative advantage within funding systems. Focusing on research areas within Natural Sciences and Engineering (NSE), this study examines the distribution of Canadian research funding over time, with particular attention to the extent to which certain subjects gain prominence as emerging or high-growth fields, while others experience relative stagnation or decline. The results indicate that many research subject groups receiving decreased funding in recent years are concentrated in the pure sciences and mathematics. In contrast, social sciences and medical sciences, which initially had relatively low average funding per grant application, have demonstrated increasing funding trends over time. These findings offer valuable insights for funding agencies seeking to design policies that promote more effective and equitable allocation of resources.

0.04

The conservative turn in science: The changing character of knowledge recombination

cs.SI cs.DL ·2026-09-08 ·Cheng Zhang, Xinkun Liang, Yi Bu, Hongkan Chen
similarity 0.50
Abstract

This study examines how the dominant mode of cross-disciplinary knowledge combination has changed over time. It addresses a limitation of existing studies that document declining disruptiveness at the level of individual works but do not reveal whether the mechanisms of cross-disciplinary knowledge flow have themselves shifted. Drawing on 56 million publications and 816 million citations from OpenAlex (1960-2025), the study classifies cross-disciplinary citations into five types based on the set relationship between the subfield portfolios of citing and cited publications and introduces a semantic-distance measure derived from SPECTER-v2 embeddings of publication abstracts. It subsequently demonstrates that cross-disciplinary citations have shifted markedly away from configurations with no shared disciplinary ground toward types built on partially overlapping knowledge bases, a reorientation further reflected in a steady decline in average semantic distance between citing and cited fields. This shift co-occurs with a diffusion of brokerage positions across the network and a greater reliance on older literature, consistent with a system that has become broader and more decentralized in its interdisciplinary reach. Finally, this study discusses the implications of these findings for science policy and for the design of cross-disciplinary funding mechanisms.

0.08

The illusion of neutrality in metric-based research evaluation

cs.DL ·2026-09-21 ·Fengyuan Liu, Hazem Ibrahim, Yasir Zaki, Talal Rahwan
similarity 0.50
Abstract

Venue prestige and citation counts are two widely used, albeit imperfect, signals of research quality. When the two signals conflict, evaluators must decide how much weight to assign each. Yet, it remains unknown how researchers across disciplines trade off these two signals when evaluating research outcome. To fill this gap, we surveyed 869 researchers using paired choices between hypothetical departmental hiring rules that assigned different weights to venue prestige and citation counts, asking which would produce better science. Among 795 respondents whose choices were largely internally consistent, choices placed nearly equal aggregate weight on the two signals. This apparent balance concealed substantial individual heterogeneity: nearly two in five respondents occupied the most venue-heavy or citation-heavy intervals. Moreover, respondents on average chose more citation-heavy rules than they believed their departments used in hiring. By revealing the subjective judgments that arise when research indicators conflict, our findings reinforce calls for greater caution when quantitative indicators are used to evaluate research.

0.27

Tracing high-profile attention to questionable research as a case for funder due diligence

cs.DL cs.SI ·2026-08-31 ·Federica Silvi, Leslie D. McIntosh
similarity 0.49
Abstract · 40 pages, 6 figures

When questionable research has entered the scientific record, it stands the same chance as other literature of shaping national and international policy, clinical guidance, and research and development activities. This study uses a known authorship-for-sale network identified in August 2022 to examine whether questionable research influences policy, patents, and clinical guidelines, and whether its authors continue to secure funding and publish after exposure. Across nearly 2,000 publications in our dataset, 57 were cited in policy documents, 12 in clinical guidelines, and 480 in patents. Nearly a quarter of these publications are linked to one or more grants: funding that could otherwise have supported rigorous, ethical science. Among the 278 authors we traced, publishing and funding continued well after the PNN's public exposure in 2022: over 90% continued publishing, and 23% were linked to a grant. As our findings show, the participants of paper mills and authorship-for-sale networks can still inform policy and clinical practice and support their authors' career progression even after the questionable practices behind them are exposed. We present a case for funders to consider authorship and network structure as part of a holistic due diligence process, alongside metrics such as citation counts and attention data.

0.35