CS Paper Radar

Does ChatGPT score research quality differently by gender?

Kayvan Kousha, Mike Thelwall

cs.DL ·submitted 2026-08-10 12:50 UTC · v1

Abstract

Large Language Models (LLMs) are being considered for research evaluation, raising concerns about the introduction of AI bias. This study investigates whether ChatGPT research quality scores differ by first-author gender using 89,744 journal articles from the UK Research Excellence Framework (REF) 2021. Author information was withheld from ChatGPT to avoid direct gender bias. Nevertheless, male first-authored papers had slightly higher ChatGPT scores in most Units of Assessment (UoAs), especially in health, science and engineering-related subjects, and this pattern was often stronger for ChatGPT than for REF scores, based on a departmental-level proxy. Rank-based ChatGPT gains relative to REF scores were also more favourable for male first-authored papers in most UoAs, although the differences were generally small. Gender differences were not evident for solo research in the social sciences, arts and humanities, however. The male-favouring pattern for first-authored research was not explained by gender differences in writing styles, at least as reflected in abstract complexity. Some ChatGPT-REF differences may also reflect the departmental averaging process used to generate the REF proxy scores. Average ChatGPT scores may differ by first-author gender indirectly through other factors, such as field, topic, method, journal context or authorship structure. Thus, this is an additional reason to be cautious with AI-based research evaluation.

Closest papers

Nearest neighbours by meaning across the whole index.

Are explicit novelty claims in research abstracts associated with higher ChatGPT scores?

cs.DL ·2026-10-18 ·Kayvan Kousha, Mike Thelwall
similarity 0.59
Abstract

Large Language Models (LLMs) such as ChatGPT can estimate research quality from article titles and abstracts, and decision makers may increasingly use LLM scores to support research assessment. In this context, it is a concern that LLM scores may be influenced by linguistic signals rather than the quality of the research described. This study investigates whether explicit novelty claims in research abstracts are associated with higher ChatGPT scores. Using 99,245 journal articles submitted to the UK Research Excellence Framework (REF) 2021, ChatGPT scores and percentile rank gains relative to REF departmental average scores (as a proxy for article-level scores) were compared between abstracts with and without any of 282 three-word phrases identified as indicating a novelty claim. Abstracts containing novelty claim phrases had higher mean ChatGPT quality scores in all four main REF research groupings (panels). Moreover, the score difference was higher for the originality dimension of research quality than for significance and rigour in 30 of the 34 broadly field-based Units of Assessment (UoAs) used to categorise research in the REF. Thus, explicit novelty claims probably associate with higher quality scores primarily because they associate with higher scores for the originality dimension. Follow-up tests suggested that abstracts containing novelty claims tended to rank more favourably under ChatGPT than under the REF departmental quality proxy. Whilst the findings suggest that ChatGPT may be influenced by explicit novelty claims, they do not conclusively show that novelty phrases caused the higher scores because the scores and phrases may at least partially reflect more novel research.

0.25

Scoring Grant Applications with Large Language Models

cs.DL ·2026-09-21 ·Mike Thelwall, David Pride, Francesco Osborne, Angelo Salatino, Petr Knoth +2 more
similarity 0.55
Abstract

Purpose: Assessing grant applications is time-consuming and difficult, adding to the overall burden of academic peer review. Whilst funders are exploring whether AI can help, there is no published research into the accuracy of Large Language Models (LLMs) for scoring contemporary grants. Design/methodology/approach: This study investigates whether six open-weight LLMs (Gemma 3 1B/4B/12B/27B, DeepSeek R1 32B, Qwen 3 32B) can give useful scores for 2267 recent UK Economic and Social Research Council (ESRC), and Engineering and Physical Sciences Research Council (EPSRC) grant applications, comparing them with scores from the original reviewers and funding panel members. Findings: Although the LLM scores are individually inaccurate, when averaged and converted to ranks they correlate positively with expert average scores. The best performing LLM, Gemma 3 27B (10 iterations with varied prompts), had moderate rank correlations with average reviewer scores (mean rho=0.26). Gemma 3 27B's average correlation with individual reviewers was 0.19, which is lower than the inter-reviewer mean correlation of 0.24, suggesting that it scores are slightly weaker than individual reviewer scores. Gemma 3 27B had weak rank correlations with average panel member scores (mean rho=0.17), with lower average correlations with individual panellists (mean rho=0.14), which is substantially lower than the inter-panellist correlation (mean rho=0.38). Whilst the correlations seem too weak to replace expert review at the final panel stage, LLM scores might help with the initial reviewing state, such as by helping identify the weakest proposals for fast-track desk rejections, to replace one human reviewer, or for triangulation to check for bias.

0.11

Gender and the Production of Research Impact

cs.DL stat.AP ·2026-08-26 ·Sanger Wagner, Charles Rahal, Melinda C. Mills
similarity 0.55
Abstract

Evaluating the impact of scientific research beyond academia --- on policy, health, the economy, and cultural life --- has become a cornerstone of science policy and research-funding allocation worldwide. Yet which researchers produce the research underpinning this impact, and how this production is shaped by gender, remains poorly understood. We combine structured and unstructured records from the United Kingdom's latest Research Excellence Framework, the largest national research assessment currently in operation, with large-scale bibliometric data to quantify gender differences among the researchers underpinning documented impact. Women account for 38.16% of these contributors: underrepresented overall, but with a consistently higher share than in research-output authorships (33.63%), both overall and across all four REF panels. Impact production is also strongly gendered across domains: women are better represented in case studies concerning education, health, cultural, and civil-society impact, whereas those concerning commercialisation pathways such as patenting and manufacturing remain dominated by men. These findings reveal critical inequalities across the pathways that connect research to impact beyond academia, offering crucial evidence for policymakers and academic institutions aiming to build more equitable and representative systems for evaluating scientific contributions.

0.20

Do Large Language Models Favour Any Research Topics?

cs.DL ·2026-08-31 ·Mike Thelwall
similarity 0.53
Abstract

Large Language Models (LLMs) can estimate the quality of published journal articles, potentially supporting human assessment when evaluations are needed. Whilst there are reasons to believe that LLMs may have biases in this role, there is no statistically strong evidence yet. The current article addresses this gap with an exploration of the types of articles that attract high or low LLM scores in 73,489 articles from 15 health and life sciences journals. Based on comparing the words in the titles and abstracts of higher and lower scoring articles for two LLMs in various ways, the results suggest that topics favoured by GPT-OSS-120B include viruses, genes and cells and its disfavoured topics include surveys, patients and students. It is not clear whether these patterns reflect underlying quality differences or AI biases, however. The same method found systematic differences between the topics favoured by GPT-OSS-120B and Gemma 3 27B, such as Gemma 3 27B giving relatively higher scores for machine learning research, proving that at least one of the two LLMs has AI bias. Finally, comparing the scores for full-text articles compared to scores for titles and abstracts also finds differences for both LLMs, showing that they both can exhibit AI bias for at least one of these two input types, and probably both. Overall, the results show that it is important to consider LLM biases when deciding whether to use them for research evaluation tasks.

0.47

A Cracked Mirror: How People Perceive Gender Performance by Large Language Models

cs.HC physics.soc-ph ·2026-11-04 ·Faezeh Fadaei, Jenny Carla Moran, Taha Yasseri
similarity 0.53
Abstract · Preprint, under review; main article and supplementary material

How do large language models (LLMs) perform gender under zero-shot prompting, and how do people interpret those performances in conversation? Drawing on gender performativity, we examine how gendered meanings emerge through generated language, conversational context and human interpretation. In a preregistered randomised online experiment, 1,060 participants each had five short conversations with an LLM. We used minimal prompts to elicit performances from "very masculine" to "very feminine" and asked participants to rate their partner's perceived gender after each conversation. Mean ratings shifted in the direction of the prompts, but ratings at the extremes were closer to the midpoint than the prompt labels implied. When prompted to perform as "neither masculine nor feminine", the models were perceived as slightly masculine on average. Ratings varied across models and conversation topics. Women and men gave similar ratings at the extremes, but women rated the models as more masculine across the intermediate prompt levels. Participants' explanations illustrate how they drew on writing style, emotional expression and conversational interests, sometimes questioning the stereotypes behind their judgements. These findings suggest that conversational AI acts as a cracked mirror of gender norms. Models reproduce recognisable cues, and people interpret and sometimes challenge the meanings those cues carry.

0.07

Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing

cs.AI ·2026-08-27 ·Hyeonchu Park, Gahye Jeong, Bugeun Kim
top venue similarity 0.52
Abstract · Presented in EMNLP 2026

AI text detectors are increasingly employed in academic settings, but it remains unclear whether their outputs reflect AI authorship itself or broader linguistic features associated with polished academic English. Previous studies have reported high false-positive rates (FPRs) for non-native English writing, but population-level comparisons confound authorship with differences in topic, domain, and writing style. Professional editing provides a useful setting for examining this issue because it changes the linguistic form of manuscripts while preserving authorship and content. We examined 135,389 document pairs from a professional English editing service (2018-2025), comprising non-native manuscripts and their native-edited versions, to assess how editing affects detector responses controlling for content and authorship. For the 13 AI text detectors, FPRs for human-written texts varied widely, from 0.0% to 100.0%. Responses varied across detectors: the same edits increased AI scores in some detectors but decreased them in others. Notably, score changes correlated with the extent of editing. The findings identify professional editing style as a key confounding variable in AI detector outputs, rather than establishing a full separation of text origin from linguistic style, raising concerns about fairness and reliability in academic settings.

0.63

Earlier citation practices are linked to signs of artificial intelligence use in scientific writing

cs.DL ·2026-11-12 ·Hongkan Chen, Yongyuan He, Qingshan Zhou, Yi Bu
similarity 0.52
Abstract

As artificial intelligence (AI) becomes more common in scientific writing, some authors show fewer signs of AI assistance than expected across successive periods. We analysed OpenAlex publication histories for 71,133 authors with at least one eligible first-authored English-language publication each year from 2023 through September 2026. Using abstract-based writing scores, we defined resistance as the predicted minus observed share of abstracts classified as AI-assisted. Positive scores indicate fewer such abstracts than expected. Early resistance was positively associated with later resistance, although the share with positive scores fell. Environmental characteristics contributed more than individual characteristics to predicting later scores, although overall predictive power was low. Having a collaborator with a non-positive early score was associated with lower subsequent resistance. Authors with positive mean scores in both 2023-2024 and 2025-2026 cited older work, drew on fewer subfields and more often cited sources they had used before than authors with non-positive mean scores in both periods. These differences were evident before 2023. The adjusted gap in reference reuse rose from 3.24 percentage points before 2023 to 7.95 in 2025-2026. The findings link variation in signs of AI assistance to earlier differences in how scientists used prior work.

0.42

Benchmarking Gender Bias in Machine Translation Evaluation Metrics across Occupations

cs.CL ·2026-09-18 ·Orfeas Menis Mastromichalakis, Giorgos Filandrianos, Wafaa Mohammed, Giuseppe Attanasio, Chrysoula Zerva
published similarity 0.52
Abstract · Accepted for publication at the 11th Conference of Machine Translation (WMT26), co-located with EMNLP 2026

Gender bias remains a persistent concern in machine translation (MT), affecting both generated translations and their automatic evaluation. When a source text leaves a person's gender unspecified, translations may realize that person using masculine or feminine forms, and both MT systems and evaluation metrics may exhibit systematic preferences between these alternatives despite the source providing no basis for such a distinction. We study this behavior in the WMT 2026 Automated Translation Quality Evaluation Systems Shared Task using an occupation-balanced subset of GAMBIT+. We consider seven English-source language pairs, six from the original dataset, targeting Arabic, Czech, Greek, Icelandic, Russian, and Ukrainian, and extend the original resource with German. The subset contains 1,308 masculine/feminine translation pairs per target language, with three examples for each of the 436 ISCO-08 occupational groups. We evaluate shared-task submissions and baselines for score prediction and error annotation, examining the direction, magnitude, and frequency of gender-related differences. We find an overall tendency for masculine translations to receive higher scores, as well as differences per occupation following stereotypical gender representations, although the strength and consistency of this preference vary considerably across evaluators and languages. Our results show that gender bias remains present in MT evaluation, but that capturing its extent requires looking beyond a single aggregate measure to complementary dimensions of evaluator behavior.

0.35