CS Paper Radar

Journal Basket: Supporting Cross-Disciplinary Literature Searching and Methodological Transparency

Michael Cahalane

cs.DL cs.IR ·submitted 2026-10-21 23:58 UTC · v1

Abstract

Business students beginning a research project must learn how to identify relevant scholarly publications, distinguish disciplinary sources, construct database searches, and report the decisions behind their literature reviews. These tasks can be difficult because journal classification systems and bibliographic databases organize scholarly information differently. This paper introduces Journal Basket, a browser-based tool developed to help business students conduct journal-bounded literature searches and currently available in beta. Journal Basket enables users to construct journal collections from the Australian Business Deans Council (ABDC) Journal Quality List, choose from 42 business discipline presets, entire ABDC fields or the Financial Times FT50 list, apply journal rating thresholds, and generate search expressions for Scopus, Web of Science and Business Source. Users can also inspect and modify journal collections, download journal inventories, and generate methodological descriptions and deterministic identifiers for journal selections. Companion learning resources use explanations, examples and interactive activities to teach review methods, database choice, referencing and the use of contemporary AI tools. Drawing on the journal-basket concept used by Litbaskets.io, I describe the educational motivation, design rationale, technical architecture, and practical workflow of Journal Basket. I distinguish reproducing a journal collection from reproducing an entire database search and discuss the limitations of journal rankings as search boundaries. The paper addresses scholarly information retrieval through a workflow for defining journal boundaries, generating database-specific queries and documenting search decisions.

Comment
18 pages, 2 Figures, 1 Table

Closest papers

Nearest neighbours by meaning across the whole index.

HiPaper: A Human-AI Collaborative System for Academic Literature Triage and Scholarly Sensemaking

cs.HC cs.AIcs.IR ·2026-10-31 ·Ye Jia, Pangjing Wu, Hayley Y. W. Gu, Zhuohang Jiang, Xu Yuan +4 more
similarity 0.55
Abstract

Scholarly sensemaking requires researchers to iteratively retrieve, collect, and synthesize literature as their understanding evolves. However, existing scholarly tools provide only partial support for this process. Recent artificial intelligence (AI)-based systems generally rely on opaque submit-and-wait pipelines that it users' ability to inspect, revise, and validate intermediate outputs. In this study, we present HiPaper, a human-AI collaborative literature review system informed by a formative study with academic experts. HiPaper organizes scholarly sensemaking as a three-stage interactive workflow spanning Retrieval, Collection, andSynthesis, centralized on the human-in-the-loop paradigm that exposes intermediate AI-generated content for user inspection and intervention through a persistent workspace called Knowledge Pocket. Through this workflow, users can iteratively refine search intent, curate and organize papers with AI-enriched metadata and clustering, and conduct evidence-traceable synthesis over selected literature. Our user study with 14 Ph.D. students showed that HiPaper efficiently supports scholarly sensemaking by enabling human-AI collaboration in both familiar and unfamiliar domains. Furthermore, the findings highlight how staged interactions with intermediate AI-generated content successfully scaffold user interactions throughout the sensemaking process.

0.05

KnowMe Paper Radar: Lightweight Discovery of Promising Papers in the Age of Autoresearch

cs.AI cs.IR ·2026-11-18 ·Zhuo Chen, Jian Wang, Jinjie Gu, Lijun Wu
code/data similarity 0.53
Abstract · Ongoing work. 67 pages with 34 figures and 37 tables. Project website: https://hackerchenzhuo.github.io/knowme-research-ai/en/ GitHub: https…

The growing volume of topically similar papers makes it difficult to identify new work that can offer useful research insights or methodological guidance. We present KnowMe Paper Radar, a lightweight discovery tool that combines multiple sources of evidence into personalized reading priorities. Users specify topics, priorities, exclusions and dates; the system brings together topical relevance, recency, author research histories, collaboration paths and direction-specific institutional context. By exposing each score component and its supporting sources, KnowMe helps readers select promising papers for their current questions and discover relevant work beyond familiar authors. Automatic acquisition, version merging and graph-cache reuse keep this workflow convenient without large language model (LLM) inference during ordinary use. Experiments on 174,640 acquired records show more than threefold faster repeated context preparation, while cached abstracts improve normalized discounted cumulative gain at rank 10 (NDCG@10) from 0.412 to 0.598 on expert-judged retrieval tasks. Complementary analyses examine how the same accumulated records support semantic retrieval, research-history modeling and literature-grounded planning. A browser interface and a structured command-line interface (CLI) make these capabilities available to both researchers and research agents, positioning KnowMe as a practical upstream tool for literature-informed recursive self-improvement (RSI) workflows.

0.41

Errors of LLM-Assisted Literature Retrieval in Environmental Science: A Comparison Study of Abstract versus Full-text Based Prompts

cs.DL cs.IRcs.LGstat.AP+1 ·2026-10-05 ·Yanjun Chen, Yongfeng Zhang, Lanjing Zhang
similarity 0.52
Abstract

Large language models (LLMs) are increasingly used for literature search and synthesis. However, it is unclear whether they retrieve accurate bibliographic information in environmental science. Therefore, we quantitatively compared the errors of widely used LLM platforms in retrieving references related to original articles from five leading environmental science journals (Energy and Environmental Science, Nature Sustainability, Nature Climate Change, Lancet Planetary Health, and Environmental Science and Technology) published in 2024 to 2025. Claude, ChatGPT, Grok, DeepSeek, Perplexity, and Gemini were used as the LLM platforms. LLMs retrieved 10 references for each of the 50 randomly selected original article using either the article's abstract or its full-text as prompt. The retrieved references were subject to a multimetric score ratio combining validity of bibliographic data, Google Scholar link, digital object identifier, Scopus Electronic Identifier and relevance score (cited by or being the index paper), and the proportion of complete fabrication that failed all metrics. Abstract-only prompt yielded significantly higher accuracy than full-text one. This advantage was confirmed in multilevel mixed-effect multivariable regression after adjusting for journal, platform, and output order. Source journal and the position of a reference within the output list were also independently associated with retrieval accuracy, with lower-listed references associated with lower accuracy. These findings suggest that LLM assisted literature retrieval in environmental science remains moderately accurate and overall inconsistent, varying significantly by platform, journal, prompt type, and output position. Abstract-based prompting, as task-aligned information compression, may outperform full-text one in literature retrieval. Caution should be used when generalizing our findings.

0.34

Westlake Scholar: AI-Enhanced Scholarly Discovery over an Institutional Repository

cs.DL ·2026-09-04 ·Junshu Pan, Luodan Zhang, Yifeng Lu, Mengfan Zhao, Ming Luo +3 more
code/data similarity 0.52
Abstract · 7 pages, 6 figures

Institutional repositories (IRs) provide mature infrastructure for preserving and disseminating research outputs, but conventional record- and document-centric interfaces provide limited support for connecting deposited papers to related research and people. We present Westlake Scholar, an open-source, institution-grounded platform that adds four complementary artificial intelligence (AI) services to repository infrastructure: contextual paper reading, research-direction-guided paper discovery, publication-grounded expert discovery, and AI-generated research chronologies for scholars. The services draw on a shared institutional knowledge layer connecting approved publication records, paper content, and scholar--publication relationships. This allows the same paper to support contextual reading, cross-paper discovery, expert matching, and longitudinal views of scholarly work. Westlake Scholar provides an open and governable implementation of an institution-controlled AI layer that connects repository content, scholarly discovery, and researcher relationships while preserving provenance, human review, and institutional governance. A deployment at Westlake University, in operation since April 2026, demonstrates that the integrated system can operate in a live institutional setting.

0.37

Uncontrolled source titles: When Nature, Science, and PNAS meet Scopus

cs.DL cs.IR ·2026-11-19 ·Weishu Liu, Ruifeng Zhang, Haifeng Wang
similarity 0.52
Abstract · Forthcoming in Journal of Information Science

Bibliographic databases such as Scopus and Web of Science play a critical role in literature discovery, systematic reviews, bibliometric analyses, and research evaluation, yet their reliability depends on effective control of the quality of the bibliographic data. This study examines the problem of uncontrolled source titles in Scopus by comparing five possibly adopted journal-level retrieval strategies across three flagship journals-Nature, Science, and PNAS. Substantial discrepancies across retrieval results indicate persistent fragmentation in the source title field. A comparative analysis using the Web of Science Core Collection shows that no comparable degree of uncontrolled source-title variation is observed for the same journals. The study further explores possible mechanisms, including inheritance of different title forms from (different) upstream providers, automated parsing and OCR-related artifacts, and insufficient cross-validation. Based on these findings, the study proposes recommendations at both the user and database-provider levels to improve source-title normalization and strengthen source-level metadata governance, with implications for the accuracy and reproducibility of journal-level retrieval and evaluative uses.

0.21

Idea2Prior: Auditable Paper Retrieval and Ranking from Research Ideas

cs.IR ·2026-10-14 ·Shitian Yang, Ruijie Tao, Jian Huang
similarity 0.52
Abstract

Finding a paper from an informal research idea requires more than matching topic words: relevant work may use different terminology, and its distinguishing mechanism may be absent from the abstract. We present IDEA2PRIOR, an auditable literature-search system built on PaperArena. It combines multi-source discovery, identity verification, facet-based abstract assessment, semantic citation expansion, and joint Expert ranking. A retrieval-only mode ranks up to five papers from a shortlist of at most 60, using complete available abstracts and locally selected PDF evidence from five fixed acquisition attempts, without generating a long-form report. In a historical comparison covering ten queries from each of EASY, MEDIUM, and HARD, aggregate reported Hit@5 is 53.3% for IDEA2PRIOR, 43.3% for ChatGPT web Deep Research, and 36.7% for Gemini web Deep Research under the documented accounting convention. The advantage is concentrated in EASY and MEDIUM; ChatGPT leads on HARD. Selected IDEA2PRIOR runs average 8 minutes 53 seconds, compared with user-reported web averages of 5.2 and 4.7 minutes. A separate nine-query API sample averages $0.0945 per task; this is a historical cost observation, not a matched comparison with web subscription costs. Pairwise Top 5 coverage ranges from 6% to 34%, showing differing returned evidence sets. The system also exposes optional implementation analysis and citation-evolution tools. These results support targeted idea-to-paper retrieval while leaving general web research, forum search, and broader relevance evaluation open.

0.24

BizSage: A Self-Evolving Multi-Agent Framework for Business Research with Efficient Knowledge Retrieval

cs.CL cs.MA ·2026-09-03 ·Yuhe Wu, Guangyu Wang, Jiaxin Liu, Guang Zhang
top venuebenchmark similarity 0.51
Abstract · Accepted by EMNLP 2026 findings

While multi-agent systems based on large language models (LLMs) have shown promise in automating the progressive workflow of academic research, extending them to economics and business research, where specialized domain knowledge spans neighboring disciplines yet remains difficult to access in a structured way, presents two challenges. First, existing methods mostly retrieve at the paper level, yet the evidence needed for research tasks is often distributed across different sections, creating a granularity mismatch that hinders retrieval coverage and precision. Second, these fields demand strict empirical rigor, yet current systems provide limited mechanisms for learning from evaluation feedback. We present \textbf{BizSage}, a multi-agent framework combining corpus-level fine-grained retrieval with quality-driven self-evolution. We build a Lateral Knowledge Graph (LKG) by merging section-level knowledge graphs and apply Personalized PageRank (PPR) to surface semantically relevant and structurally important sections. Seven specialized agents collaborate under a Meta-Review self-evolution mechanism that distills failure modes from evaluation traces into reusable strategies. On a benchmark spanning four domains and three tasks, BizSage ranks first on the majority of metrics, achieves pairwise win-rates above 60\% against six baselines, and produces zero hallucinated citations. We hope BizSage paves the way for reliable research assistance in economics, business, and the broader social sciences.

0.31

The Scientific Research Taste Benchmark (SciTaste-Bench): A Multi-Disciplinary Benchmark for Assessing Large Language Models' Judgment of Research Taste in Scientific Papers

cs.DL ·2026-10-09 ·Xinyi Gao, Xiaogang Li, Jialu Nie, Yuting Fu, Jingye Xu +7 more
benchmarkcode/data similarity 0.50
Abstract

Whether large language models can assess the innovativeness of academic publications matters for literature reviews, research funding screening, and academic recommendations. We introduce the Scientific Research Taste Benchmark (SciTaste), a gold-standard benchmark covering six disciplines: physics, mathematics, chemistry, biology, medicine, and finance. SciTaste measures research taste, that is, the ability to judge a paper's scientific value and potential, of which innovativeness is one of seven dimensions. It integrates metadata from NASA ADS, OpenAlex, and arXiv, aligns papers to field-specific classification systems, and scores each paper with the seven-dimensional Academic Taste Index. Dimension weights come from a bi-objective machine-learning approach (five regressors, including random forests) and are shared across all six disciplines. The benchmark includes 300 selected papers (50 per discipline) and a backup pool of 5,700 papers (950 per field) covering 1996-2023. SciTaste supports four evaluation modes: pure_qa, native_search, our structured tool-calling agent DiM (9 bibliometric tools in ADS/OpenAlex), and dimagent_v3_native. Outputs are evaluated by two complementary schemes: correlation with dimension-level accuracy, and WAPE relative error. Across ten state-of-the-art LLMs, tool-based structured evaluation generally outperformed toolless and raw web search modes, though gains were model-dependent. Physics is easiest; chemistry, biology, and medicine remain more challenging. SciTaste supplies the value-judgment substrate auto-research systems need to screen, rank, and prioritize candidate ideas. Dataset, harness, and scoring code are available on Hugging Face at https://huggingface.co/datasets/skylenage/SciTaste-benchmark.

0.38