CS Paper Radar

Towards a Definition of the Computational Architecture of Open Scholarly Infrastructures

Ivan Heibi, Mario Petrella, Angelo Di Iorio, Silvio Peroni

cs.DL ·submitted 2026-08-24 18:53 UTC · v1

Abstract

This paper proposes a layered framework for defining the architecture of the computational unit of an Open Scholarly Infrastructure (OSI) and presents a concrete implementation possibility through the introduction of OpenCitations, an OSI dedicated to publishing citation data and bibliographic metadata. Grounded in the Principles of Open Scholarly Infrastructure (POSI), the study focuses on the technical dimensions of openness, sustainability, interoperability, and reproducibility that are required for a robust OSI. The proposed approach first identifies the core principles and technical features that a computational block in an OSI should guarantee, including separation of operational domains, orchestration, scalability, observability, automation, and workflow portability. It then maps these requirements onto a layered architectural model composed of Hardware, Virtualization, Orchestration, and Application layers, complemented by a transversal Meta layer. The OpenCitations case study shows how this framework can be instantiated in practice through an on-premises infrastructure. The case is presented with details regarding the technicalities and actual implementations of the proposed methodology. By combining a conceptual definition with a real-world implementation, this work offers both a practical reference and a methodological basis for designing the computational block of an OSI.

Closest papers

Nearest neighbours by meaning across the whole index.

Westlake Scholar: AI-Enhanced Scholarly Discovery over an Institutional Repository

cs.DL ·2026-09-04 ·Junshu Pan, Luodan Zhang, Yifeng Lu, Mengfan Zhao, Ming Luo +3 more
code/data similarity 0.58
Abstract · 7 pages, 6 figures

Institutional repositories (IRs) provide mature infrastructure for preserving and disseminating research outputs, but conventional record- and document-centric interfaces provide limited support for connecting deposited papers to related research and people. We present Westlake Scholar, an open-source, institution-grounded platform that adds four complementary artificial intelligence (AI) services to repository infrastructure: contextual paper reading, research-direction-guided paper discovery, publication-grounded expert discovery, and AI-generated research chronologies for scholars. The services draw on a shared institutional knowledge layer connecting approved publication records, paper content, and scholar--publication relationships. This allows the same paper to support contextual reading, cross-paper discovery, expert matching, and longitudinal views of scholarly work. Westlake Scholar provides an open and governable implementation of an institution-controlled AI layer that connects repository content, scholarly discovery, and researcher relationships while preserving provenance, human review, and institutional governance. A deployment at Westlake University, in operation since April 2026, demonstrates that the integrated system can operate in a live institutional setting.

0.37

AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research

cs.AI ·2026-09-15 ·Bernie Boscoe, Srinath Saikrishnan, Vikram Seenivasan, Jack Stark, Andrew Lizarraga +4 more
benchmarkcode/data similarity 0.56
Abstract · 14 pages, 1 figure

Scientific research increasingly relies on large, heterogeneous data sources, motivating interest in retrieval-augmented generation (RAG) systems that provide natural language access to scientific knowledge and research workflows. Researchers are exploring the viability of these systems as natural language interfaces for document search and for generating analysis code and pipeline components. At the same time, concerns about data privacy and control over research infrastructure have motivated interest in open-weight models and open-source deployments hosted within research institutions. In astronomy, this development follows a long history of computational infrastructure development, from archival databases and Structured Query Language (SQL)-based systems to large language model (LLM)-assisted research tools. This paper presents a domain-expert evaluation of faithfulness for AquiLLM, an open-weight, offline RAG-LLM platform designed to support scientific research groups in the use and preservation of tacit and formal knowledge. We define faithfulness as the extent to which generated responses remain grounded in retrieved scientific context without unsupported claims or omissions. We report results from an astronomy case study evaluating AquiLLM across retrieval and scientific analysis tasks. AquiLLM performs most reliably on explicit retrieval-oriented questions grounded in the RAG collection, while faithfulness degrades for queries requiring synthesis or ambiguity resolution. These results highlight both the promise and limitations of open-weight RAG-LLM systems for scientific research and demonstrate the importance of domain-expert evaluation beyond standard benchmark leaderboards.

0.52

OC-AND: A Citation-Enriched Benchmark for Author Name Disambiguation

cs.DL ·2026-10-09 ·Francesca Cappelli, Giovanni Colavizza, Silvio Peroni
benchmark similarity 0.55
Abstract

Author Name Disambiguation benchmarks are predominantly derived from closed infrastructures that may not reflect conditions in open bibliographic environments. We present OC-AND, an open citation-enriched benchmark for AND constructed by remapping the WhoIsWho dataset with bibliographic and citation metadata from OpenCitations. The dataset is produced through a reproducible five-stage pipeline involving DOI verification, metadata validation, OpenCitations enrichment, and author-centric transformation. OC-AND retains the WhoIsWho ground-truth files and partition structure unchanged, while its publication files are restricted to publications that could be matched to a validated DOI and an OpenCitations record. It introduces realistic characteristics of open environments: heterogeneous metadata completeness, absent abstracts and affiliations, asymmetric citation coverage, and sparse graph connectivity. The dataset contains author records with associated citations, enabling evaluation of AND methods in settings closer to real-world open scholarly infrastructure scenarios. OC-AND is released as open data with complete provenance documentation and pipeline code, supporting reproducible research and the development of citation-aware disambiguation approaches.

0.25

A curated global dataset of open science initiatives and policies

cs.DB ·2026-10-26 ·Abdelghani Maddi, Marc-Andr{é} Simard, Isabelle Dorsch
similarity 0.55
Abstract

Inventories of open science initiatives differ in scope, geographic coverage and classification, making it difficult to compare infrastructures, services, networks and policies. We developed COSMI Hub within the OPENIT project to bring these sources together in a curated dataset. The release archived on 8 October 2026 contains 1,186 records and 71 variables covering initiative identity, source provenance, geography, record level, operational status, thematic activities, governance, funding and external identifiers. We identified candidates through structured directories, policy documents, official websites and suggestions from the open science community, then checked identities, reconciled duplicates and assessed supporting evidence. The dataset distinguishes standalone initiatives, services, deployments, umbrella organisations and policy instruments. Records can be assigned several thematic dimensions, with uncertainty retained where evidence is incomplete. We describe the collection and coding methods, the data structure and file-level checks, together with considerations for reuse. The Zenodo release is fixed, whereas the companion dashboard is updated separately. Because we assembled the collection purposively, it cannot be used to estimate the worldwide number of open science initiatives.

0.28

From OA colors to observable access states: A commentary on the 2026 OpenAlex proposal

cs.DB ·2026-09-21 ·Abdelghani Maddi
similarity 0.55
Abstract

The OpenAlex Colors Working Group proposes replacing the familiar Gold, Green, Hybrid, Bronze and Closed taxonomy with a work-level framework based on three dimensions: access, location and license. The proposal addresses genuine weaknesses in the legacy color system, particularly its dependence on journal-level characteristics, its difficulty in describing non-article outputs, and its conflation of access conditions with venue business models. This commentary supports that general direction but argues that the proposed labels should not become the primary data model. The central technical issue is that access, location and license are not best understood as three independent attributes of a work: scholarly works commonly have several versions or copies at different locations, and access status, license and version may differ from one location to another. The analysis therefore recommends treating the location/version observation as the atomic unit of OA metadata and deriving work-level labels, legacy colors and user-facing summaries from those observations. Particular attention is given to license semantics, version identification, the normative assumptions embedded in a ``best-available'' hierarchy, the coarse Publisher/Other Platform distinction, temporal change, provenance, compound works, and backward compatibility. Existing standards and infrastructure (including NISO/ALPSP Journal Article Versions, COAR controlled vocabularies, FAIR provenance principles, and OpenAlex's own current location objects) already provide many of the components needed for such an approach. The result would preserve the simplicity sought by the Working Group while making the underlying data model more extensible, auditable and suitable for funder compliance, bibliometric research and future changes in scholarly communication.

0.25

An AI-Assisted Migration Framework for Transforming Legacy Scientific Applications into Reusable Cloud-Based Workflows

cs.SE ·2026-08-24 ·Nafiseh Soveizi, Sven Tesselaar, Hero Robinson Brouwer, Zhiming Zhao
published similarity 0.54
Abstract · 8 pages, 2 figures, 5 tables. Accepted at the 22nd IEEE International Conference on e-Science (eScience 2026)

Legacy scientific applications remain valuable research assets but are often tightly coupled to project-specific execution environments, limiting their reuse, reproducibility, and deployment within modern scientific workflow systems and cloud-native Virtual Research Environments (VREs). Existing migration approaches primarily target individual artifacts, such as notebooks or containers, and provide limited support for systematically transforming heterogeneous legacy applications into reusable cloud-native workflows. This paper presents an AI-assisted migration framework that combines the Reference Model of Open Distributed Processing (RM-ODP)-guided architectural analysis, Large Language Models (LLMs), and Design Structure Matrix (DSM) analysis. The framework first uses RM-ODP to guide an LLM in identifying reusable workflow components, their interfaces, and execution dependencies from heterogeneous legacy applications. The resulting workflow structure is then iteratively evaluated and refined using DSM analysis. Finally, an LLM-based workflow generator implements the validated workflow components and produces containerized execution environments and executable workflow definitions for deployment in cloud-native workflow systems, including VREs. The framework was evaluated on two legacy scientific applications from different scientific domains. In both cases, the applications were successfully transformed into reusable cloud-native workflows while preserving their original functionality, demonstrating the feasibility of the proposed approach for modernizing legacy scientific software.

0.28

Best practices in software citation

cs.DL astro-ph.IM ·2026-09-30 ·Phil R. Van-Lane, Floor S. Broekgaarden, Daniel S. Katz, Bhavesh Patel, Pengyin Shan +9 more
similarity 0.53
Abstract · 17 pages, 1 figure (including appendices)

Software is both a foundational tool and a primary output of modern computational research, yet citation practices for software remain inconsistent, incomplete, and rarely machine-actionable. Existing infrastructure designed for paper and data citation does not adequately serve the distinct needs of software citation, leaving a gap that impedes reproducibility, misattributes scholarly credit, and obscures the labor embedded in research pipelines. Drawing on a NASA-funded community workshop held in April 2026, we present an analysis of four interconnected themes: (I)~the cultural barriers to consistent citation practice; (II)~the need for clearer community norms and conventions; (III)~gaps in existing technical infrastructure and workflow; and (IV)~the emerging challenges posed by AI-assisted research. For each theme we identify targeted interventions and assign responsibility across stakeholder groups. We conclude that meaningful progress requires simultaneous action on technical and cultural fronts. Journal editors and publishers represent the single highest-leverage point for accelerating this change, and correct citation must become the path of least resistance within researchers' existing workflows.

0.13

LLMCrater: Lifecycle-Aware FAIR Metadata Generation using Large Language Models

cs.SE ·2026-08-24 ·Dani Termaat, Nafiseh Soveizi, Zhiming Zhao, Marios Avgeris
published similarity 0.53
Abstract · 2 pages, 1 figure. Accepted at the 22nd IEEE International Conference on e-Science (eScience 2026)

FAIR (Findable, Accessible, Interoperable, and Reusable) metadata is essential for the discovery, interoperability, and reuse of scientific research assets. However, creating and maintaining FAIR metadata remains largely manual, making the process time-consuming for heterogeneous research artifacts generated throughout the research lifecycle. Existing approaches primarily generate metadata at publication time, missing opportunities to capture contextual information as it becomes available. To address this limitation, we present \emph{LLMCrater}, a lifecycle-aware metadata generation framework that combines Large Language Models (LLMs) with stage-specific RO-Crate metadata profiles. The framework progressively enriches metadata across four research lifecycle stages (Design, Development, Deployment, and Execution \& Provenance) while remaining compatible with RO-Crate~1.1 and EOSC metadata recommendations. It automatically extracts metadata from heterogeneous artifacts, generates and validates machine-actionable RO-Crates, and supports publication to FAIR repositories and PID services (e.g., Zenodo). We demonstrate the approach using two representative use cases: a 5G experimentation environment within SLICES-RI and an experiment on GreenDIGIT's EcoJupyter platform. Results show that LLMCrater progressively enriches metadata throughout the research lifecycle and generates valid RO-Crates conforming to the RO-Crate~1.1 specification.

0.30