CS Paper Radar

An Open-Source Data Infrastructure for Alloy Synthesis Research: Stage 1 --- Composition Screening and Literature Cross-Referencing

Iliya Angelov Radulov

cs.DL cond-mat.mtrl-sci ·submitted 2026-10-04 07:00 UTC · v1
positioncode/data

Abstract

Experimental materials-science labs routinely accumulate synthesis and characterization data across spreadsheets, instrument export files, and ad-hoc folders, with no durable link between a sample's recipe, its measured properties, and whether a similar composition has been reported elsewhere. We present Stage 1 of an open-source data infrastructure closing this loop for a single working alloy-synthesis lab: a relational schema for composition and synthesis records, a strict composition/mass calculator, three empirical alloy-design screening metrics (VEC, atomic-size mismatch, mixing enthalpy) plus a melt/boil-point synthesis-feasibility check, an automated cross-referencing layer against three public materials databases (Materials Project, OQMD, Alexandria) with deduplication and adjustable relevance filtering, and a desktop GUI unifying the workflow behind a single "new entry" action. Built and used by a practicing researcher rather than a software team, we report it as a systems/methodology contribution - the architecture, the concrete engineering failures encountered while building it, and how each was diagnosed and fixed - rather than new materials-science results. We argue the specific defects found - a parser ambiguity that produced silent wrong answers, a partial code edit that broke a dependency chain invisibly, a database-metadata bug traceable to an un-cast numeric type, and a credential-hygiene gap that .gitignore alone did not close - generalize to any small scientific-software project built by a domain expert without formal software-engineering training. Both the system and the lessons from building it are reported here; two follow-on papers cover the validated characterization pipelines (Stage 2) and the retrieval-augmented synthesis advisor and CALPHAD thermodynamics module (Stage 3) built on this foundation.

Closest papers

Nearest neighbours by meaning across the whole index.

ORCHID-SAGE: Fully Reproducible CALPHAD Assessment from Evidence to Phase Diagram

cs.AI cond-mat.mtrl-sci ·2026-11-12 ·Raymundo Arróyave
positioncode/data similarity 0.62
Abstract · 24 pages, 19 figures. Code and data: https://github.com/orchid-calphad/orchid-sage (doi:10.5281/zenodo.24045967); assessment record doi:10.5…

Knowledge of phase stability is the first requirement for materials design, and predicting the conditions under which new materials can be synthesized has become a key capability of self-driving laboratories (SDLs). For inorganic materials, notably alloys, these predictions come from thermodynamic databases built with the CALPHAD method. Building a database, however, requires expert judgment at many steps, and because these decisions are rarely recorded, others can use a database but cannot regenerate or update it. Machines can already collect the data, build a first model with machine-learned interatomic potentials and refine it against experiments. The assessment itself, the sequence of judgments that turns these parts into a reliable database, is still carried out by human experts. We argue that it can be automated reproducibly only if the expert knowledge behind an assessment is encoded in formal protocols, so that an assessment delivers a record of its construction and not only its parameters. We introduce ORCHID-SAGE, a standard that organizes this record into reproducible and automatable protocols. In this first attempt, applied to Cr-Ni, the database was regenerated from its record by a script on a second machine, by an AI agent working only through the Model Context Protocol (MCP) and by a refit from public sources only, with the same predictions. Recorded in this way, a database need no longer be fixed at publication but can be updated by AI agents as SDLs and other sources provide new evidence, while the judgment remains with people and on the record.

0.38

Benchmarking language models and agents for scientific reasoning in evolving materials laboratories

cs.AI cond-mat.mtrl-scics.CEcs.LG ·2026-11-09 ·Xuyu Dong, Yixuan Li, Jianguo Huang, Feng Chen, Yiyun Zhou +3 more
similarity 0.61
Abstract · 36 pages, 5 figures, 2 tables

Large language models and the multi-agent systems built around them could accelerate materials discovery by connecting scientific knowledge with experimental decisions. Existing benchmarks establish capabilities in domain knowledge, multimodal interpretation and scientific tool use. As language models increasingly support materials research workflows, their ability to distinguish closely related material states and reason accurately with quantitative evidence remains insufficiently evaluated. These abilities are essential for comparing material responses, assessing mechanisms and maintaining reliable judgements as experimental evidence accumulates. We introduce MatScope to evaluate three connected capabilities. M1 tests unaided, condition-specific reasoning through 200 tasks spanning ten research functions, using aluminium and high-entropy alloys as representative material systems. M2 tests agent-assisted transfer of related knowledge to unresolved materials questions. MatEvoBench-20 tests initial forecasts across scientific dependency chains and revisions of still-hidden responses as observations accumulate. Across eleven model deployments, including GPT-6 Astra and Claude Fable 5.1, given-input calculations and many physical explanations are handled well. Fine-grained response estimates, comparisons between similar states and quantitatively supported choices remain substantially weaker. Related literature improves selected estimates, while condition and baseline mismatches limit transfer. Progressive observations calibrate some downstream responses and destabilize earlier accurate predictions. MatScope establishes measurable targets for developing reliable scientific reasoning in future self-evolving materials laboratories and materials-aware world models.

0.15

Complex materials engineering via Provenance Action Graphs: potential, structure and demonstration

cs.AI cond-mat.mtrl-sci ·2026-10-13 ·Yevgeny Rakita, Paul Todd, James R. Neilson, Simon J. L. Billinge
similarity 0.59
Abstract · 13 pages, 8 figures

This work discusses and tests the potential of reaction graphs for material synthesis, in which events consist of reaction steps (actions) and their outputs (observations). The importance comes from the requirement to synthesize technologically useful materials, especially those that are kinetically stabilized. Often, it is a science that follows years of trial and error, culminating in (published) successful recipes, but is truly driven by far more (unpublished) failures. The entry into the era of AI provides an opportunity to use learning algorithms to encode rules from multi-dimensional synthesis pathways, regardless of their technological usefulness, and to decode both forward prediction and inverse learning modes. The main incentive is to accelerate material discovery by generating a global knowledge base that can be shared among data agents and contributed to by them. We will focus on several scenarios in the common synthesis process during solid-state synthesis, primarily because these reactions are kinetic in nature and require closer monitoring and control of the reaction history.

0.28

What Do LLMs Use to Judge Synthesis Recipes? An Experimental Analysis on 240 Solid-State Syntheses

cs.CE cond-mat.mtrl-sci ·2026-11-17 ·Derek van Tilborg, Laura-Bianca Pasca, Harry Sevi, Kyle Reeves, Thomas Loux +4 more
publishedbenchmark similarity 0.59
Abstract · 23 pages, 13 figures, NeurIPS Ai4Mat

Inorganic materials discovery is increasingly limited by synthesis rather than by material design. Large language models (LLMs) are being adopted to propose synthesis conditions with little experimental evidence of their capabilities and biases. Here, we carry out an experimental synthesis benchmark of 240 experiments across eight known and unknown inorganic oxides and subsequently evaluate an LLM as a zero-shot ranker over fixed banks of solid-state synthesis recipes. For each pair of recipes for the same oxide target, `GPT-5.6-Sol` selects the recipe expected to yield higher target-phase purity. We aggregate these pairwise preferences using a regularized Bradley-Terry model to obtain a ranked list of synthesis recipes for a given target material. By comparison with the actual purity, obtained through X-ray diffraction, we measure `GPT-5.6-Sol`'s performance as a zero-shot ranker (0.72 pairwise accuracy). By selective removal of the information exposed to the model during this ranking, we conclude that ranking is driven predominantly by thermal features, with reaction chemistry modulating the effect. Ranking accuracy tracks the purity-temperature correlation by target (Spearman ρ= 0.91\), \(p = 0.002\), and on the six thermally-driven targets withholding all chemical identity hardly impacts performance (0.68) compared to withholding temperature (0.56). Ranking performance was higher on known than unknown targets, but the group-level difference was not statistically conclusive. The methodological choices highlight the need for more experimentally validated synthesis benchmarks and position LLMs as a thermally informed prior.

0.54

Evaluating LLM-based AI agents integrated with materials synthesis tools: the case of atomic layer deposition

cs.AI cond-mat.mtrl-sciphysics.app-ph ·2026-08-29 ·Angel Yanguas-Gil
survey similarity 0.59
Abstract · Invited prospective paper submitted to MRS Communications

This work provides an overview of the different strategies that can be used to evaluate the performance of AI models and agents based on large language models (LLMs) for materials synthesis. After providing a brief overview of the key technologies behind the current generation of AI agents based on LLMs, we summarize the different approaches to evaluating these models in the context of materials science and in particular on materials synthesis, with a specific emphasis on scenarios in which the models are directly integrated with experimental tools. We discuss evaluation strategies spanning knowledge and reasoning benchmarks, tool-use benchmarks, and closed loop benchmarks involving the interaction with experimental systems or realistic virtual tools. We use atomic layer deposition (ALD) as a case study, emphasizing how existing approaches in the literature both build from general approaches used beyond materials science and can be generalized to other materials synthesis techniques. Finally, we provide a practical evaluation framework to evaluate LLMs in the context of materials synthesis

0.46

Hypothesis-Driven Autonomous Materials Synthesis with Multimodal LLM Agents

cs.AI cond-mat.mtrl-sci ·2026-09-16 ·Izumi Takahara, Kazunori Nishio, Akira Aiba, Shigeru Kobayashi, Takao Nakajima +2 more
similarity 0.59
Abstract

Self-driving laboratories can explore synthesis conditions autonomously, but their decision-making layer is typically a black-box optimizer, and the output is a set of optimized samples, with the measurements reduced to predefined scalar objectives and the reasons behind success left unarticulated. Here we present SynAgent, a framework in which large language model agents operate an automated experimental system and maintain an explicit, revisable understanding of the synthesis process as the campaign's primary output. Starting with no predefined analysis pipeline, SynAgent adaptively generates analysis skills for newly acquired data and evolves this understanding through multimodal reasoning over experimental data such as X-ray diffraction patterns and electron micrographs. The evolution is guided by a verify-falsify scheme, in which the agent deliberately challenges its own hypotheses by testing conditions predicted to fail as well as those predicted to succeed. In a single campaign of 18 autonomous experiments using LiCoO2 (001) thin-film deposition as a testbed, SynAgent synthesized highly crystalline films and evolved an understanding of how the substrate temperature governs crystallization, discovering an abrupt threshold and a narrow optimal growth window at 650-690 °C. These results extend autonomous experimentation beyond optimized samples to testable, human-readable understanding.

0.28

CP-Agent: A Harness-Engineered Agent for Crystal Plasticity Simulation Workflows

cs.AI cond-mat.mtrl-sci ·2026-09-25 ·Samuel Onimpa Alfred, Abhishek Kumar, Veera Sundararaghavan
similarity 0.57
Abstract · 37 pages, 9 figures

Crystal plasticity (CP) simulations predict the mechanical behavior of polycrystalline metals, yet their routine use is hindered by the manual effort of configuring heterogeneous tools, orchestrating multi-step data pipelines, and calibrating constitutive parameters against experiments. These bottlenecks impede productivity in systematic parameter studies, motivating interest in automated workflows. This study presents CP-Agent, a harness-engineered LLM-based agent that autonomously executes complete CP modeling workflows from natural-language tasks. Operating under the ReAct paradigm, the agent reasons about tool selection and sequencing while delegating numerical search to established optimizers. The harness comprises a minimal system prompt, typed tool definitions, a dispatcher, and a safety-bounded iteration loop, encoding domain knowledge through tool schemas rather than hard-coded logic. CP-Agent is demonstrated on four case studies: calibrating four slip parameters of additively manufactured stainless steel 316L against tensile data; validating the workflow against published copper benchmarks, reproducing stress-strain and texture evolution; recovering the initial crystallographic texture of copper, where the agent correctly identifies a diffuse initial texture; and reproducing the multi-pass rolling texture evolution of a Mg-Zn-Ca alloy, where the agent chains five deformation passes and recovers the experimentally observed weakened, split basal texture. In all cases, the agent inferred the correct execution sequence from the task statement, robustly across repeated runs, and delivered physically interpretable results. This work establishes harness engineering as a systematic approach to automating CP modeling workflows while maintaining physical interpretability and auditability through visible reasoning traces.

0.20

Probing the limits of forward screening and inverse design of crystal materials

cs.LG cond-mat.mtrl-sci ·2026-10-23 ·Zhilong Song, Zijun Pang, Lixue Cheng
hot direction similarity 0.57
Abstract · 23 pages, 5 figures

Crystal materials are designed either by screening known crystals for a target property or by generating new crystals with that property. Both routes are judged against public databases of known crystals, but these databases name the same crystal differently. Several materials announced as new by recent generative and autonomous discovery campaigns have since proved to be known phases or close variants of them. The limits of both routes remain unmeasured. Here we probe them by matching the crystals of 55 databases by structure into one self-extending database of 14.6 million crystals and 131.8 million property values, each traced to its source. Only 4.5% of its crystal-property pairs carry a value. To fill the empty pairs, we developed CGTNet, an equivariant graph transformer with state-of-the-art accuracy on several tasks of two public benchmarks. Trained on each task, it forms a library of property models whose predictions we release. The reach of forward screening has been underestimated. Known crystals hold tens of thousands of ultra-incompressible candidates without a recorded bulk modulus, and a post hoc audit of synthesis evidence finds among them ReN2, whose bulk modulus was measured at 428 GPa. The novelty claimed for inverse design has been overestimated. At an equal verification budget, a stiffness-conditioned generator returned more stiff hits than screening (100 versus 55), but all contained osmium and 82 repeated recorded compositions. Integrating and completing the databases of known crystals therefore moves the limits of both routes: it widens what screening can reach and sets the reference against which generated crystals are judged new.

0.33