CS Paper Radar

ARMD-Predict: multi-site machine learning to predict antibiotic resistance before culture results

Fateme Nateghi Haredasht, Nicholas P. Marshall, Wenyuan Chen, Lauren N. Cooper, Ziming Wei, Harrison Konsker, Jacob S. Chen, Michael Klompas, Cara McKenna, Richard J. Medford, Sanjat Kanjilal, Austin J. Schoeffler, Stephen P. Ma, Niaz Banaei, Steven M. Asch, Amy Chang, Stanley C. Deresinski, Mary K. Goldstein, Robert Tibshirani, Jonathan H. Chen

cs.LG q-bio.QM ·submitted 2026-10-06 01:29 UTC · v1

Abstract

Clinicians select empiric antibiotics before culture susceptibility results are available. Electronic health record (EHR) models could inform that choice, but most are developed at a single hospital and transport poorly to others. We developed ARMD-Predict using 7.5 million culture-antibiotic observations from four academic medical centers. One set of models estimates susceptibility to individual antibiotics; a second, hierarchical set predicts the infecting organism and then organism-specific resistance phenotypes. Across 23 pooled susceptibility models evaluated in same-period, patient-grouped test partitions, median area under the receiver operating characteristic curve (AUROC) was 0.77 for inpatient urine and 0.70 for inpatient blood cultures; chronological retraining reduced AUROC by approximately 0.04. At an exploratory threshold with 95% positive predictive value, derived and evaluated on the same test observations, the model identified 55% of ceftriaxone-susceptible inpatient urine observations as suitable for narrower therapy and flagged 60% of ceftriaxone-resistant observations for broader coverage. Organism classifiers achieved top-3 accuracy of 51.3-83.3%; phenotype AUROCs were conditional on the observed organism. Research applications are available at https://armd-predict.stanford.edu. Independent calibration, threshold and end-to-end prospective validation are required before clinical use.

Comment
31 pages, 4 figures, 2 tables, 7 Extended Data figures, 5 Extended Data tables. Research web applications: https://armd-predict.stanford.edu

Closest papers

Nearest neighbours by meaning across the whole index.

Machine Learning for Pre-Culture ESBL Risk Stratification to Guide Empiric Antibiotic Selection: A 12-Hospital Study of Enterobacteriaceae Cultures

cs.LG stat.AP ·2026-09-05 ·Aravind V. Kuruvikkattil, Lalitha Pranathi Pulavarthy, Rashmita Kudamala, Saptarshi Purkayastha
publishedunusual similarity 0.75
Abstract · Accepted for presentation at American Medical Informatics Association (AMIA) Annual Symposium 2026

Empiric antibiotic therapy for suspected ESBL-producing Enterobacteriaceae must be selected 48-72 hours before culture results, forcing clinicians to choose between undertreating resistant infections and overusing carbapenems that drive further resistance. We developed a cost-sensitive XGBoost model predicting an ESBL phenotype (resistance to ceftriaxone, ceftazidime, cefepime or piperacillin-tazobactam) at culture ordering using 45 pre-culture EHR features across 132,955 cultures from 72,217 patients at 12 hospitals (14.41% with the ESBL phenotype). Cultures were partitioned at the patient level. At 90% sensitivity, the model achieved 95.8% NPV, reducing post-test ESBL probability to 4.2%, a threshold that may support safe carbapenem-sparing in non-ICU settings, while sparing 307 of every 1,000 cultures an unnecessary broad-spectrum course at the cost of 14 missed ESBL cases per 1,000. SHAP analysis identified prior ESBL colonization as the dominant predictor, ahead of prior organism burden and neighborhood deprivation; removing deprivation features caused minimal performance loss ($Δ\text{AUROC} = -0.020$), enabling equitable bedside deployment. Discrimination was unchanged under a strict IDSA ESBL-E definition (AUROC 0.766), with specimen type added as a predictor (0.764) and without any class-imbalance correction (0.762), and ranged from 0.71 to 0.78 across organism strata.

0.36

Routine Blood Tests Outperform CRP for Distinguishing Bacterial From Viral Infection in Children

cs.LG ·2026-09-18 ·Mihaela Demireva, Zhecho Mitev, Djuna Chinareva-Klimentova, Svetoslav Ivanov, Georgi Nalbantov +1 more
similarity 0.65
Abstract

Acute infectious diseases are among the leading causes of medical consultations and hospitalizations in children worldwide. These infections are predominantly caused by viruses or bacteria, yet differentiating between the two remains a common clinical challenge. As a result, pediatricians often default to the safer option of prescribing antibiotics contributing to the growing problem of antimicrobial resistance. The objective is to assess the additional predictive value of CBC towards determining the current infection. This retrospective study used data from 906 pediatric patients aged between 2 and 14 years who were tested positive either for viral or bacterial infection between 2022 and 2026. Inclusion criteria further required availability of CBC results and CRP level measurements. These laboratory parameters as well as age were used as input features for several supervised classification models. Model performance was evaluated using AUC, sensitivity and specificity. The best performing model is XGBoost, which included all features, achieving out of-sample performance of AUC of 81.7% and sensitivity of 70.8%, specificity of 79.2%. All trained models outperform a CRP-based only decision-rule model in terms of AUC. We suggest that the decision to prescribe antibiotics should be based on a number of factors, including but not limited to CBC, some of which are not currently incorporated into routine practice.

0.26

Sign-Constrained Intervention Effects for Domain-Generalizable ICU World Models

cs.CE ·2026-10-08 ·Zhen Xu, Nicholas Konz, Zhen Tan, Zachary Plotkin, Tianlong Chen
similarity 0.54
Abstract · 24 pages, 6 figures, 15 tables

Predicting how a patient's vital signs respond to an intervention is a central question in intensive care. World models can do so by learning dynamics as a function of prior actions. However, such models tend to be brittle outside of training data. Clinicians choose drug dosages based on the patient's state, so the association a model learns between dose and outcome runs opposite to the drug's effect, generalizing poorly to out-of-distribution (OOD) dosing practices. Yet, pharmacological information provides the directional effects of different drugs, which are invariant to OOD shifts. To resolve the OOD sensitivity of current ICU world models, we introduce PHYSIO WORLD, which isolates an intervention's effect by evaluating a forward pass twice: once under recorded doses, and once with those doses set to zero. The difference is projected onto pharmacologically admissible effect directions stated by 70 rules over 28 drugs, leaving the magnitude to be learned from data. Across five distribution-shift parameters over cohorts from three intensive-care databases, and against forecasters, counterfactual models, and invariance objectives, PHYSIO WORLD attains the lowest OOD RMSE in every setting, improving on the strongest external baseline by 8-12%, while matching the in-distribution error of its backbone. Reversing the pharmacological directions degrades accuracy below the backbone, and data-mined directions recover almost no gain, indicating the improvement derives from the content of the pharmacological knowledge. The construction may extend to other settings where the sign of an effect is known in advance and its magnitude is confounded by treatment assignment.

0.17

Large-scale AI-Ready Data for Anti-Cancer Drug Response Modeling

cs.LG q-bio.QM ·2026-08-11 ·Vincent Lavelle, Yitan Zhu, Kaitlyn Marlor, Thomas Brettin, Rick Stevens
benchmarkdataset similarity 0.53
Abstract

Drug response prediction (DRP) models are an active area of research in pharmacogenomics, with growing potential to accelerate the identification of effective anticancer drugs. However, their predictive performance is often constrained by limited dataset scale and insufficient coverages of cancer and chemical spaces. In addition, inconsistent benchmarking practices hinder reliable comparison across models. Standardized frameworks, such as the Innovative Methodologies and New Data for Predictive Oncology Model Evaluation (IMPROVE) project, provide unified data schemas and evaluation protocols for consistent benchmarking, but improving model generalizability requires larger and more diverse training data. In this work, we substantially expand the IMPROVE benchmark through large-scale integration of pharmacogenomic data, primarily from PharmacoDB, together with additional smaller data sources. The expanded resource includes millions of drug response measurements, broader multi-omics coverage, and a major increase in chemical diversity, adding more than 50,000 compounds. To evaluate the impact of the new dataset compared to the original IMPROVE benchmark dataset, we trained DRP models using the two datasets and assess their prediction performance using a common test set and several evaluation strategies, including drug-blind, cancer-blind, and disjoint data splits. While cancer-blind performance remained comparable to the original benchmark, models trained on the expanded dataset showed consistent improvements in drug-blind and disjoint settings, indicating enhanced generalization to previously unseen compounds. These results position the expanded dataset as a community resource that provides a richer foundation for developing DRP models intended to aid in the discovery of novel anticancer drugs.

0.04

Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IV

cs.LG q-bio.QM ·2026-09-14 ·Mohamad Najafi, Hongyun Fu, Mathias Brochhausen, Jian Wu, Yaohang Li
published similarity 0.53
Abstract · 15 pages, 3 figures. Accepted at SDSC 2026 Mid-Atlantic

Recent approaches to 30-day hospital readmission prediction rely on pre-trained language models applied to discharge summaries. Although these methods achieve strong performance, they depend on the availability of clinical notes, incur substantial computational costs, and yield representations that lack interpretability. We propose a knowledge-enriched feature representation that augments structured Electronic Health Record (EHR) data with four medical knowledge sources: disease ontology mapping, procedure classification, drug ingredient vocabulary, and organ system laboratory aggregation, without using clinical notes. Each feature dimension corresponds to a named clinical concept, yielding a sparse and interpretable patient representation. The approach is evaluated with six classifiers on a MIMIC-IV v2.2 cohort. Under 20-fold cross-validation, the best configuration achieves an AUROC of 0.743. This performance is comparable to that of previously reported methods on this dataset, including both those using only structured data and those incorporating clinical notes, while requiring considerably less computational cost. Interpretability analysis shows that demographics, organ system labs, drug ingredient features, and first-level ontology disease categories drive prediction, while deeper hierarchy levels contribute negligibly. These findings indicate that knowledge-enriched structured features offer a competitive and efficient alternative to embeddings from clinical notes for 30-day readmission prediction.

0.25

Machine Learning for Live-Birth Prediction After IVF/ICSI From Structured Clinical Data: A Systematic Review, Meta-Analysis, and Critical Appraisal

cs.LG ·2026-11-04 ·Abdul Raheem Shahzad, Muhammad Zaheer Khan, Umar Ajaib, Asad Ur Rehman, Juan Deng +1 more
surveybenchmarkcode/data similarity 0.53
Abstract · 20 pages, 4 figures, 6 tables; supplementary material (26 pages) in ancillary files. Data and code: https://github.com/abdul-raheem-shahzad/…

Machine-learning models predicting live birth after in vitro fertilisation (IVF) or intracytoplasmic sperm injection (ICSI) from routine clinical data report performance from near chance to near perfect. We systematically reviewed these models under PRISMA 2020, searching OpenAlex, Scopus and Web of Science to 22 October 2026, appraised them with PROBAST+AI and TRIPOD+AI, and pooled their discrimination with random-effects meta-analysis on the logit scale. We define what fixes the meaning of a model's output (decision point, endpoint, unit of analysis, data source) and map the 48 included studies by model family, decision point and validation design. Models evaluated only internally pooled to an area under the receiver operating characteristic curve (AUC) of 0.814, against 0.756 (95% prediction interval 0.546-0.889) for models evaluated on a later period or another centre, and 0.764 for studies not at high risk of bias; neither difference was significant, and heterogeneity was extreme. Models whose decision point was not stated pooled to 0.910, the only significant moderator in meta-regression. Against logistic regression fitted to the same data, the best machine-learning model gained a pooled 0.056 AUC (95% CI 0.017-0.090). Of 48 studies, 47 were at high or unclear risk of bias, only four assessed the calibration slope, and no model has evidence of clinical impact. The certainty of the pooled evidence is low to very low; the gains that survive validation came from staging predictions to decision points and local calibration, not deeper architectures. We provide a TRIPOD+AI-mapped checklist, a benchmark specification and a research agenda.

0.39

From Mutation to Medication: Characterizing Failures of Clinical LLMs to Respect Genomic Resistance

cs.AI cs.LGq-bio.GN ·2026-11-14 ·Negin Ashrafi, Roxana Daneshjou
top venue similarity 0.52
Abstract · Accepted for publication in the Proceedings of the Machine Learning for Health (ML4H) 2026 Symposium

Language models are increasingly proposed to support molecular tumour boards, but may recommend cancer therapies despite genomic evidence of resistance. We evaluated ten models on 1,464 resistance cases from five curated oncology knowledge bases, collecting 58,910 judgments. Models endorsed resisted therapies in 21.8-81.4% of cases. However, raw rates can reflect a tendency to agree rather than an ability to distinguish resistance from drug sensitivity: one open-weight model endorsed 81.4% of resistance cases and 82.3% of sensitivity controls. We therefore compared endorsement within matched gene and evidence-level groups. This analysis is exploratory because it was specified after the pre-registered analysis, which yielded null-to-weak results. Measured failures depended strongly on the reference knowledge base and evidence strength. When a second source independently confirmed resistance, four models across three vendors endorsed at most 2.4% of cases; at weaker evidence tiers, discrimination was not measurable. Models sometimes acknowledged resistance yet recommended the therapy. Repeating a model's own resistance conclusion reduced endorsement to 0.0-3.5% on cases where it had stated resistance. Falsely attributing the opposite conclusion increased endorsement above baseline for all seven hosted models, reaching 95.2% for GPT-4o; an instruction without an attributed conclusion changed endorsement by only 0.9 percentage points. Providing the correct curated evidence reduced unqualified strong recommendations to 0.3-3.5%, testing evidence use under an oracle condition rather than retrieval.

0.40

PDO Drug Screening Data for Evaluating and Training AI Drug Response Prediction Models

cs.AI q-bio.QM ·2026-11-11 ·Y. Zhu, K. Marlor, V. Lavelle, T. S. Brettin, M. Sacco +4 more
code/data similarity 0.52
Abstract

Anti-cancer drug response prediction (DRP) is critically important for precision oncology and therapeutic development. Currently, most DRP models are developed using drug screening data from immortalized cancer cell lines, which can differ substantially from patient tumors at the genomic and molecular levels, even though patient tumor response is the ultimate prediction target. To help bridge this gap and bring DRP models closer to their intended clinical application, we conducted four drug screening studies using patient-derived organoids (PDOs), which more faithfully recapitulate patient tumors than immortalized cell lines. These studies generated data for improving and evaluating DRP models, including multi-omics profiles of PDO lines, drug feature data, and treatment response measurements. Using these data, we retrained and evaluated multiple publicly available DRP models under three model-building scenarios: training models using cell line data only, training models using combined cell line and PDO data, and pretraining models on cell line data followed by fine-tuning on PDO data. We then evaluated and compared model prediction performance on PDOs across these analysis scenarios. In addition, we also assessed the consistency of drug screening viability data generated by different laboratories using different assay technologies and/or experimental protocols.

0.36