CS Paper Radar

Reference Manual of MEDiml

Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum, Ben Coull-Nveu, Duran Juan, Mariem Kallel, Hakima Laribi, Oliver Lefebvre, Nicolas Longchamps, Thanh-Tri Nguyen, Steven Ravary, Ouael Nedjem Eddine Sahbi, Jérémy Dana, Martin Vallières

cs.SE physics.med-ph ·submitted 2026-10-21 12:41 UTC · v1
code/data

Abstract

Radiomics is the high-throughput extraction of quantitative features (e.g., tumor shape, intensity distributions, and texture) from medical images to characterize tissues and uncover disease patterns invisible to the human eye. These features can serve as candidate imaging biomarkers for cancer diagnosis, prognosis, and classification. However, extracting thousands of features makes it difficult to identify the most informative ones for a given clinical task, while implementing an end-to-end workflow can require programming expertise that limits accessibility for clinical researchers. Hence, we propose MEDiml, an open-source, standards-compliant radiomics platform connecting feature extraction, predictive modeling, and interpretation through complementary graphical and programmatic interfaces. MEDiml combines a Python package (MEDiml-pkg) with a graphical desktop application (MEDiml-app) that enables researchers to conduct experiments without writing code. Both interfaces use the same computational implementation, and code generation exports graphically configured workflows as executable Python code, facilitating reproducibility and collaboration between clinical researchers and computational scientists. A typical MEDiml workflow includes image preprocessing, radiomic feature extraction, feature set reduction, model training and evaluation, and interpretation using feature importance. Feature sets can be grouped into levels of radiomic complexity (morphological, intensity-based, textural, and filter-based) to evaluate whether more complex features provide additional predictive value. This reference manual documents the radiomics concepts, workflow, software components, architecture, and installation, compares MEDiml with existing tools, and demonstrates its complexity-driven workflow on five oncological imaging cohorts comprising 2,104 patients. Resources: www.mediml.app.

Comment
39 pages, 18 figures, 2 tables. Software, documentation, tutorials, and all software resources are available at https://www.mediml.app

Closest papers

Nearest neighbours by meaning across the whole index.

Medical Image Analysis with Machine Learning (MEDiml): Strategies for Simpler Radiomics

eess.IV physics.med-ph ·2026-10-27 ·Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum +11 more
code/data similarity 0.88
Abstract · 11 pages, 3 figures, 2 tables. Software paper. Full reference manual: arXiv:2610.29666 . Software, documentation, tutorials, and resources a…

Radiomics extracts quantitative features describing tumor shape, intensity, and texture from medical images to build models that predict clinical outcomes. However, large feature sets increase the risk of overfitting in small datasets, and building an end-to-end workflow often requires programming expertise. We present MEDiml (Medical Image Analysis with Machine Learning), open-source radiomics software available as a Python package (MEDiml-pkg) and a no-code desktop application (MEDiml-app). Both run on the same computational engine, and code generation exports graphically configured workflows as executable Python code. Feature extraction follows the Image Biomarker Standardization Initiative (IBSI) standards. MEDiml is built around complexity minimization: features are grouped into levels of increasing complexity (morphological, intensity, textural,l and filter-based), a model is trained at each level, and the simplest level not significantly outperformed by more complex ones is retained. Applied to five oncological datasets (2,104 scans), MEDiml achieved AUCs of 0.65 to 0.82, with morphological or intensity features sufficient in four of the five tasks. Resources: www.mediml.app.

0.28

TIAgent: From Natural Language to Grounded Agentic Workflows for Computational Pathology

cs.AI q-bio.QMcs.CLcs.MA ·2026-09-30 ·Aakash Madhav Rao, Mark Eastwood, Danielle Belgrave, Fayyaz Minhas
benchmark similarity 0.62
Abstract

Computational pathology (CPath) analyses increasingly depend on multi-step computational workflows that require substantial programming expertise, limiting their accessibility to pathologists and other domain experts without extensive coding experience. Although large language models (LLMs) provide a promising natural-language interface for constructing such analyses, hallucinated operations and incorrect workflow specifications limit their reliability in scientific settings. We introduce Tissue Image Analysis Agent (TIAgent), an automated CPath workflow generation framework that, given a natural-language prompt specifying a complex analytical task together with an input dataset, automatically constructs a verifiable computational graph employing existing CPath operations. The resulting graph can be inspected and executed, enabling natural-language construction of complex CPath workflows for applications including automated biomarker discovery and tissue analysis. We demonstrate end-to-end workflow generation and execution and systematically benchmark 14 backbone LLMs across 90 unit tasks spanning 18 CPath operation types. The ability of each LLM to generate a complete and correct unit workflow is quantified using Unit Workflow Success (UWS). Performance varied substantially across backbone models, with Kimi-K2.7-Code achieving the highest UWS of 0.967 (95% CI: 0.907-0.989). Analysis of node and parameter correctness further revealed that selecting the appropriate computational operation and correctly configuring it represent distinct challenges for LLM-based workflow generation. TIAgent provides a foundation for making complex CPath workflow construction more accessible while enabling systematic evaluation of LLM-driven scientific workflow generation.

0.20

MedUAG: Unified Understanding and Generation for Medical Multimodal Models

cs.CL cs.AI ·2026-08-19 ·Zijie Meng, Yuncheng Zhang, Hualiang Wang, Yitian Tang, Xiaotang Gai +6 more
benchmark similarity 0.61
Abstract

Recent Multimodal Large Language Models (MLLMs) are rapidly evolving into unified understanding and generation (UAG) frameworks. However, extending these unified paradigms to the medical domain is hindered by: the absence of comprehensive training and evaluation benchmarks, and the lack of broadly validated unified medical model. To address these gaps, we present a comprehensive foundation for medical UAG. First, we construct MedUAGCorpus, the largest unified medical understanding and generation dataset to date, comprising over 6 million instances across 14 imaging modalities. Second, we introduce MedUAGBench, a systematic benchmark that expands medical generation evaluation to 12 diverse tasks under standardized protocols. Finally, leveraging these resources, we develop MedUAG, an end-to-end trained unified medical model. Extensive experiments demonstrate that MedUAG achieves strong performance across a wide array of understanding and generation tasks, establishing a competitive baseline and paving the way for next-generation medical multimodal systems.

0.21

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

cs.CV ·2026-09-10 ·Boya Wang, Ruizhe Li, Chao Chen, Xin Chen
published similarity 0.61
Abstract · 12 pages, 2 figures. Accepted by AIiH

Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural color images and multi-channel medical scans. We present a unified, patch-based framework that processes raw multimodal imaging through training-free registration, automated localization, and mask-filtered patch extraction. This architecture culminates in a hierarchical strategy that aggregates patch-level insights into subject-level diagnostics. Using liver fibrosis staging as a case study, we evaluate four patch-level feature representations: handcrafted Radiomics features, learned ResNet features, pre-trained foundation model SAM-Med2D features, and frozen DINOv3 features. To ensure a controlled comparison, all models utilize the same lightweight MLP head and are evaluated across both rigid and deformable registration settings. Our training protocol focuses on mild fibrosis (S1) and cirrhosis (S4) classes only, enabling a single classifier to address both substantial fibrosis detection and cirrhosis staging. Evaluated via 10 random train (90%)/ test (10%) splits on 360 subjects from the CARE 2025 Liver Track 4 cohort, our DINOv3-based framework significantly outperforms all baselines, achieving the best classification accuracy of 78.4% for S1 and 75.8% for S4.

0.43

MIST: Multimodal Survival Prediction with Genomic-Guided Histology Attention

cs.AI cs.CV ·2026-09-18 ·Muhammet Sami Yavuz, Sabri Mustafa Kahya, Richard R. Chen, Jana Lipkova, Benedikt Wiestler
publishedcode/data similarity 0.61
Abstract · Accepted at the COMPAYL 2026 Workshop on Computational Pathology and Multimodal Data at MICCAI 2026. 11 pages, 2 figures, 4 tables

Multimodal survival models can combine complementary prognostic information from whole-slide images and genomic profiles, but effective fusion remains challenging amid external cohort shift and computational complexity. To address these challenges, we propose MIST, multimodal survival prediction with genomic-guided histology attention. MIST represents genomic features as tokens and allows them to query compact foundation-model-derived histology context tokens before survival prediction. This design enriches molecular information with histology context rather than merging separately encoded modalities only at the final stage. Training combines discrete-time survival prediction with genomic feature masking, WSI dropout, and paired WSI-genomics contrastive alignment. Across four external evaluations in colon, renal, lung, and glioblastoma cohorts, MIST improves external C-index over standard fusion baselines in the primary comparisons. These results support genomic-guided histology attention as a compact and effective strategy for multimodal oncology outcome prediction. Our code is available at https://github.com/samiyavuuz/MIST .

0.34

Pre-training, Reasoning, Benchmarking: X-ray Report Generation on CheXpert Plus Dataset

cs.CV cs.AI ·2026-09-23 ·Xiao Wang, Yuxiang Zhang, Dan Xu, Yuehang Li, Shiao Wang +4 more
benchmarkcode/data similarity 0.60
Abstract

X-ray image-based Radiology Report Generation (RRG) constitutes a critical research direction within medical artificial intelligence, with great potential to alleviate clinicians' diagnostic workload and shorten patient waiting periods. Despite substantial advances over recent years, the field faces evident bottlenecks stemming from insufficient standardized benchmarks and inadequate domain adaptation of generic large models. Notably, the newly released CheXpert Plus dataset is provided without accompanying baseline implementations and evaluation results, which impedes standardized training, quantitative evaluation and fair comparison among follow-up algorithms. To mitigate this limitation, we establish a comprehensive benchmark encompassing prevailing X-ray report generation models and Large Language Models on CheXpert Plus. This benchmark delivers a reliable comparative foundation for upcoming methods and enables researchers to rapidly identify state-of-the-art approaches within this domain. Beyond benchmark construction, we rethink X-ray RRG under the paradigm of large models and propose a novel framework termed MambaXray-PRB. Our framework improves report generation performance and enhances model interpretability via multi-stage large-model pre-training and multi-modal Chain-of-Thought reasoning. The pipeline consists of three successive phases: self-supervised auto-regressive modeling, X-ray-report contrastive learning, and post-training optimization for reasoning and report generation. Extensive experiments on IU X-ray, MIMIC-CXR, and CheXpert Plus datasets validate the effectiveness of MambaXray-PRB for radiology report generation. The source code of this paper is available on https://github.com/Event-AHU/Medical_Image_Analysis

0.32

Sharing standardized image-derived data in computational pathology using DICOM

cs.CV cs.AIcs.LG ·2026-09-13 ·Daniela P. Schacherer, Christopher P. Bridge, David Clunie, Igor Octaviano, André Homeyer +11 more
code/data similarity 0.59
Abstract · Daniela P. Schacherer, Christopher P. Bridge: contributed equally

Development and evaluation of computational pathology methods require access to large and diverse datasets. Over the past decade, various initiatives invested significantly into collecting, centralizing, and sharing pathology imaging data. In contrast, sharing of image-derived data such as region-of-interest delineations or segmentation masks is less well developed. In this work, we describe our approach to encoding and sharing image-derived pathology data in a standardized manner within the National Cancer Institute (NCI) Imaging Data Commons (IDC), a platform that hosts and provides public access to de-identified radiology and pathology data. The IDC relies on the Digital Imaging and Communications in Medicine (DICOM) standard for data harmonization, yet the adoption of DICOM for pathology image-derived content has remained largely unexplored until now. Here, we present five representative datasets harmonized by conversion from their original representations into DICOM and shared publicly in the IDC. We demonstrate the benefits of this harmonization, describe contributions to critical open-source tooling, and discuss technical considerations relevant to broader adoption of DICOM for pathology image-derived data.

0.22

Glyph: An Interpretability Engine for AI-Driven Scientific Discovery in Clinical Data

cs.AI ·2026-11-06 ·Robbie Holland, Ashwin Kumar, Mateus A. Esmeraldo, David Le, Andrea Fisher +17 more
code/data similarity 0.59
Abstract

Automated scientific discovery has the potential to advance understanding of disease mechanisms and accelerate identification of early disease markers. Manual data annotation is infeasible at population scale, motivating methods that automatically extract pre-defined phenotypes in multimodal and unstructured clinical data. Such pre-defined feature sets determine and limit which associations these approaches can discover. This limitation extends to agentic AI systems that use these tools to query population-scale data. In contrast, foundation models (FMs) trained on large volumes of clinical data can perform tasks beyond their training objectives. This suggests their latent embeddings may represent novel or unexplored features that could yield insights into disease mechanisms, yet such latent features remain difficult to interpret. To address this challenge, we introduce Glyph, an automated multistage framework that extracts features from multimodal and unstructured clinical data using FMs and sparse autoencoders, interprets them as coded clinical concepts, and evaluates their value for clinical scientific discovery. We applied Glyph to abdominal CT volumes, CT radiology reports and laboratory measurements from 41,628 patients across different institutions. We identified 397 predictive concepts supported by 4,463 Bonferroni-significant associations. Moreover, a majority of discovered associations were automatically reproducible in held-out cohorts across different sites. Glyph concepts provided complementary associations to literature-derived markers, leading to gains in predictive power. We envision that interpretability can extend beyond a mechanistic understanding of neural networks to connecting implicitly learned features with clinical knowledge and establishing their significance for patient outcomes. We release Glyph at https://github.com/StanfordMIMI/Glyph.

0.40