CS Paper Radar

Medical Image Analysis with Machine Learning (MEDiml): Strategies for Simpler Radiomics

Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum, Ben Coull-Neveu, Juan Duran, Mariem Kallel, Hakima Laribi, Oliver Lefebvre, Nicolas Longchamps, Thanh-Tri Nguyen, Steven Ravary, Ouael Nedjem Eddine Sahbi, Jérémy Dana, Martin Vallières

eess.IV physics.med-ph ·submitted 2026-10-27 03:42 UTC · v1
code/data

Abstract

Radiomics extracts quantitative features describing tumor shape, intensity, and texture from medical images to build models that predict clinical outcomes. However, large feature sets increase the risk of overfitting in small datasets, and building an end-to-end workflow often requires programming expertise. We present MEDiml (Medical Image Analysis with Machine Learning), open-source radiomics software available as a Python package (MEDiml-pkg) and a no-code desktop application (MEDiml-app). Both run on the same computational engine, and code generation exports graphically configured workflows as executable Python code. Feature extraction follows the Image Biomarker Standardization Initiative (IBSI) standards. MEDiml is built around complexity minimization: features are grouped into levels of increasing complexity (morphological, intensity, textural,l and filter-based), a model is trained at each level, and the simplest level not significantly outperformed by more complex ones is retained. Applied to five oncological datasets (2,104 scans), MEDiml achieved AUCs of 0.65 to 0.82, with morphological or intensity features sufficient in four of the five tasks. Resources: www.mediml.app.

Comment
11 pages, 3 figures, 2 tables. Software paper. Full reference manual: arXiv:2610.29666 . Software, documentation, tutorials, and resources are available at https://www.mediml.app

Closest papers

Nearest neighbours by meaning across the whole index.

Reference Manual of MEDiml

cs.SE physics.med-ph ·2026-10-21 ·Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum +11 more
code/data similarity 0.88
Abstract · 39 pages, 18 figures, 2 tables. Software, documentation, tutorials, and all software resources are available at https://www.mediml.app

Radiomics is the high-throughput extraction of quantitative features (e.g., tumor shape, intensity distributions, and texture) from medical images to characterize tissues and uncover disease patterns invisible to the human eye. These features can serve as candidate imaging biomarkers for cancer diagnosis, prognosis, and classification. However, extracting thousands of features makes it difficult to identify the most informative ones for a given clinical task, while implementing an end-to-end workflow can require programming expertise that limits accessibility for clinical researchers. Hence, we propose MEDiml, an open-source, standards-compliant radiomics platform connecting feature extraction, predictive modeling, and interpretation through complementary graphical and programmatic interfaces. MEDiml combines a Python package (MEDiml-pkg) with a graphical desktop application (MEDiml-app) that enables researchers to conduct experiments without writing code. Both interfaces use the same computational implementation, and code generation exports graphically configured workflows as executable Python code, facilitating reproducibility and collaboration between clinical researchers and computational scientists. A typical MEDiml workflow includes image preprocessing, radiomic feature extraction, feature set reduction, model training and evaluation, and interpretation using feature importance. Feature sets can be grouped into levels of radiomic complexity (morphological, intensity-based, textural, and filter-based) to evaluate whether more complex features provide additional predictive value. This reference manual documents the radiomics concepts, workflow, software components, architecture, and installation, compares MEDiml with existing tools, and demonstrates its complexity-driven workflow on five oncological imaging cohorts comprising 2,104 patients. Resources: www.mediml.app.

0.35

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

cs.CV ·2026-09-10 ·Boya Wang, Ruizhe Li, Chao Chen, Xin Chen
published similarity 0.65
Abstract · 12 pages, 2 figures. Accepted by AIiH

Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural color images and multi-channel medical scans. We present a unified, patch-based framework that processes raw multimodal imaging through training-free registration, automated localization, and mask-filtered patch extraction. This architecture culminates in a hierarchical strategy that aggregates patch-level insights into subject-level diagnostics. Using liver fibrosis staging as a case study, we evaluate four patch-level feature representations: handcrafted Radiomics features, learned ResNet features, pre-trained foundation model SAM-Med2D features, and frozen DINOv3 features. To ensure a controlled comparison, all models utilize the same lightweight MLP head and are evaluated across both rigid and deformable registration settings. Our training protocol focuses on mild fibrosis (S1) and cirrhosis (S4) classes only, enabling a single classifier to address both substantial fibrosis detection and cirrhosis staging. Evaluated via 10 random train (90%)/ test (10%) splits on 360 subjects from the CARE 2025 Liver Track 4 cohort, our DINOv3-based framework significantly outperforms all baselines, achieving the best classification accuracy of 78.4% for S1 and 75.8% for S4.

0.43

Radiomics--Foundation Fusion for Interpretable RCC Classification: Internal Benchmarking and Exploratory External Transfer

cs.CV ·2026-09-22 ·Yuan Liang, Fangyijie Wang, Kathleen M. Curran, Guénolé Silvestre, Sourav Bhattacharjee +1 more
published similarity 0.64
Abstract · Accepted for an oral presentation at CaPTion 2026, a MICCAI 2026 workshop. 11 pages, 3 figures

Accurate preoperative subtype classification of renal cell carcinoma (RCC) from contrast-enhanced CT remains clinically challenging because clear cell RCC (ccRCC) and non-clear cell RCC often show overlapping imaging appearances. This study evaluates whether foundation representations reduce reliance on handcrafted radiomics, or whether radiomics remains complementary for interpretable tumour characterisation. We compared radiomics, conventional CNN features, MedicalNet-pretrained features, MedVAE representations, and fusion variants for binary ccRCC classification on KiTS23, reporting area under the receiver operating characteristic curve (AUC) with bootstrap confidence intervals and average precision (AP) as a complementary class-imbalance-sensitive metric. We further assessed branch-removal ablation, TCGA/AIMI external transfer, and interpretability using radiomics permutation importance and gate-level analysis. Internally, 3D MedVAE gated fusion achieved the best performance, with an AUC of 82.7% and AP of 92.2%. On the external TCGA cohort, the same model achieved an AUC of 79.5% and AP of 98.9%, although specificity remains uncertain because only two external non-ccRCC cases were available. Gate analysis showed a radiomics-dominant fusion regime, suggesting that foundation representations acted as case-dependent refinement signals rather than replacements for structured tumour descriptors. These findings support radiomics as a complementary and clinically interpretable component of CT-based RCC characterisation in the foundation-model era.

0.42

OpenMidnight: Closing the Performance Gap Between Open and Proprietary Pathology Foundation Models

cs.CV ·2026-10-13 ·Ratna Sagari Grandhi, Anis Chihoub, Ryan Kim, Daniel Z. Kaplan, Chao Feng +13 more
code/data similarity 0.63
Abstract

Pathology foundation models offer transferable representations for a range of downstream tasks in computational pathology, but reliance on proprietary data, substantial compute requirements, and limited availability of training code and preprocessing pipelines hinder independent validation and further methodological development. We present OpenMidnight 1.1, an open-source replication and refinement of Midnight trained on approximately 12,000 publicly available whole-slide images from The Cancer Genome Atlas. Using an encoder initialized with pretrained DINOv2 weights, OpenMidnight 1.1 uses approximately 320 H100 GPU-hours for pathology pretraining, a 34-fold reduction relative to the compute reported for Midnight. Across 16 classification and four segmentation datasets in THUNDER, OpenMidnight 1.1 achieves the highest mean segmentation Dice (69.7) and ranks fourth among 14 models, ahead of Midnight, with performance that matches or exceeds models trained on substantially larger datasets in several tasks. Our ablation studies additionally examine how initialization, data volume, model size, and tissue composition affect downstream performance, providing empirical evidence to inform the development of future training recipes. Our release of the training code, preprocessing pipeline, and model weights lowers barriers to reproducible research and further development of competitive pathology foundation models.

0.50

TIAgent: From Natural Language to Grounded Agentic Workflows for Computational Pathology

cs.AI q-bio.QMcs.CLcs.MA ·2026-09-30 ·Aakash Madhav Rao, Mark Eastwood, Danielle Belgrave, Fayyaz Minhas
benchmark similarity 0.62
Abstract

Computational pathology (CPath) analyses increasingly depend on multi-step computational workflows that require substantial programming expertise, limiting their accessibility to pathologists and other domain experts without extensive coding experience. Although large language models (LLMs) provide a promising natural-language interface for constructing such analyses, hallucinated operations and incorrect workflow specifications limit their reliability in scientific settings. We introduce Tissue Image Analysis Agent (TIAgent), an automated CPath workflow generation framework that, given a natural-language prompt specifying a complex analytical task together with an input dataset, automatically constructs a verifiable computational graph employing existing CPath operations. The resulting graph can be inspected and executed, enabling natural-language construction of complex CPath workflows for applications including automated biomarker discovery and tissue analysis. We demonstrate end-to-end workflow generation and execution and systematically benchmark 14 backbone LLMs across 90 unit tasks spanning 18 CPath operation types. The ability of each LLM to generate a complete and correct unit workflow is quantified using Unit Workflow Success (UWS). Performance varied substantially across backbone models, with Kimi-K2.7-Code achieving the highest UWS of 0.967 (95% CI: 0.907-0.989). Analysis of node and parameter correctness further revealed that selecting the appropriate computational operation and correctly configuring it represent distinct challenges for LLM-based workflow generation. TIAgent provides a foundation for making complex CPath workflow construction more accessible while enabling systematic evaluation of LLM-driven scientific workflow generation.

0.20

Complementary Roles of Radiomics and Foundation Representations in Renal Cell Carcinoma Classification: A Comparative Study of 2D and 3D CT Encodings

cs.CV cs.AI ·2026-09-22 ·Yuan Liang, Sourav Bhattacharjee, Abraham Campbell
published similarity 0.62
Abstract · Accepted at Medical Image Understanding and Analysis (MIUA 2026). 15 pages, 2 figures

Accurate preoperative subtype classification of renal cell carcinoma (RCC) from contrast-enhanced computed tomography remains clinically challenging. Radiomics provides structured tumour descriptors, whereas foundation representations offer transferable image features. However, it remains unclear whether radiomics still adds value beyond pretrained representations, and how 2D and 3D MedVAE encoders compare in this setting. We compared handcrafted radiomics, 2D MedVAE, 3D MedVAE, and their fusion for binary clear-cell RCC versus non-clear-cell RCC classification on KiTS23 under a unified preprocessing pipeline. Concatenation, cross-attention, and gated fusion were evaluated as representative integration strategies, and radiomics feature importance was analysed to support decision-centric interpretability. Fusion consistently improved discrimination over image-only MedVAE branches. The best overall performance was achieved by 3D gated fusion, with an AUC of 82.7\%, outperforming the best 2D fusion model (79.6%), the radiomics baseline (74.4%), and the single-modality MedVAE branches. Ablation analysis further showed clear gains of the full fusion model over both image-only and radiomics-only variants, indicating complementary contributions from radiomics and image representations. These findings suggest that radiomics remains relevant for RCC CT classification in the presence of foundation representations, and that its integration with MedVAE is more effective in the 3D setting. More broadly, the study supports a complementary role for radiomics and foundation representations in clinically meaningful imaging decision support.

0.33

MedUAG: Unified Understanding and Generation for Medical Multimodal Models

cs.CL cs.AI ·2026-08-19 ·Zijie Meng, Yuncheng Zhang, Hualiang Wang, Yitian Tang, Xiaotang Gai +6 more
benchmark similarity 0.62
Abstract

Recent Multimodal Large Language Models (MLLMs) are rapidly evolving into unified understanding and generation (UAG) frameworks. However, extending these unified paradigms to the medical domain is hindered by: the absence of comprehensive training and evaluation benchmarks, and the lack of broadly validated unified medical model. To address these gaps, we present a comprehensive foundation for medical UAG. First, we construct MedUAGCorpus, the largest unified medical understanding and generation dataset to date, comprising over 6 million instances across 14 imaging modalities. Second, we introduce MedUAGBench, a systematic benchmark that expands medical generation evaluation to 12 diverse tasks under standardized protocols. Finally, leveraging these resources, we develop MedUAG, an end-to-end trained unified medical model. Extensive experiments demonstrate that MedUAG achieves strong performance across a wide array of understanding and generation tasks, establishing a competitive baseline and paving the way for next-generation medical multimodal systems.

0.21

Merlin Plus: A Large-Scale, Multi-Cancer, Image-Mask-Report Dataset

cs.CV ·2026-09-29 ·Pedro R. A. S. Bassi, Wenxuan Li, Szymon Plotka, Ruby Honjol, Jakub Przado +8 more
top venuedatasetcode/data similarity 0.61
Abstract · MICCAI 2026

Multi-cancer segmentation in computed tomography (CT) is fundamentally limited by the scarcity of tumor masks across different organs. We present Merlin Plus, the first large-scale CT dataset with radiologist-created tumor masks across 9 organs. Merlin Plus extends the Merlin dataset by adding 1,153 per-voxel tumor masks and longitudinal metadata. To create these tumor masks, we developed a report-based active-learning framework in which radiology reports identify tumor cases for annotation and support training of a tumor segmentation model. The model generates initial masks, which radiologists review and correct to produce the final masks, reducing annotation burden while maintaining high-quality annotations. Besides tumor masks, the longitudinal metadata in Merlin Plus enables temporal modeling of cancer progression. By directly addressing the major bottleneck of limited multi-cancer segmentation masks, Merlin Plus supports scalable multi-organ cancer detection, segmentation, and longitudinal analysis in CT. Dataset is available at: https://github.com/MrGiovanni/MerlinPlus

0.57