CS Paper Radar

OPTARI: An open-source software framework for clinical translation of optoacoustic imaging

Moritz Schillinger, Maximilian Bader, Adrian Buehler, Felix Wachter, Ferdinand Knieling, Vasilis Ntziachristos, Katharina Breininger

cs.SE cs.CVphysics.med-ph ·submitted 2026-10-23 10:35 UTC · v1
code/data

Abstract

Combined optoacoustic (OptA) and ultrasound imaging is a promising modality across a wide range of pathologies. Its use in clinical research, however, is limited by a lack of analysis software accessible to users without programming expertise. Existing tools are either script-based engineering frameworks or proprietary vendor applications. We present OPTARI, an open-source graphical software application to facilitate large-scale clinical optoacoustic-ultrasound (OPUS) studies. OPTARI builds on the napari image viewer and the PATATO toolkit for OptA data processing. It supports native vendor and open HDF5 data formats, aligns with the IPASC standard, and is distributed as a standalone executable. Features include region-of-interest annotation, reconstruction, chromophore unmixing, deep-learning-based tissue segmentation, and temporal and spectral analysis modules. OPTARI offers a combination of features for clinical study analysis that none of the compared tools provide. The automated tissue segmentation produced results comparable to expert labeling for muscle tissue, and batch processing reduced analysis time from minutes to under one second per scan. The tool is used in ongoing clinical OPUS studies. OPTARI connects engineering frameworks with medical research and provides an open-source basis for reproducible and standardized analysis in clinical OptA imaging studies.

Comment
15 pages, 4 figures, 2 tables. Submitted to the Journal of Biomedical Optics. Code and documentation: https://mo-sc.github.io/OPTARI/

Closest papers

Nearest neighbours by meaning across the whole index.

Which Pretext Task Transfers? Self-Supervised Pretraining Objectives for Lung Ultrasound

cs.CV ·2026-09-15 ·Moein Heidari, Junbo Rao, Jai Choraria, Wenjin Chen, David J. Foran +1 more
code/data similarity 0.55
Abstract · Submitted to SPIE 2027

Self-supervised learning (SSL) can reduce the need for labelled medical images, but the choice of pretext objective remains unclear for lung ultrasound (LUS). Contrastive learning, masked reconstruction, and joint-embedding predictive architectures (JEPA) differ in the space in which their targets are defined, yet existing ultrasound studies compare them under different corpora, backbones, and evaluation protocols. We compare these three objective families using the same encoder backbone, pretraining corpus, optimisation schedule, and frozen-evaluation protocol. Encoders are pretrained on COVID-BLUeS LUS videos and evaluated with linear, $k$NN, and attentive probes at 5\%, 10\%, 50\%, and 100\% label budgets. Evaluation is performed on POCUS using patient-level five-fold cross-validation and on the independently acquired Mendeley-Uganda dataset, which is excluded from both pretraining and probe fitting. At the full label budget under linear probing, VideoMAE and V-JEPA achieve $66.5 \pm 13.1$ and $65.4 \pm 11.7$ balanced accuracy on POCUS, while MoCo achieves $42.1 \pm 1.2$. On Mendeley-Uganda, the ranking reverses: MoCo performs best at $62.7 \pm 1.0$, followed by VideoMAE at $53.8 \pm 2.8$, while V-JEPA falls near chance at $35.1 \pm 4.9$. These results show that POCUS probe accuracy alone does not identify the objective that transfers best across datasets. We also outline planned representation-level analyses to examine this reversal. Code is publicly available at https://github.com/moeinheidari7829/LUSVideoSSL.

0.35

Reference Manual of MEDiml

cs.SE physics.med-ph ·2026-10-21 ·Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum +11 more
code/data similarity 0.53
Abstract · 39 pages, 18 figures, 2 tables. Software, documentation, tutorials, and all software resources are available at https://www.mediml.app

Radiomics is the high-throughput extraction of quantitative features (e.g., tumor shape, intensity distributions, and texture) from medical images to characterize tissues and uncover disease patterns invisible to the human eye. These features can serve as candidate imaging biomarkers for cancer diagnosis, prognosis, and classification. However, extracting thousands of features makes it difficult to identify the most informative ones for a given clinical task, while implementing an end-to-end workflow can require programming expertise that limits accessibility for clinical researchers. Hence, we propose MEDiml, an open-source, standards-compliant radiomics platform connecting feature extraction, predictive modeling, and interpretation through complementary graphical and programmatic interfaces. MEDiml combines a Python package (MEDiml-pkg) with a graphical desktop application (MEDiml-app) that enables researchers to conduct experiments without writing code. Both interfaces use the same computational implementation, and code generation exports graphically configured workflows as executable Python code, facilitating reproducibility and collaboration between clinical researchers and computational scientists. A typical MEDiml workflow includes image preprocessing, radiomic feature extraction, feature set reduction, model training and evaluation, and interpretation using feature importance. Feature sets can be grouped into levels of radiomic complexity (morphological, intensity-based, textural, and filter-based) to evaluate whether more complex features provide additional predictive value. This reference manual documents the radiomics concepts, workflow, software components, architecture, and installation, compares MEDiml with existing tools, and demonstrates its complexity-driven workflow on five oncological imaging cohorts comprising 2,104 patients. Resources: www.mediml.app.

0.35

Annotating anatomy and pathology in the National Lung Screening Trial computed tomography images

eess.IV ·2026-09-09 ·Deepa Krishnaswamy, Vamsi Thiriveedhi, Suraj Pai, David Clunie, Igor Octaviano +4 more
similarity 0.52
Abstract

Large-scale public medical imaging datasets contribute critically to translational research. When accompanied by rich clinical and multi-omics data, they can stimulate exploratory research and enable secondary analyses. Expert annotations of such imaging collections can support the development of new image analysis tools. Continuous enrichment of images with image-derived data makes them more usable for researchers without expertise in image analysis or access to large-scale computational resources. The National Lung Screening Trial (NLST) released a rich longitudinal dataset that includes Computed Tomography (CT) images for over 26,000 patients. We introduce three Digital Imaging and Communications in Medicine (DICOM) formatted datasets, complementing NLST CT images, shared as analysis results in the National Cancer Institute Imaging Data Commons (IDC). Two of those (IDC NLSTSeg and IDC NLSTSybil) contain DICOM-harmonized annotations and extracted measurements (for 581 and 601 NLST patients, respectively) shared earlier using research formats (Sybil and NLSTseg). The third one (TotalSegmentator-CT-Segmentations) contains volumetric segmentations generated using TotalSegmentator and radiomics features for each segment for 26,194 NLST patients.

0.18

Medical Image Analysis with Machine Learning (MEDiml): Strategies for Simpler Radiomics

eess.IV physics.med-ph ·2026-10-27 ·Mahdi Ait Lhaj Loutfi, Simon Provost, Élodie Gillard, Moustafa Amine Bezzahi, Alexander Chum +11 more
code/data similarity 0.52
Abstract · 11 pages, 3 figures, 2 tables. Software paper. Full reference manual: arXiv:2610.29666 . Software, documentation, tutorials, and resources a…

Radiomics extracts quantitative features describing tumor shape, intensity, and texture from medical images to build models that predict clinical outcomes. However, large feature sets increase the risk of overfitting in small datasets, and building an end-to-end workflow often requires programming expertise. We present MEDiml (Medical Image Analysis with Machine Learning), open-source radiomics software available as a Python package (MEDiml-pkg) and a no-code desktop application (MEDiml-app). Both run on the same computational engine, and code generation exports graphically configured workflows as executable Python code. Feature extraction follows the Image Biomarker Standardization Initiative (IBSI) standards. MEDiml is built around complexity minimization: features are grouped into levels of increasing complexity (morphological, intensity, textural,l and filter-based), a model is trained at each level, and the simplest level not significantly outperformed by more complex ones is retained. Applied to five oncological datasets (2,104 scans), MEDiml achieved AUCs of 0.65 to 0.82, with morphological or intensity features sufficient in four of the five tasks. Resources: www.mediml.app.

0.28

Open ultrasound foundation model for robust segmentation and clinical measurement across heterogeneous settings

cs.CV ·2026-09-16 ·Chao Qin, Fahad Shahbaz Khan, Salman Khan, Sarim Ather, Siddiq Anwar +2 more
code/data similarity 0.51
Abstract · The PDF includes the Supplementary Information. Code is available at https://github.com/AlfredQin/sonobase

Ultrasound is the most widely deployed imaging modality worldwide, yet clinical AI remains fragmented into narrow single-task models that fail when device, operator, or anatomy changes. Here we present SonoCorpus, an open resource unifying 456,963 images and 1,626,085 expert masks from 53 public datasets spanning 24 clinical applications and 17 countries, and SonoBase, an interactive segmentation foundation model pretrained on it. Across fifteen evaluation datasets introducing new organs, devices, operators, and geographies, SonoBase outperforms SAM2, MedSAM2, and the concept-promptable MedSAM3 on every dataset and matches per-dataset specialist models trained on the same data; on fully external data it exceeds the accuracy these baselines achieve on their own in-distribution benchmarks. Ejection fraction derived from its segmentations falls within inter-observer variability (6.63\% error), with fewer misclassifications at the defibrillator-candidacy threshold than either promptable baseline (13\% versus 18--42\%); fetal head-circumference (1.81~mm) and gestational-age (1.2 days) errors fall below inter-observer variability. Where a baseline fails outright, one in four test cases, SonoBase recovers a usable segmentation in 81\% of them, including on handheld probes operated by minimally trained users in two low- and middle-income countries (Sierra Leone and Tanzania). Five labeled examples can help the model adapt to a new setting, and the identical training protocol transfers well to newer models such as SAM3, locating the advantage in ultrasound-specific pretraining rather than any single architecture. To ensure reproducibility and enable the community to build on SonoBase as a platform, we release all checkpoints, optimizer states, data-split indices, deduplication hashes, and starter code at https://github.com/AlfredQin/sonobase.

0.36

LingLan: An Advancing Traditional Chinese Medicine Diagnosis LLM with Multimodal Data

cs.AI ·2026-09-22 ·Zheng Chen, Zhicheng Du, Haoxuan Li, Yingshan Liang, Peiwu Qin
similarity 0.51
Abstract · 6 pages, 5 figures

Though artificial intelligence (AI) increasingly transforms modern medicine, its integration into Traditional Chinese Medicine (TCM) has been relatively slow, primarily due to TCM's reliance on holistic, subjective diagnostic methods---namely Inspection, Auscultation and Olfaction, Inquiry, and Palpation(I-AOI-P)---which are difficult to align with quantitative, standardized medical systems. In this work, we introduce a Unification Framework for Multimodal Data (UFMD), which automatically processes tongue and pulse images into structured, clinically standard descriptions, integrating multi-source diagnostic information into a unified digital record of I-AOI-P process. Building on this structured data, we create LingLan-14B, a TCM-specific large language model fine-tuned via supervised learning to emulate the diagnostic logic and workflow of I-AOI-P process. Experimental results show that our method significantly enhances diagnostic accuracy, achieving a relative improvement of 103.5% over the baseline (62.72% vs. 30.82%) and reaching an F1-score of up to 82%.

0.13

BEACON: A Versatile Accelerator for Computational Pathology Applications

cs.AR ·2026-09-10 ·Sumanth Gudaparthi, Ananth Krishna Prasad, Lin Jia, Rajeev Balasubramonian, Srinivasan Parthasarathy
similarity 0.51
Abstract

While accelerators for AI have seen great commercial success, it is challenging to replicate that success for other specialized domains due to a number of factors. We make the case that barriers for new accelerators can be lowered by starting with a baseline AI accelerator, and adding minimal logic to support new operators demanded by new specialized domains. This leads to a versatile chip that can be manufactured at high volume and deployed for a range of popular applications. We refer to this as the AI+X approach. This paper explores its potential for the emerging domain of Computational Pathology, which involves analysis of large whole-slide tissue images with a multi-stage pipeline. The pipeline requires support for a number of different kernels and operators - early stages perform segmentation and feature extraction, followed by graph creation with k nearest neighbor (kNN) algorithms, and finally inference with an iterative graph convolutional network (GCN) that alternates between Aggregation and Combination. We show that these stages execute inefficiently on a range of baseline CPU, GPU, AI, and GCN accelerators. That inefficiency is addressed with a combination of software re-structuring and small modifications to a baseline systolic AI accelerator. Many of the above kernels can be mapped to a systolic accelerator by offering a flexible datapath between processing elements and register access mechanisms. We add support for feature aggregation, load balanced execution, Euclidean distance calculation, binning, and counter aggregation. This additional flexibility and logic grows the area of a baseline AI chiplet by 1.1x, but by avoiding the memory wall and offering high parallelism, the proposed accelerator BEACON yields over an order of magnitude higher throughput for Computational Pathology than baseline CPU and GPU platforms.

0.11

Targeted Deep Regression - Initial Applications in Whole-Body Water-Fat MRI in UK Biobank

cs.CV cs.LG ·2026-10-26 ·Filip Marttala, Taro Langner, Johan Öfverstedt, Nouman Ahmad, Håkan Ahlström +2 more
similarity 0.50
Abstract · 16 pages, 8 figures

UK Biobank is a British clinical study which, in addition to large amounts of medical data collected, plans to include detailed Magnetic Resonance Imaging (MRI) examina- tions from 100,000 participants. The image data can be analyzed for example by auto- mated analysis with neural networks for image segmentation or classification to expand the collection of image-derived phenotypes for medical research. In this work, we pro- pose, present and evaluate a methodology that uses image-based regression to estimate numerical properties from the collected neck-to-knee water-fat MRI scans. It applies a ResNet50-style network to 2D multi-channel collages that represent targeted and study- specific anatomical sub-regions from the MRI scan. The targeted sub-region sampling is achieved by propagating manually defined subregions from a reference scan to the other >30,000 analyzed scans using image registration. The resulting collages can be compact while retaining high-resolution, for example by providing multiple slices of kidney tissue for a kidney volume regression network. This approach also enables group-wise saliency analysis that highlight image and anatomical regions used by the network for the pre- dictions. The method was applied for the regression endpoints of kidney volume, heart volume, and age. Predictive performance was found between R2 = 0.731-0.984 and the group-wise saliency maps were found to highlight medically relevant regions. We con- clude that the method can be used to standardize and restrict the information presented to a deep regression analysis pipeline, increasing information density and opening up a wide range of future medical inference studies.

0.24