CS Paper Radar

CS-LDM: Clinically Guided Structure-Aware Latent Diffusion for Knee Radiographic Forecasting

Shaotian Li, Chenhui Wang, Wenhua Wu, Yanqiu Wu, Xiaohan Yu

eess.IV ·submitted 2026-10-29 03:39 UTC · v1

Abstract

Knee osteoarthritis (KOA) is a leading cause of physical disability and currently has no curative clinical treatment. Early diagnosis and accurate prognosis are therefore vital for managing its progression. Existing methods mainly predict future severity grades and provide limited visual explanation of structural change. Recent generation-guided approaches synthesize follow-up radiographs for progression assessment, but generated images are often judged by predictive accuracy or image realism, so they may satisfy a grading model while remaining morphologically unreliable. We therefore propose CS-LDM, a clinically guided, structure-aware latent diffusion framework that forecasts patient-specific future knee radiographs from the current X-ray and clinically available current KL grade, using LoRA adaptation, current-grade conditioning, and frozen-teacher diagnostic distillation. Experiments on the public Osteoarthritis Initiative (OAI) dataset show that CS-LDM improves future severity-grade consistency while maintaining competitive image fidelity. Further ordinal, OARSI, ROI-level, and stable/progressed analyses show that radiographic forecasting should be evaluated by balancing diagnostic consistency, anatomical plausibility, and structural preservation.

Closest papers

Nearest neighbours by meaning across the whole index.

OA-MAP: Evidence-Grounded Multi-Agent Multimodal Framework for Interpretable Knee Osteoarthritis Progression

cs.AI cs.MA ·2026-10-08 ·Sixu Chen, Mingrui Yang, Qiang Guan, Xiaojuan Li
similarity 0.67
Abstract

Knee osteoarthritis (KOA) progression prediction can support patient monitoring, requiring the integration of multimodal data and multidomain expertise. Moreover, isolated risk estimates provide limited insight underlying a prediction. To automate the progression assessment workflow and reduce manual effort while providing interpretable findings and supporting evidence, we present OA-MAP, an autonomous multi-agent framework for evidence-grounded assessment of structural and pain progression in KOA. The system incorporates modality-specific agents including MRI, X-ray, and clinical agents, together with a coordinator agent. This framework can autonomously recruit specialist agents, select tools for prediction and analysis, and retrieve literature as external evidence based on user request and available patient information. An uncertainty-informed human-in-the-loop mechanism enables clinicians to review and correct intermediate findings, triggering recomputation of affected results. We evaluate the prediction models using 600 participants from the FNIH Osteoarthritis Biomarkers Consortium cohort. On the test set of 100 participants, the fusion models achieve AUROCs of 0.80 for structural progression and 0.68 for pain progression. A case study illustrates how OA-MAP combines risk estimates with intermediate findings, cross-modal conflicts, literature support, and uncertainty indicators to support interactive review.

0.18

Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment

cs.CV cs.AI ·2026-10-06 ·Maryam Baizhigitova, Andrew Seohwan Yu, Po-Hao Chen, Naveen Subhas, Sixu Chen +5 more
similarity 0.67
Abstract · 11 pages, 2 figures, 5 tables

Vision-language models (VLMs) are increasingly being applied to three-dimensional medical imaging, but their application to knee MRI remains limited, particularly for interpreting the complementary sequences used in clinical practice. We introduce Knee3DVLM, a sequence-aware VLM that uses full-volume DESS and fluid-sensitive TSE MRI to predict 57 anatomically resolved binary diagnostic targets derived from the MRI Osteoarthritis Knee Score (MOAKS) for structured reporting. We evaluated DESS-only, TSE-only, and paired DESS-TSE configurations using subject-disjoint Osteoarthritis Initiative partitions. In a held-out cohort of 1,074 examinations, the fused model achieved 72.98% average accuracy, 71.17% balanced accuracy, 78.96% mean ROC-AUC, and 78.74% macro ROC-AUC, the highest values among the three configurations. In a secondary multiclass analysis aligned with the released 3DReasonKnee cohort, Knee3DVLM was numerically higher than the strongest reported 3DReasonKnee configuration across five pathology categories. These findings support dual-sequence full-volume modeling for comprehensive knee MRI assessment.

0.23

Report-Derived Labels, an Image Teacher and the Gap to Expert Labels in Knee MRI: An Analysis of One Entry to the RSNA 2026 Knee Abnormality Detection Challenge

eess.IV ·2026-10-28 ·Soheil Kooklan
benchmarkcode/data similarity 0.66
Abstract · 24 pages, 10 figures, 14 tables. Code: https://github.com/soheilkooklan/rsna-knee-report-labels

In the RSNA 2026 Knee Abnormality Detection challenge, 58 of 4,407 training studies have expert labels for 12 findings, and the rest have only a radiology report. We compare training targets built from a language-model reading of the reports and from a public image model against two references: the expert labels and the 39,248 study-finding cells that the reports state as present or absent. The report labels and the out-of-fold predictions of the image model reach similar agreement with the expert labels (macro AUC 0.892 and 0.896) but fail on different findings. The report is better for ligament tears and patellofemoral osteoarthritis, which it never calls present when the experts do not; the image model is better for effusion, Baker's cyst, contusion, and synovitis, where the reports call the finding absent, leave it out, or call it present more often than the experts. Their equal mixture reaches 0.927 (gain over the report labels 0.035, 95% interval 0.019 to 0.052), also after removing the studies whose knee side was handled inconsistently. We did not observe a model-level gain from this better target: a 2.5D ResNet50 trained on the report labels alone scored 0.877 on the private leaderboard, after the deadline, against 0.872 for the same model trained on the mixture, and the out-of-fold advantage of the mixture is confounded by a change of code and by possible leakage through the image model's folds. A scanner prevalence prior raised agreement with the reports but not with the experts, so a report-derived reference can reward reporting habits. A rank correction for co-occurring findings gave small out-of-fold gains and no visible leaderboard effect. Our entry, a forked public ensemble with that correction, was displayed at rank 582 of 6,299 on the private leaderboard (0.943, a score shared by 287 teams). All results are exploratory; none of the models is meant for clinical use.

0.41

DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images

cs.CV ·2026-10-14 ·Yifei Sun, Fenglei Fan, Junhao Jia, Wenming Deng, Hongxia Xu +2 more
benchmark similarity 0.62
Abstract · 19 pages, 13 figures

Chest X-Ray (CXR) is a primary modality for diagnosing pulmonary diseases, yet the overlap of bony structures often obscures critical radiographic findings, increasing the risk of diagnostic uncertainty. While Dual-Energy Subtraction (DES) is the clinical benchmark for bone suppression, its widespread adoption is primarily hindered by specialized hardware requirements and increased radiation exposure. Recently, diffusion-based generative models have shown promise for this task, yet they are still constrained by reconstruction-biased latent compression, prior-induced domain gap, and a scarcity of high-quality paired datasets. To address these challenges, we propose DeBoneDiT, a depth-driven conditional bridge diffusion Transformer architecture for efficient high-resolution bone suppression. We first introduce Depth Auto-Encoder (DAE), a structure-aware vision tokenizer for latent compression. By incorporating a multi-level depth feature loss derived from the pretrained Depth Anything V2 encoder, DAE preserves both visual fidelity and structural consistency. Second, we formulate bone suppression as a source-conditioned Brownian bridge diffusion process, leveraging CXRs as both the diffusion prior and structural guidance to narrow the source-to-target domain gap and maintain anatomical plausibility. Furthermore, we have constructed and released SZCH-X-Rays, the largest publicly available high-quality paired dataset for bone suppression to date, comprising 741 pairs of CXR and DES soft tissue images. Extensive experiments and downstream evaluation demonstrate that DeBoneDiT achieves superior bone suppression performance with reduced computational overhead.

0.19

KneeFS-Net: A Lightweight Deep Learning Model for Knee Osteoarthritis Severity Assessment with Cross-Domain External Validation

cs.CV cs.LG ·2026-11-15 ·Shafqat Alam, Galib Anjum Talukder Mahi, Yeasir Rabbani Tanvir, Md. Ibrahim, Md. Shahed Hossain +4 more
similarity 0.62
Abstract · 23 pages, 6 figures, 4 tables

Knee osteoarthritis (OA) grading from radiographs using the Kellgren-Lawrence (KL) scale requires expertise that may be scarce. We present KneeFS-Net, a lightweight ordinal grader (0.8 million parameters; 0.33 GFLOPs) combining spatial, Fourier and state-space features with landmark-guided attention. On the Osteoarthritis Initiative (OAI) test set, KneeFS-Net achieved a quadratic weighted kappa (QWK) of 0.863, mean absolute error (MAE) of 0.325 and 97.2% within-one-grade accuracy, comparable to models with 9-35-fold more parameters. We evaluated cross-population generalization on two Bangladeshi cohorts, a single-center hospital cohort and a multi-center teleradiology cohort. Without further training or adaptation, the OAI-trained model achieved QWK 0.803, MAE 0.339 and 98.2% within-one-grade accuracy on its hospital cohort, declining to QWK 0.656 and MAE 0.522 on multi-center teleradiology images. Self-supervised pretraining on 6,092 unlabeled radiographs followed by joint fine-tuning achieved QWK 0.823, MAE 0.329 and 99.7% within-one-grade accuracy in cross-validation. These findings demonstrate accurate, efficient KL grading and potential adaptation to new populations with limited annotation.

0.29

Revisiting Classifier-Free Guidance Methods in Latent Diffusion Models

cs.CV ·2026-08-17 ·Artem Sergievskii, Artyom Turevich, Sergey Kastryulin
similarity 0.61
Abstract

Inference-time quality-enhancement methods are an effective and widely adopted means of improving diffusion models without expensive retraining. We study a family of training-free techniques conceptually rooted in Classifier-Free Guidance (CFG), most of which were originally proposed on older U-Net diffusion models and validated using metrics that assess image quality in isolation, without accounting for compositional alignment or semantic correspondence between the generated image and its associated text prompt. We re-evaluate eight such methods on two open-weight rectified-flow transformers under a fixed per-model protocol and three compositional-alignment benchmarks. No method consistently improves on CFG across the measured criteria. APG obtains several nominal best scores, but the corresponding gains often remain within the estimated evaluation uncertainty. Attention-perturbation methods provide isolated gains on SD3.5 Medium and more frequent degradations on FLUX.2 [klein] 4B Base, while CFG remains a competitive lower-cost baseline.

0.16

Learning the Dose Manifold: A Latent Diffusion Framework for Volumetric Dose Prediction in Automated Radiotherapy Treatment Planning

cs.CV ·2026-10-19 ·J. Boyer-Chammard, R. Vauclin, M. C. Biston, P. Maury, M. Gau +5 more
similarity 0.60
Abstract · 27 pages, 7 figures plus graphical abstract

Automated treatment planning (ATP) aims to reduce the unwarranted inter-planner variability of manual planning, while improving treatment quality and efficiency. Most ATP pipelines rely on the prediction of the achievable three-dimensional dose distribution for a given anatomy and the subsequent optimization of machine parameters to reproduce it. Diffusion-based methods are largely slice-wise due to the high dimensionality of radiotherapy data, and assume a one-to-one mapping between anatomy and optimal dose despite the multi-objective nature of treatment planning. They are evaluated on their ability to match reference doses and rarely on their integration in ATP frameworks. We present LaDose, a latent diffusion framework for fully volumetric dose prediction. An autoencoder learned on dose distributions, trained so that perturbed latents decode to plausible doses, compresses dose maps 128-fold and enables 3D diffusion on a single GPU. Prescription values are represented as exact scalar vectors that bypass the image encoder, avoiding resampling and latent compression. Multiscale classifier-free guidance allows for the modulation of clinical trade-offs at inference, without retraining or additional labeled data. On 900 clinically delivered head-and-neck volumetric modulated arc therapy plans from five centers, LaDose reached a median absolute error of 1.18 Gy (1.4--1.8\% of the prescription) and was the only one of six frameworks free of systematic bias with respect to the reference distribution. Guidance scales acted predictably on target coverage and organ-at-risk sparing. Integrated with direct aperture optimization, the pipeline generated plans in 15.2 minutes; in a blinded review, senior clinicians rated 14 of 15 plans acceptable without editing.

0.12

Multimodal-Conditioned Latent Diffusion Models for Spatiotemporal Brain MRI Forecasting

cs.CV cs.AI ·2026-10-18 ·Antonio Scardace, Silvia Ingala, Sebastiano Battiato, Daniele Ravì
publishedcode/data similarity 0.60
Abstract · Accepted to WACV 2027

Spatiotemporal forecasting of 3D anatomical changes is a critical generative vision challenge for modeling Alzheimer's Disease (AD) progression. While brain MRI forecasting from single-modality data has advanced, other key complementary multimodal biomarkers remain underutilized. In this work, we propose the Multimodal-Conditioned Latent Diffusion Model (MC-LDM), a novel framework for patient-specific brain MRI synthesis. MC-LDM leverages multimodal biomarkers---MRI, tau-PET, Clinical Dementia Rating (CDR), and APOE4---during training, but relies only on baseline MRI, APOE4, and patient metadata at inference, reflecting realistic clinical availability. Our contributions are threefold: (1) a Latent Diffusion Model (LDM) fine-tuned via Low-Rank Adaptation (LoRA) for data-efficient learning; (2) a multimodal conditioning that integrates molecular and clinical signals to model heterogeneous disease trajectories; and (3) auxiliary predictors estimating unobserved multimodal biomarkers from MRI features and patient covariates to condition the diffusion model, removing the need for these assessments at inference. Trained on 1,355 visits from 852 subjects in the Alzheimer's Disease Neuroimaging Initiative (ADNI), MC-LDM reduces average regional volumetric MAE by 18% over the second-best baseline on an independent test set of 664 visits. To our knowledge, MC-LDM represents the first diffusion-based framework to leverage multimodal priors for MRI forecasting. This conceptual advancement enables patient-specific trajectory generation that captures aspects of AD heterogeneity not observable from structural anatomy alone, bridging the gap between rich multimodal supervision and the strict constraints of routine clinical deployment. Code is available at: https://github.com/antonioscardace/MC-LDM.

0.43