CS Paper Radar

Report-Derived Labels, an Image Teacher and the Gap to Expert Labels in Knee MRI: An Analysis of One Entry to the RSNA 2026 Knee Abnormality Detection Challenge

Soheil Kooklan

eess.IV ·submitted 2026-10-28 22:53 UTC · v1
benchmarkcode/data

Abstract

In the RSNA 2026 Knee Abnormality Detection challenge, 58 of 4,407 training studies have expert labels for 12 findings, and the rest have only a radiology report. We compare training targets built from a language-model reading of the reports and from a public image model against two references: the expert labels and the 39,248 study-finding cells that the reports state as present or absent. The report labels and the out-of-fold predictions of the image model reach similar agreement with the expert labels (macro AUC 0.892 and 0.896) but fail on different findings. The report is better for ligament tears and patellofemoral osteoarthritis, which it never calls present when the experts do not; the image model is better for effusion, Baker's cyst, contusion, and synovitis, where the reports call the finding absent, leave it out, or call it present more often than the experts. Their equal mixture reaches 0.927 (gain over the report labels 0.035, 95% interval 0.019 to 0.052), also after removing the studies whose knee side was handled inconsistently. We did not observe a model-level gain from this better target: a 2.5D ResNet50 trained on the report labels alone scored 0.877 on the private leaderboard, after the deadline, against 0.872 for the same model trained on the mixture, and the out-of-fold advantage of the mixture is confounded by a change of code and by possible leakage through the image model's folds. A scanner prevalence prior raised agreement with the reports but not with the experts, so a report-derived reference can reward reporting habits. A rank correction for co-occurring findings gave small out-of-fold gains and no visible leaderboard effect. Our entry, a forked public ensemble with that correction, was displayed at rank 582 of 6,299 on the private leaderboard (0.943, a score shared by 287 teams). All results are exploratory; none of the models is meant for clinical use.

Comment
24 pages, 10 figures, 14 tables. Code: https://github.com/soheilkooklan/rsna-knee-report-labels

Closest papers

Nearest neighbours by meaning across the whole index.

Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment

cs.CV cs.AI ·2026-10-06 ·Maryam Baizhigitova, Andrew Seohwan Yu, Po-Hao Chen, Naveen Subhas, Sixu Chen +5 more
similarity 0.68
Abstract · 11 pages, 2 figures, 5 tables

Vision-language models (VLMs) are increasingly being applied to three-dimensional medical imaging, but their application to knee MRI remains limited, particularly for interpreting the complementary sequences used in clinical practice. We introduce Knee3DVLM, a sequence-aware VLM that uses full-volume DESS and fluid-sensitive TSE MRI to predict 57 anatomically resolved binary diagnostic targets derived from the MRI Osteoarthritis Knee Score (MOAKS) for structured reporting. We evaluated DESS-only, TSE-only, and paired DESS-TSE configurations using subject-disjoint Osteoarthritis Initiative partitions. In a held-out cohort of 1,074 examinations, the fused model achieved 72.98% average accuracy, 71.17% balanced accuracy, 78.96% mean ROC-AUC, and 78.74% macro ROC-AUC, the highest values among the three configurations. In a secondary multiclass analysis aligned with the released 3DReasonKnee cohort, Knee3DVLM was numerically higher than the strongest reported 3DReasonKnee configuration across five pathology categories. These findings support dual-sequence full-volume modeling for comprehensive knee MRI assessment.

0.23

KneePreM: Towards 3D Knee MRI Foundation Models via Large-Scale Unlabeled Pretraining and Label-Efficient Fine-Tuning

cs.CV ·2026-09-25 ·Xinxin Wang, Liam Hazan, Jing Li, Simona Rabinovici-Cohen, Xiaojuan Li +1 more
similarity 0.67
Abstract

Background: Large volumes of unlabeled knee MRI scans are available across repositories but remain insufficiently leveraged. We developed KneePreM, a knee-specific 3D self-supervised model, and evaluated transfer and label efficiency for classification and segmentation. Methods: A 3D U-Net masked autoencoder was pretrained on 19,011 unlabeled Osteoarthritis Initiative (OAI) MRI series from 4,791 participants. Downstream fine-tuning used full and reduced training sets for fastMRI+ two-label classification (1,172 examinations), Arthroscopic Partial Meniscectomy (APM) eight-target classification (1,716 examinations), SKM-TEA segmentation (155 examinations), and APM segmentation (25 examinations). Baselines were random initialization and SuPreM. Deployment workflow was implemented with a Model Context Protocol interface. Evaluation metrics included balanced accuracy, F1 score, ROC AUC, PR AUC, and Dice score. Statistical analysis used bootstrap confidence intervals and paired bootstrap tests for classification and Wilcoxon signed-rank tests for segmentation. Results: KneePreM achieved higher full-data macro ROC AUC than both baselines for fastMRI+ and APM (all p < .001). For fastMRI+ classification, KneePreM achieved a ROC AUC of 0.722 using 50% of the training data, exceeding both full-data baselines. In APM classification, KneePreM reached a ROC AUC of 0.740 with 70% of the data, matching the full-data random baseline and outperforming SuPreM. For SKM-TEA segmentation, its 70%-data Dice of 0.838 exceeded the full-data random baseline (0.835) and both same-budget comparators. In APM segmentation, its 75%-data Dice of 0.746 exceeded the full-data random baseline (0.731) and both same-budget comparators. Conclusion: KneePreM improves transfer performance and label efficiency across knee MRI classification and segmentation tasks, particularly when labeled training data are limited.

0.34

CS-LDM: Clinically Guided Structure-Aware Latent Diffusion for Knee Radiographic Forecasting

eess.IV ·2026-10-29 ·Shaotian Li, Chenhui Wang, Wenhua Wu, Yanqiu Wu, Xiaohan Yu
similarity 0.66
Abstract

Knee osteoarthritis (KOA) is a leading cause of physical disability and currently has no curative clinical treatment. Early diagnosis and accurate prognosis are therefore vital for managing its progression. Existing methods mainly predict future severity grades and provide limited visual explanation of structural change. Recent generation-guided approaches synthesize follow-up radiographs for progression assessment, but generated images are often judged by predictive accuracy or image realism, so they may satisfy a grading model while remaining morphologically unreliable. We therefore propose CS-LDM, a clinically guided, structure-aware latent diffusion framework that forecasts patient-specific future knee radiographs from the current X-ray and clinically available current KL grade, using LoRA adaptation, current-grade conditioning, and frozen-teacher diagnostic distillation. Experiments on the public Osteoarthritis Initiative (OAI) dataset show that CS-LDM improves future severity-grade consistency while maintaining competitive image fidelity. Further ordinal, OARSI, ROI-level, and stable/progressed analyses show that radiographic forecasting should be evaluated by balancing diagnostic consistency, anatomical plausibility, and structural preservation.

0.20

A4-MR: Abnormality Aware Anatomical Alignment for MR

cs.CV ·2026-10-09 ·Noel D'souza, Zhijian Yang, Nishank Singla, Pranay Doshi, Krisztian Koos +13 more
similarity 0.65
Abstract

Recent advances in large-scale foundation models have enabled strong generalization across a wide range of clinical and research tasks in magnetic resonance imaging (MRI). However, existing vision-language MRI models remain limited in anatomy-specific localization and pathology-aware representation, particularly in real-world settings. We introduce A4-MR, a 3D vision-language foundation model trained on approximately 50,000 MRI studies comprising 491,000 series, roughly half of which are paired with radiology reports. A4-MR is designed to: (1) learn anatomy localization through large-scale pretraining with noisy labels; (2) align image and text representations at the anatomical level; and (3) learn distinct representations of healthy and abnormal anatomy. Across a diverse set of downstream tasks, A4-MR outperforms existing foundation models, including a +1.7 AUROC improvement over MedSigLIP for abnormality detection. Using a frozen encoder, A4-MR also surpasses an end-to-end task-specific MedNeXt model for knee segmentation by +1.4 Dice and performs comparably to the best task-specific model for abdominal organ segmentation on AMOS, within 0.4 Dice. Finally, without anatomical prompts, A4-MR localizes 3D anatomy comparably to MedSAM2 provided with ground-truth bounding boxes. Together, these results demonstrate that anatomy-level multimodal alignment and abnormality-aware representation learning can enable a single MRI foundation model to support localization, segmentation, and pathology-related tasks.

0.12

KneeFS-Net: A Lightweight Deep Learning Model for Knee Osteoarthritis Severity Assessment with Cross-Domain External Validation

cs.CV cs.LG ·2026-11-15 ·Shafqat Alam, Galib Anjum Talukder Mahi, Yeasir Rabbani Tanvir, Md. Ibrahim, Md. Shahed Hossain +4 more
similarity 0.64
Abstract · 23 pages, 6 figures, 4 tables

Knee osteoarthritis (OA) grading from radiographs using the Kellgren-Lawrence (KL) scale requires expertise that may be scarce. We present KneeFS-Net, a lightweight ordinal grader (0.8 million parameters; 0.33 GFLOPs) combining spatial, Fourier and state-space features with landmark-guided attention. On the Osteoarthritis Initiative (OAI) test set, KneeFS-Net achieved a quadratic weighted kappa (QWK) of 0.863, mean absolute error (MAE) of 0.325 and 97.2% within-one-grade accuracy, comparable to models with 9-35-fold more parameters. We evaluated cross-population generalization on two Bangladeshi cohorts, a single-center hospital cohort and a multi-center teleradiology cohort. Without further training or adaptation, the OAI-trained model achieved QWK 0.803, MAE 0.339 and 98.2% within-one-grade accuracy on its hospital cohort, declining to QWK 0.656 and MAE 0.522 on multi-center teleradiology images. Self-supervised pretraining on 6,092 unlabeled radiographs followed by joint fine-tuning achieved QWK 0.823, MAE 0.329 and 99.7% within-one-grade accuracy in cross-validation. These findings demonstrate accurate, efficient KL grading and potential adaptation to new populations with limited annotation.

0.29

RadRef: A Reference-Free Metric for Radiology Report Generation

cs.LG ·2026-11-09 ·Shelly Schwartz, Alan Ropp, Michael B. Sneider, Nur Yildirim, Cree M. Gaskin +1 more
similarity 0.62
Abstract

AI-generated radiology reports are commonly evaluated against radiologist-authored references, limiting the applicability of standard reference-based metrics when no reference is available. We introduce RadRef, a reference-free metric that scores report claims against image-derived beliefs over a clinical finding vocabulary, weighted by relevance to the clinical indication. By evaluating findings beyond the report's stated claims, RadRef assesses omissions as well as unsupported assertions. On ReXVal, RadRef achieves $73.1\%$ agreement with radiologist rankings among non-tied same-radiograph report pairs, with $61.8\%$ pair coverage and $64.3\%$ tie-inclusive agreement. Its non-tied agreement is close to GREEN ($73.9\%$) and RadFact ($72.6\%$), with its strongest relative results on omissions. We further evaluate $100$ model-generated and $100$ radiologist-authored reports from $100$ MIMIC-CXR studies, independently annotated by two board-certified radiologists. On same-image omission rankings, RadRef attains Kendall's $τ_b = 0.295$, compared with $0.386$ between the readers. In separate paired comparisons across generated reports, no evaluated comparator significantly outperforms RadRef on omissions. The same image-grounded representation provides a false-finding readout, RadRef-FF, with $τ_b = 0.32$ on ReXVal and $0.29$ in the reader study. Controlled perturbations confirm that RadRef depends on the radiograph, report, and clinical indication. RadRef enables image-grounded evaluation before a radiologist-authored reference exists, supporting quality monitoring of report-generation systems in clinical settings, and complements reference-based metrics when one is available.

0.21

OA-MAP: Evidence-Grounded Multi-Agent Multimodal Framework for Interpretable Knee Osteoarthritis Progression

cs.AI cs.MA ·2026-10-08 ·Sixu Chen, Mingrui Yang, Qiang Guan, Xiaojuan Li
similarity 0.62
Abstract

Knee osteoarthritis (KOA) progression prediction can support patient monitoring, requiring the integration of multimodal data and multidomain expertise. Moreover, isolated risk estimates provide limited insight underlying a prediction. To automate the progression assessment workflow and reduce manual effort while providing interpretable findings and supporting evidence, we present OA-MAP, an autonomous multi-agent framework for evidence-grounded assessment of structural and pain progression in KOA. The system incorporates modality-specific agents including MRI, X-ray, and clinical agents, together with a coordinator agent. This framework can autonomously recruit specialist agents, select tools for prediction and analysis, and retrieve literature as external evidence based on user request and available patient information. An uncertainty-informed human-in-the-loop mechanism enables clinicians to review and correct intermediate findings, triggering recomputation of affected results. We evaluate the prediction models using 600 participants from the FNIH Osteoarthritis Biomarkers Consortium cohort. On the test set of 100 participants, the fusion models achieve AUROCs of 0.80 for structural progression and 0.68 for pain progression. A case study illustrates how OA-MAP combines risk estimates with intermediate findings, cross-modal conflicts, literature support, and uncertainty indicators to support interactive review.

0.18

Reliability assessment and multicenter clinical application of magnetic resonance methods for knee cartilage quantification

eess.IV q-bio.QM ·2026-09-08 ·Binbin Yang, Yongmei Jian, Chenglei Liu, Rui Huang, Hongda Shao +8 more
similarity 0.59
Abstract · 57 pages, including supporting information and a graphical abstract; 5 main figures, 7 supplementary figures, 3 main tables, and 6 supplemen…

Background: This study evaluated interreader agreement and longitudinal performance of MRI methods for knee cartilage volume, thickness, and defect-area quantification. Methods: AI-presegmented masks from 1,189 phase III examinations underwent independent correction by two readers and adjudication. Cartilage volume, three-dimensional ray-tracing thickness (3D-RT), and ray-based defect area (3D-RBA), defined by a 1.5-mm thickness threshold, were calculated. Agreement was assessed using segmentation metrics, intraclass correlation coefficients (ICCs), repeated-measures Bland-Altman analysis, and minimal detectable change at 95% confidence (MDC95). The 3D-RBA framework was evaluated in 120 digital-phantom experiments from 40 participants. Longitudinal analyses included 374 participants, alternative-method comparisons included 65, and retrospective phase II analysis included 24 participants with four visits. Results: Overall AI-to-adjudicated-mask Dice was 0.964 +/- 0.029. Interreader ICCs for volume, thickness, and defect area were 0.956, 0.904, and 0.932; corresponding MDC95 values were 1,596.9 mm^3, 0.227 mm, and 147.4 mm^2. Geometric mean absolute percentage error for defect area was 5.62%, with spatial Dice of 0.961. In 374 participants, volume changes correlated positively with thickness changes (rho=0.431) and negatively with defect-area changes (rho=-0.221). Within-participant phase II correlations followed the same directions in both groups. Conclusions: The workflow demonstrated good interreader agreement. Controlled geometric results and longitudinal associations supported the feasibility of threshold-based defect-area estimation. Volume, thickness, and defect area provide complementary measures of cartilage structure.

0.37