CS Paper Radar

Rethinking weakly supervised localization on chest radiographs: position nulls, protocol dependence, and PACE

Shixin Qiu

cs.CV cs.LG ·submitted 2026-09-29 07:53 UTC · v1
benchmark

Abstract

Weakly supervised localization on chest radiographs is reported as a single overlap accuracy, and those numbers are not comparable across papers. We measure what one contains. Against position-null controls that keep a readout's own box and move only its position, class activation mapping and its gradient-weighted variant beat the null on two to four of seven annotated findings on ChestX-ray14 and two of eight on CheXlocalize. The null is beatable: three board-certified radiologists clear it on four to seven. Three rarely stated choices each move a result by more than most reported method effects: the results regime, the extraction threshold, and the mask-to-box rule, whose cost is predicted by how fragmented the thresholded mask is. Predicted box area alone reverses a paired comparison. These measurements produced PACE, for \emph{population anomaly and class evidence}, which multiplies the finding identity from the label-trained head by the spatial evidence from a frozen radiograph backbone that never sees a pathology label. It is the case study that made the protocol dependence visible, and we report its costs beside its gain: in an exploratory matched-area analysis it improves strict-overlap accuracy on both corpora and beats a label-derived second map, but it is the least faithful of the three readouts to the classifier's causal map, its advantage depends on the box rule, and, this benchmark releasing no localization validation set, every design choice behind it was made on the boxes it is scored on. Its one clean transfer beats one baseline and loses to the other.

Closest papers

Nearest neighbours by meaning across the whole index.

Can saliency maps flag chest radiograph classifier errors at a new hospital? An external validation study

cs.CV cs.LGeess.IV ·2026-11-03 ·Aashish Chapagai, Angad Singh Gurtatta, Erik Cambria
code/data similarity 0.68
Abstract · 21 pages, 5 figures, 1 table, 6 Extended Data figures and 4 Extended Data tables. Code: https://github.com/aashish-chapagai/CXR-Saliency-Ext…

Saliency maps are offered as a safeguard for medical image classifiers, but whether they reveal individual errors at a new hospital remains largely untested. We trained a convolutional network and a vision transformer on NIH ChestX-ray14 and evaluated 303,768 decisions per model at the training hospital and at two external sites, in the USA and Vietnam, with radiologist-consensus labels. We scored each explanation by its anatomical enrichment, the area-normalized concentration of attribution in a segmented thoracic region, and tested whether it detects errors beyond the model's confidence. Grad-CAM localized findings less often than radiologists (hit rate at most 0.575 versus 0.888). Adding enrichment to a confidence-based error detector calibrated at the training hospital never raised its area under the curve by more than 0.011, and for the convolutional network the relation between enrichment and correctness reversed between hospitals, degrading the transferred detector. Model confidence, not saliency, should anchor deployment monitoring.

0.31

Trading Parameters for Accuracy in MambaVision for Chest Radiograph Classification

cs.CV ·2026-11-15 ·Qaiser Farooq, Tehseen Zia
similarity 0.67
Abstract · 10 pages, 4 figures, 9 tables. Submitted to an IEEE journal

MambaVision, a hybrid state-space and attention backbone, places most of its parameters in its widest, fourth stage. We quantified what that stage contributes to multi-label chest radiograph classification. The fourth stage was replaced with lighter single-scan state-space blocks adapted from Spatial-Mamba, with multi-scale dilated depthwise convolutions applied to the scan output; the first three stages were retained. Tiny, Small, and Base models were evaluated across nine dataset-scale combinations drawn from two source cohorts: the National Institutes of Health ChestX-ray14 archive (full ChestMNIST and a high-resolution subset) and Indiana University Open-i. At the Tiny scale, replacement reduced parameter count by 35.7% and increased graphics processing unit throughput by 19.3%; the savings came from the stage's dense projections, not from removing quadratic attention. Without distillation, the mean area under the receiver operating characteristic curve on ChestMNIST was 0.004 lower than the baseline (95% bootstrap confidence interval, 0.002 to 0.006), and 0.003 to 0.006 lower across all nine combinations. Knowledge distillation from an unreplaced teacher narrowed the gap to the undistilled baseline to 0.001-0.002 and met the equivalence criterion on ChestMNIST, but distilling the baseline with the same recipe improved it by 0.001-0.003, so a gap of 0.002-0.005 persisted under symmetric training. At the Base scale, the unreplaced Small model was both smaller and more accurate. Fourth-stage replacement is a useful trade-off only for Tiny and Small models. These measurements let developers of chest radiograph screening tools weigh model size and speed against a quantified loss of diagnostic discrimination.

0.27

APED-CXR: Adaptive Privileged Evidence Distillation for Chest X-Ray Grounding with Image-Only Inference

cs.CV ·2026-10-21 ·Md Shihabul Islam Shovo, Nishi Kanta Paul, Jamil Fayyad
similarity 0.66
Abstract · 5 pages, 2 figures, 3 tables. Submitted to IEEE ISBI 2027

Compact chest X-ray (CXR) models that localize findings suit deployment, but box annotations are limited and report-aware multimodal models are expensive at inference. We introduce APED-CXR, which distills report-informed spatial evidence from a frozen multimodal teacher into a student with 11.1M parameters that predicts diseases and boxes from shared evidence maps and requires the image alone at test time. During training, the teacher uses the radiograph, report, and queried class to evaluate regions proposed from the student's current evidence maps, and its support scores serve as training targets for the student's pooled evidence scores within these regions. Trained on PadChest and evaluated on held-out PadChest-GR, refreshing the student's proposals for teacher evaluation improves box-level localization F1 from 0.302 with fixed warm-up proposals to 0.338 (IoU >= 0.5; gain 0.036, 95% CI [0.022, 0.049]), while maintaining diagnostic AUC. This gain depends on the teacher checking current proposals: with equally many random boxes, a fixed dense box set, teacher-generated boxes, or report rules instead of the teacher, F1 stays near the fixed-proposal level, and proposals two refreshes old recover only part of the gain. On NIH ChestX-ray14, a secondary test set, box recall also rises from 0.423 to 0.447.

0.30

C$^2$A: Coupling Spatial Evidence with Clinical Priors via Co-occurrence Aware Class Attention for Multi-Label Chest X-Ray Classification

cs.CV cs.LGeess.IVeess.SP ·2026-08-10 ·Akash Gogineni, Nagur Shareef Shaik, Aasrith Mandava, Adnan Masood, Dong Hye Ye
published similarity 0.66
Abstract · Accepted at 2026 IEEE International Workshop on Machine Learning for Signal Processing

Thoracic pathologies rarely occur in isolation, yet standard multi-label classifiers rely on shared global descriptors, discarding \emph{where} findings lie and \emph{how} they co-occur. We propose \textbf{C$\mathbf{^2}$A} (Co-occurrence Aware Class Attention), a classification head that explicitly couples spatial evidence with clinical priors. First, C$^2$A casts pooling as an expectation over learned per-class spatial attention maps, yielding localized descriptors for each disease. Second, it couples these descriptors via a learnable graph warm-started from empirical label co-occurrence. A single residual message-passing step shares evidence among related findings, proving to be a bounded perturbation of the identity where co-occurrence enters each logit through an explicit bilinear interaction. On CheXpert, C$^2$A achieves a superior $0.895$ macro-mean AUROC, outperforming advanced context-gating baselines. Crucially, gains concentrate on highly co-occurrent classes with ambiguous spatial evidence (rescuing Atelectasis by $+1.5$ over GCG), demonstrating the prior's regularizing effect with a negligible overhead of one linear projection and a $C\!\times\!C$ edge matrix.

0.20

From Augmentation to Synthetic Evidence: Evaluating Generated Chest Radiographs at Dataset Intake

cs.CV cs.AIcs.LG ·2026-10-21 ·Shaikh Akib Shahriyar, Zinedine Sehili, Adam Arthur, Christopher Schwartz
position similarity 0.65
Abstract

While generated chest radiographs can serve as valuable data augmentation when explicitly declared, the same pixels become unsupported evidence when submitted as records of real clinical examinations. We study this dataset-intake vulnerability by disentangling three questions: (1) whether an image passes an automated technical quality check, (2) whether an origin classifier flags it as synthetic, and (3) whether a trusted provenance record supports the claimed clinical acquisition. In this study, a submitter uses Qwen3.8-27B to select up to 20 candidate radiographs from pools of 1,000 Cheff-identified or SynthCheX images, while a receiver evaluates image quality via MedGemma 1.5 and predicts origin using a linear probe over frozen DINOv3 features. Although quality selection increases MedGemma quality passes from 12/20 to 19/20 for Cheff-identified images and from 8/20 to 17/20 for SynthCheX, we find no evidence that candidate selection increases passage through both checks simultaneously: zero selected Cheff-identified images pass both gates, and uniform, quality-guided, and surrogate-guided selection yield 2, 1, and 2 SynthCheX passes out of 20, respectively. On unprocessed test cohorts, the origin classifier rejects 4,677 of 5,000 SynthCheX images at a nominal 5% false-alarm rate (flagging 110 of 2,297 real NIH radiographs), yet leaves 152 SynthCheX images that pass both pixel-level checks. Moreover, pixel-level screening is fragile to routine distribution shifts: JPEG compression reduces SynthCheX-versus-NIH AUROC from 0.987 to 0.841, and applying the NIH-calibrated threshold to an external genuine cohort (Open-I) triggers false alarms on 568 of 957 authentic radiographs (59.4%). Because pixel-level checks can filter submissions but cannot verify clinical acquisition claims, we argue that dataset intake pipelines must record and verify source provenance independently of image pixels.

0.13

When Repository Labels Are Not Image-Level Truth: A Supervision Auditing Framework for Chest Radiograph AI

eess.IV cs.CV ·2026-08-10 ·Yesika Alexandra Agudelo-Londoño, Jhon Wilmer Pino-Román, Brahian Carrera Rodríguez, José Miguel Castañeda-Bedoya, Juan Pablo Gómez-López +7 more
published similarity 0.64
Abstract · Accepted (oral) at the 3rd MICCAI Student Board (MSB) EMERGE Workshop, MICCAI 2026. This is the authors' version; the final authenticated ve…

Public chest X-ray repositories are widely used to train medical AI systems, yet their labels are typically extracted from radiology reports rather than verified directly on images. As a result, repository labels are often treated as image-level ground truth without validating whether they reflect what is actually visible in the radiograph. We introduce Repository Supervision Auditing (RSA), a framework that evaluates repository-derived labels against expert image-level annotations before model development. Using cardiomegaly in MIMIC-CXR as a case study, RSA compares repository labels with radiologist-reviewed image annotations, characterizes disagreement sources, and builds a curated cohort for deployment-oriented evaluation. Repository-derived cardiomegaly labels showed near-zero agreement with expert image-level assessment, identifying only 1% of expert-confirmed cases. Most discrepancies resulted from non-mention rather than explicit report negation, with expert-confirmed cardiomegaly identified in nearly half of studies assigned a repository-derived No Finding label. Using the resulting expert-curated cohort, a DenseNet121 model achieved a test ROC-AUC of 0.853. These findings show that repository labels may not reliably represent image-level truth and highlight supervision auditing as a critical step for developing trustworthy medical imaging AI.

0.24

MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter

cs.CV cs.AIcs.LG ·2026-08-17 ·Vignesh Nagarajan, Sriram Venkatapathy
hot direction similarity 0.64
Abstract · 8 pages, 5 figures, 5 tables, 24 references

A radiologist reading a model's output faces two problems. The model returns a number and no reason, and any system that turns that number into readable prose can quietly add claims the model never made. MIRROR is a research prototype built to separate those failures. It chains a multi-label classifier, a Grad-CAM localizer that turns each positive finding into a named anatomical region, and a report writer that receives the labels, probabilities, and regions but never the image. Because the language layer cannot see pixels, it cannot assert a finding the classifier did not make. We are precise about what that buys: a MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text, and we show one stating a cardiothoracic ratio the system never measured. One registry holds the taxonomy, anatomy, and phrasing for chest X-ray, brain MRI, and head CT, so adding a modality is a data change; all three are routed and tested, one is trained. On ChestMNIST that classifier reaches macro AUROC 0.729 and ranks better than chance on all 14 labels, at 1.6 to 6.8 times the precision a random ranker would get. Yet at the default 0.5 threshold it emits no positive prediction at all for 11 of them, and its excellent-looking Brier score of 0.045 sits beside the 0.047 earned by a predictor that ignores the image. The discrimination is real; the decisions are not. Under the class imbalance normal in radiology, aggregate metrics flatter models that do nothing, and should be reported against that floor.

0.32

Leakage- and Label-Aware Benchmarking of Class-Imbalance Strategies for Multimodal Chest X-Ray and EHR Classification

cs.LG cs.CV ·2026-11-05 ·Dang-Khoa Bui, Quang-Huy Tran, Minh-Khoi Nguyen-Bui, Duc-Tuan Ngo, Thanh-Trong Tran +2 more
benchmark similarity 0.64
Abstract · 10 pages, 1 figure, 6 tables

Benchmarks of class-imbalance strategies for multimodal chest X-ray (CXR) and electronic health record (EHR) prediction are often evaluated on record-level splits of cohorts in which one patient contributes several radiographs. We audit such a benchmark on 29,083 MIMIC-CXR radiographs of 10,479 patients with eight diagnosis targets. First, the record-split benchmark was misleading: a lookup table that copies the label of a development-set radiograph with the same EHR vector nearly matched the best model, and on unseen patients every model fell to the level of predicting every case positive. Second, tracing the labels back to MIMIC-IV explained why: each patient's labels are keyword matches on the diagnosis codes of a single admission, copied, with one EHR vector per patient, to all of the patient's radiographs, so about a third of the radiographs carry labels that differ from the codes of their own admission. Third, under patient-separated evaluation with admission-aligned and rule-refined labels, the initial conclusions do not hold: in the evaluated configurations no imbalance strategy raised the observed mean macro F2 over no augmentation by more than 0.01, tuned tree ensembles showed no consistent advantage over tuned logistic regression, and the released EHR variables stayed at the level of the all-positive baseline, whereas the diagnostic history available at imaging time and image embeddings exceeded it, including, with rule-refined labels, a CheXpert-trained encoder that never saw these radiographs; RAD-DINO had seen 96.6% of them during self-supervised pretraining. Adding either encoder to the diagnostic history gave no statistically significant F2 gain; exploratory AUROC gains were significant with RAD-DINO but not with DenseNet. We provide reusable diagnostics, a leakage-aware protocol and a checklist.

0.24