CS Paper Radar

Reliability-Aware Hybrid-K Ensemble Selection for Cervical Cytology Classification: Integrating Discrimination, Calibration, and Selective Prediction

Nisreen Albzour, Sarah S. Lam

eess.IV cs.AIcs.CV ·submitted 2026-09-01 02:30 UTC · v1

Abstract

High classification accuracy alone is insufficient for clinical image analysis, where calibrated confidence and reliable uncertainty estimates are essential. This study proposes a reliability-aware Hybrid-K ensemble selection framework for multiclass cervical cytology classification using the SIPaKMeD dataset. Nine deep learning architectures were evaluated using a fixed stratified five-fold partition and three training seeds. After post-hoc temperature scaling, models were assessed using macro-F1, accuracy, AUROC, expected calibration error (ECE), worst-class ECE (WC-ECE), area under the risk-coverage curve (AURC), Brier score, and negative log-likelihood (NLL). Models were ranked using an equal-weight composite score, and Hybrid-K ensembles were formed from the top-ranked models using soft voting. Robustness was examined using 5,000 Dirichlet-sampled metric-weight vectors, leave-one-metric-out analysis, and corrected paired testing across 15 fold-by-seed evaluations. The final Hybrid-2 ensemble, comprising Swin-Tiny and TinyViT-5M, reduced AURC by 43%, NLL by 17%, and WC-ECE by 36% relative to the best individual model. It was selected in 96.8% of random weighting scenarios, remained unchanged across all leave-one-metric-out analyses, and improved the full composite score. However, per-metric gains were not statistically significant after Holm-Bonferroni correction (all adjusted p >= 0.168). Because post-hoc calibration did not use a fully independent calibration set, calibration-dependent results should be interpreted as exploratory internal estimates. Overall, the framework identified a compact ensemble robust to alternative metric weightings and improved reliability point estimates under internal validation on a single dataset.

Closest papers

Nearest neighbours by meaning across the whole index.

A Dual Cross-Attention Framework for Colposcopic CIN Grading and Swede Score Prediction Using a New Multi-Center Dataset

cs.CV ·2026-09-11 ·Dania Khan, Nuzhat Aisha Shaikh, Asfina Hassan Juicy, Raiyun Kabir, S M Shahida +1 more
code/data similarity 0.68
Abstract · 8 pages

Cervical cancer is a major global health challenge, with disease burden falling disproportionately on low- and middle-income countries (LMICs) due to a shortage of trained specialists and the subjective nature of colposcopy-based screening. To address this challenge, we propose a novel deep learning framework for the automated grading of Cervical Intraepithelial Neoplasia (CIN) and the prediction of clinical Swede scores. We also introduce the BUET Multi-Center Colposcopy Dataset, a novel, multi-center cohort designed and annotated for Swede score prediction and CIN grading. Our proposed dual-stream cross-attention architecture mimics the visual reasoning of an expert colposcopist by explicitly fusing paired multimodal cervigrams to evaluate comparative tissue responses. Furthermore, we introduce a custom composite loss function to address severe class imbalances and scoring inconsistencies across the five Swede score components. The proposed framework achieved 71.85% accuracy and an 86.23% AUC-ROC for three-class CIN grading, outperforming existing methods. For Swede score component prediction, the architecture achieved AUC-ROC values ranging from 75.7% to 88.4%, with the composite loss function yielding consistent F1-score improvements. Finally, the total predicted Swede Score, which ranges between 0 and 10, shows a Mean Absolute Error (MAE) of 1.489. The results show that the proposed method can pave the way towards developing AI-assisted colposcopy screening tools to support risk-based triage in resource-limited healthcare settings. The dataset and source code are publicly available(url: https://github.com/mHealthBuet/BUET-colposcopy)

0.33

Deep Learning for Cervical Cytology Screening: Methods, Algorithms, Challenges and Prospects

cs.CV ·2026-11-01 ·Jiang Yangbo, Zheng Nenggan
benchmark similarity 0.67
Abstract

Cervical cancer remains a leading cause of cancer death among women, with more than 90\% of deaths occurring in low- and middle-income countries, where cytology screening is constrained by a shortage of trained cytopathologists. Deep learning has made automated cytology screening increasingly feasible, but the literature is fragmented across cell, patch and whole-slide-image scales, task formulations and supervision regimes, hindering comparison and clinical translation. This Review synthesizes the deep learning literature for cervical cytology screening, organizing the field along three axes---data scale, functional task and supervision---and distinguishing two clinical roadmaps: whole-slide-image confidence aggregation and cell-level detection with Bethesda classification. We examine 16 publicly available or publicly documented cytology datasets alongside the CAISHI histopathology dataset, compare quantitative performance while exposing incomparable metrics and data leakage, and assess commercial systems, regulatory status, HPV-era screening pathways and low-resource deployment. Single-cell accuracy on Herlev and SIPaKMeD has plateaued, but this reflects benchmark saturation rather than clinical readiness; prospective and randomized evidence is emerging but remains limited. We consolidate the evidence into five challenge areas---data and benchmarks, architecture and label-efficient learning, trustworthy AI, clinical translation and health economics, and evaluation and reproducibility---and provide an evidence-to-agenda map and a deployment decision matrix. Progress now depends on multi-center benchmarks, externally validated label-efficient methods, calibrated and fair predictions, and pragmatic clinical trials rather than further gains on saturated single-cell benchmarks.

0.09

Beyond Discrimination: Evaluating Probability Calibration in Radiomics-Image Fusion for Renal Cell Carcinoma Classification

eess.IV cs.AIcs.CVq-bio.QM ·2026-10-09 ·Yuan Liang, Morgan May, Abraham Campbell, Sourav Bhattacharjee, Simon Caton +1 more
top venue similarity 0.67
Abstract · 12 pages. 1 figure. Accepted at the 2026 Irish Conference on Artificial Intelligence and Cognitive Science (AICS 2026). Proceedings forthcom…

Reliable probability estimates are important for the clinical interpretation of machine-learning classifiers, yet radiomics--image fusion models for renal cell carcinoma (RCC) are commonly evaluated primarily by discrimination. Using 396 patients from the KiTS23 dataset, we evaluated whether adding radiomics to four image-model families improved probabilistic performance in addition to discrimination. Seventeen individual models and four probability-average ensembles were assessed using discrimination, probability calibration, and proper scoring measures. Across 12 matched image-only versus fusion comparisons, AUC and AP improved in all 12, while Brier score and negative log likelihood (NLL) improved in 11 of 12 and expected calibration error (ECE) in eight of 12. The 3D MedVAE gated-fusion model achieved the strongest overall individual-model profile. Probability averaging across concatenation, cross-attention, and gated fusion produced favourable point estimates across all five primary metrics relative to image-only models in all four families, although paired-bootstrap support was stronger for Brier score and NLL than for ECE. These findings show that radiomics--image fusion can improve probabilistic prediction quality beyond discrimination, while calibration behaviour varies across image architectures and fusion strategies. We show that our proposed probability-average ensemble models improve discrimination and calibration simultaneously across all architectures in the study.

0.38

KESurv: A Kernel Ensemble Method for Patient-Specific Survival Prediction

cs.LG stat.ML ·2026-10-05 ·Rahul Goswami
similarity 0.62
Abstract

Predicting patient-specific survival functions is crucial for clinicians in making informed decisions about patient care and treatment strategies. Among the various models available, the Survival Forest has demonstrated significant effectiveness in numerous scenarios. In this work, we propose an ensemble method that leverages the strengths of the Survival Forest as the master model, complemented by several base models. This ensemble incorporates the Beran estimator, a type of kernel estimator, to enhance predictions of patient-specific survival curves. We evaluated the performance of our proposed model using four distinct healthcare datasets. The results highlight the superiority of our ensemble method over baseline models in both calibration and ranking across most datasets. The findings suggest that our approach offers a more accurate and reliable estimation of patient-specific survival functions, providing a valuable tool for clinical decision-making.

0.24

Uncertainty Identifies Difficult Samples Across Methods: A Multi-Task Study on a Heterogeneous Skin Lesion Dataset

cs.CV cs.LG ·2026-08-14 ·Leon Koole, Jiapan Guo, Matias Valdenegro-Toro
published similarity 0.60
Abstract · 12 pages, 9 figures, UNSURE 2026 @ MICCAI camera ready

Skin lesion classifiers can be confidently wrong on the cases that matter most, so knowing when a prediction should not be trusted is clinically as useful as the prediction. We study uncertainty quantification on a dataset pooled from many ISIC sources, with a shared backbone and two jointly learned heads: a binary malignant versus non-malignant head and a five-class diagnostic head. Five UQ methods (MC Dropout, DropConnect, Flipout, Deep Ensembles, DUQ) are compared on accuracy, calibration, uncertainty decomposition, and risk-coverage. Difficulty is largely method-agnostic: even methods with narrow entropy distributions rank the same samples as hard (per-sample entropy correlations of $0.54$ to $0.91$). The choice of method matters more for calibration and uncertainty decomposition, where Deep Ensembles is the clear winner, than for finding difficult cases. The ranking is also good enough that deferring the most uncertain cases removes a disproportionate share of errors, supporting uncertainty-based selective referral, evaluated here in-distribution only.

0.33

Ensemble of Convolutional Neural Networks for StrokePrediction: Towards Improved Diagnostic Accuracy

cs.CV cs.AI ·2026-08-25 ·Md Shahriar Sajid
similarity 0.59
Abstract

Brain stroke, known for its high mortality and incidence rates, poses significant health risks and requires rapid intervention for survival. Early diagnosis and preventive measures can greatly reduce life loss and disabilities. Recent advancements in deep learning have led to novel computer-aided diagnostic techniques for early stroke detection. This study proposes an intelligent system that predicts potential strokes using eleven features, evaluated through seven supervised machine learning algorithms. The process includes a literature review, dataset visualization, data preprocessing, and model evaluation. Ensemble methods like Random Forest, Stacking Classifier, and Bagging Classifier achieved high accuracies of 99.52%, while Decision Tree reached 98.24%. Other models, including KNN and TabNet, demonstrated reliable performance, achieving accuracies of 96.73% and 96.49%, respectively. The custom feedforward model achieved 94.91%, while SVC and logistic regression had lower accuracies at 88.06% and 77.03%. The results highlight the effectiveness of ensemble methods in stroke classification.

0.32

Multi-Label 12-Lead ECG Classification on the PTB-XL Dataset: A Comparative Evaluation of Deep Learning Architectures and Heterogeneous Ensemble Approaches

eess.SP ·2026-09-11 ·Yunus Emre Mert, Ece Akdoğan, Hüseyin Üvet
similarity 0.59
Abstract · 6 pages, 2 figures, 1 table

This study aimed to compare the performance of different deep learning architectures and heterogeneous ensemble learning approaches for multi-label 12-lead ECG classification on the PTB-XL dataset. Five different models, namely 1D-ResNet18, Bidirectional Mamba, xLSTM, CWT-ViT-KAN, and the pre-trained ECGFounder, were evaluated. Utilizing the recommended split structure of the PTB-XL dataset, folds 1-8 were allocated as the training set, fold 9 as the validation set, and fold 10 as the independent test set. In addition to the individual models, three different ensemble approaches were investigated: Equal-Weight Soft Voting, Validation-Weighted Soft Voting, and stacking. Among the individual models, the highest performance was achieved by ECGFounder, with a Macro AUROC of 0.930 and a Macro AUPRC of 0.823. For the ensemble models, the highest values in the primary macro performance metrics were obtained by the stacking approach, achieving a Macro AUROC of 0.936, a Macro AUPRC of 0.836, and a Macro F1 of 0.763. The highest subset accuracy of 0.630 was achieved using the Validation-Weighted Soft Voting method. The findings indicate that heterogeneous ensemble models, which combine different representation learning approaches, can provide additional performance improvements over individual models in multi-label ECG classification.

0.20

MammoMix: Leveraging Mixture of Experts for Robust Mammogram Breast Detection

cs.CV ·2026-08-11 ·Dinh Tan Nguyen, Hoang Quan Dang, Chen Zhang, Sai Ho Ling
published similarity 0.59
Abstract · Australasian Joint Conference on Artificial Intelligence 2025

Breast lesion detection in mammography remains a challenging task due to variations in image quality, lesion appearance, and population demographics across datasets. While current object detectors such as YOLO and DETR achieve strong results on individual datasets, their performance often degrades when trained on or applied across heterogeneous sources. To address this, we propose MammoMix, a novel framework based on Mixture-of-Experts (MoE) paradigm for robust and generalizable lesion detection. In MammoMix, each expert model is trained on a specific domain, allowing it to specialize in distinct characteristics of its source data. A gating mechanism adaptively weighs contributions from each expert based on input image, combining their outputs to enable domain-adaptive inference. To improve reliability, we further incorporate a calibration module, MoCAE, which adjusts confidence scores to reflect true predictive uncertainty. We evaluate MammoMix on 3 public mammography datasets: CSAW, DDSM, and DMID, covering diverse clinical settings. Results show that MammoMix outperforms baseline detectors in both average precision and reliability, particularly on datasets with greater variability. Our findings demonstrate that expert specialization and calibrated ensemble fusion significantly enhance model generalization and robustness. MammoMix offers a promising step toward dependable AI-assisted breast cancer screening across real-world clinical domains.

0.52