CS Paper Radar

FSS-UBrain: Multi-region Few-Shot Brain Tumor MRI Segmentation

Truong Viet Vu, Nguyen Phuc Nguyen, Dang Thi Thu Hang, Tran Thien Thanh, Vo Nguyen Quoc Bao, Nguyen Thai Anh, Ngo Hoang Tu

cs.CV ·submitted 2026-09-26 06:01 UTC · v1
published

Abstract

Accurate delineation of whole tumor (WT), tumor core (TC), and enhancing tumor (ET) from multimodal magnetic resonance imaging remains challenging under limited annotation, cross-cohort variation, and severe target sparsity. We propose FSS-UBrain, a region-wise one-shot segmentation framework that uses a labeled positive support slice to condition binary query segmentation separately for WT, TC, and ET. Support-derived foreground and background descriptors guide query-feature adaptation, bottleneck interaction, decoder-side reconstruction, and boundary refinement. Episodic training additionally incorporates hard-negative and fully negative queries with empty-query regularization to suppress spurious foreground activation when the selected region is absent. Although inference operates on two-dimensional support--query slice pairs, checkpoint selection, threshold calibration, and final evaluation are performed after volumetric reconstruction. FSS-UBrain is evaluated on a held-out BraTS 2020 split and under target-supported cross-cohort protocols on BraTS 2023 and BraTS-Africa. Cases used as target support are excluded from the query cohorts, and no target-domain fine-tuning or test-time parameter updates are performed. On BraTS 2020, FSS-UBrain achieves volumetric Dice scores of 89.82%, 82.14%, and 77.42% for WT, TC, and ET, respectively, with corresponding 95th-percentile Hausdorff distance (HD95) values of 11.12, 9.01, and 4.46 mm. It also achieves the highest mean Dice and lowest finite-pair mean HD95 point estimates on BraTS 2023 and BraTS-Africa among the compared few-shot methods. These findings support target-conditioned few-shot segmentation while highlighting sensitivity to support selection and cohort-specific variation.

Comment
This work has been submitted to the Elsevier for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible
Journal ref
Neurocomputing, vol. 709, p. 135301, 2027
DOI
10.1016/j.neucom.2026.135301

Closest papers

Nearest neighbours by meaning across the whole index.

VGG16-MCA UNet: Whole-Tumor Segmentation in 2D FLAIR MRI with Decoder-Side Channel Attention

eess.IV cs.CV ·2026-09-20 ·Shubham Gajjar, Deep Joshi, Avi Poptani, Vishal Barot
benchmarktheorycode/data similarity 0.74
Abstract · 22 pages, 7 figures, 4 tables. Code and data splits: https://github.com/ShubhamGajjar/vgg16-mca-unet

Automated brain tumor segmentation supports diagnosis, treatment planning, and monitoring of disease progression, but building models that generalize across heterogeneous tumors and limited annotated data remains difficult. We present VGG16-MCA UNet, a hybrid architecture pairing an ImageNet-pretrained VGG16 encoder with a decoder in which a Multi-Channel Attention (MCA) module recalibrates features after each skip-connection fusion, trained with the Focal Tversky loss to counter severe foreground-background imbalance. We evaluate the model as a 2D, FLAIR-only, whole-tumor segmenter on tumor-positive slices from two public datasets: the BraTS 2020 benchmark and the LGG MRI Segmentation dataset. Using 5-fold cross-validation and a single network formed by averaging the weights of the five fold models, the method attains an aggregate pixel-level Dice (F1) of 95.10% on our held-out BraTS 2020 split and 88.32% on LGG. These scores are computed over all test pixels pooled into a single confusion matrix rather than averaged per case, and are therefore not directly comparable to the per-case mean Dice used in the BraTS challenge protocol. All partitions were drawn over individual slices rather than over patients, so every patient contributes slices to both training and test; the figures above therefore measure interpolation within known patients and should be read as an upper bound rather than as generalization to new ones. The model segments a 256x256 slice in 66.32 ms on a single 6 GB NVIDIA RTX 2060, approximately 8 ms more than an equivalent VGG16-UNet without MCA. We release the split records and report the protocol in full, with the aim of providing a precisely specified and reproducible 2D FLAIR baseline.

0.23

A Simple yet Effective Framework for Pre-treatment and Post-treatment Glioma Segmentation Using Multimodal MRI

eess.IV ·2026-10-01 ·Lin Qu, Ziqi Chen, Anqi Wu, Jinyao Shen, Hai Shu
published similarity 0.73
Abstract · The proposed method won second place in the MICCAI 2025 BraTS Lighthouse Challenge on Glioma Segmentation on Pre- and Post-Treatment MRI (Br…

Accurate glioma segmentation across pre- and post-treatment MRI remains challenging because treatment alters both image appearance and the target regions. In particular, the resection cavity (RC) is defined only for post-treatment cases, complicating joint learning from pooled data. We present RC-aware nnU-Netv2, a simple yet effective glioma segmentation framework that combines lesion- and boundary-aware single-cohort training, an RC-aware joint learning objective, and treatment-status-guided model routing at inference. During pooled training, the joint objective applies both standard and boundary-weighted binary cross-entropy to all four region channels, while employing Dice supervision for channels with non-empty targets and a controlled false-positive penalty for channels with empty targets across the mini-batch. This design explicitly accommodates the absence of RC in pre-treatment cases. Our approach uses only the standard nnU-Netv2 data augmentation and a single specialized model per case, without additional synthetic tumor generation or multi-model ensembling. RC-aware nnU-Netv2 ranked second in the BraTS 2025 Lighthouse Challenge Task 1 (BraTS-GLI 2025), with segmentation performance comparable to that of the first-place method, which relied on on-the-fly GliGAN-based synthetic tumor augmentation and multi-model ensembling. On the official blind test set, our method achieved mean lesion-wise Dice scores of 0.7878, 0.8709, 0.7923, and 0.8715 and mean NSD@1.0 scores of 0.8309, 0.8712, 0.7980, and 0.8336 for enhancing tumor, RC, tumor core, and whole tumor, respectively. In paired post-treatment analysis, the RC-aware joint model improved mean lesion-wise Dice by 0.042 (95% CI: [0.028, 0.057]) and mean NSD@1.0 by 0.043 (95% CI: [0.028, 0.059]) compared with the joint baseline.

0.13

On the Role of MRI Sequences in Cross-Dataset Generalization for Brain Tumor Segmentation

cs.CV ·2026-08-30 ·Henrique Zan Grande, João G. Pitol, Lucas B. Schuck, Rafael V. Serenato, Rayson Laroca +1 more
publishedcode/data similarity 0.72
Abstract · Accepted for presentation at the 2026 Conference on Graphics, Patterns and Images (SIBGRAPI)

Brain tumor segmentation in magnetic resonance imaging (MRI) is a critical task for diagnosis and treatment planning. Despite the success of deep learning architectures such as U-Net and its variants, performance degradation across datasets remains a major challenge, particularly under domain shift and limited annotated data. To address this issue, this study systematically evaluates how individual MRI sequences influence model robustness across two well-known datasets. A ResUNet-based framework is employed, where each modality is trained independently to isolate its effect under a controlled cross-dataset evaluation protocol with tumor size stratification, without target-domain training, or with limited domain adaptation. Results show that the T2f/FLAIR sequence achieves the best cross-dataset performance, with Dice scores exceeding 75%. It consistently outperforms other modalities across most tumor size ranges, while multi-sequence training further improves performance. Additionally, even limited target-domain adaptation yields rapid initial gains, reducing the need for extensive annotations and costly retraining. Our source code is publicly available at https://github.com/henrique-zan/brain_tumor_segmentation/.

0.39

Progressive multi-scale tumor-state memory for incomplete multimodal brain tumor segmentation

eess.IV cs.CV ·2026-10-19 ·Milad Rostamian, Mohammadreza Mohammadi, Mohsen Soryani
similarity 0.71
Abstract

Brain tumor segmentation uses complementary magnetic resonance imaging (MRI) sequences, but some sequences may be unavailable in practice. Their absence changes the information available for segmenting different tumor regions. Fusion methods can support different input subsets. However, fusion at several scales does not by itself specify how tumor evidence is retained and updated to guide fusion at later stages. We propose a progressive multi-scale tumor-state memory network (PMTM) for segmentation from any non-empty subset of T1ce, T1, FLAIR, and T2. PMTM maintains a compact state for the current subject across the encoder stages. At each stage, we use assignment maps to pool spatial features into ordered evidence vectors for each available modality. We average these vectors across the available modalities, and a learned gate combines this evidence with the previous state. The up- dated state guides residual fusion at that stage and is used in the state update at the next stage. A modality-token mixer also models interactions among the available modalities at each stage. We apply semantic supervision to the assignment maps at all four stages. We evaluate PMTM on BraTS2018, BraTS2020, and BraTS2023 GLI across all 15 non-empty modality subsets. Averaged over the three tumor regions and the 15 subsets, PMTM achieves Dice scores of 75.31%, 77.54%, and 80.47% on BraTS2018, BraTS2020, and BraTS2023 GLI, respectively. These scores are higher than those of RobustSeg, RFNet, and mmFormer in our experiments on each dataset. Component ablations and internal state analysis are performed on BraTS2020.

0.06

NeuroCBIR: A Fast and Accurate Image Retrieval System for Whole-Brain and Region-Specific MRI

cs.CV cs.LGq-bio.NC ·2026-10-05 ·Felix Nieto-del-Amor, Jingru Fu, J. -Sebastian Muehlboeck, Eric Westman, Daniel Ferreira +1 more
code/data similarity 0.70
Abstract · Neuroimaging, Content-Based Image Retrieval, MRI, Zero-Shot Learning

Content-based image retrieval (CBIR) in neuroimaging enables the identification of structurally similar brain scans, supporting diagnosis, prognosis, and treatment planning; however, existing methods are often limited to small datasets, single brain regions, or coarse class labels, thereby restricting their clinical utility and generalizability. Here, we present NeuroCBIR, a framework for fast and flexible retrieval of both whole-brain and region-specific 3D T1w MRI scans. A total of 103 cortical and subcortical regions are extracted to enable both whole-brain and region-level queries. NeuroCBIR leverages latent representations learned by a variational autoencoder (VAE) combined with contrastive learning, producing scan-specific embeddings that capture anatomical patterns. These embeddings were evaluated for subject re-identification, zero-shot age prediction, and zero-shot multi-class pathology stratification. Re-identification performance was high across both whole-brain and brain-region levels (mean average precision across the top-5 retrieved images (mAP@5) >= 98.4%), with robust generalization across datasets and acquisition conditions. While NeuroCBIR is not trained for age prediction or pathology stratification, zero-shot evaluations for these two tasks demonstrate that the embeddings encode meaningful information for downstream tasks. Embedding extraction on a 4-core CPU required approximately 18.7 s per scan, whereas similarity search was effectively instantaneous (less than 0.01 s). NeuroCBIR is publicly available for brain MRI with more than 26,000 precomputed T1w MRI embeddings. It supports reproducible research, region-specific flexibility, and clinically meaningful personalized diagnostic support. The software is available at https://github.com/minnelab/NeuroCBIR.

0.26

NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI

cs.CV cs.LG ·2026-09-15 ·Darius Peteleaza, Razvan-Gabriel Dumitru, Bogdan Neamtu, Arpad Gellert, Mariana Sandu +1 more
publishedcode/data similarity 0.69
Abstract · Accepted at the 2026 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) - BraTS Cluster of Chal…

Pediatric brain tumors are a leading cause of cancer-related mortality in children, and their small, rare, and often low-contrast subregions make accurate manual delineation challenging. Reliable automated segmentation is therefore needed to support diagnosis, treatment planning, and response assessment. Accordingly, we introduce NeuroTS-Net, a three-dimensional encoder-decoder convolutional neural network architecture for multi-class semantic segmentation that incorporates a dual-scale raw-detail stream, adaptive low-resolution context selection, and detail-preserving multipath downsampling. These components preserve fine intensity and boundary information while efficiently modeling broader tumor context. NeuroTS-Net was trained on the BraTS 2026 pediatric dataset without external data or pretrained weights and evaluated against nnU-Net and MedNeXt under the same experimental protocol. NeuroTS-Net outperformed the baseline methods, achieving whole-tumor and tumor-core Dice scores of 0.938 and 0.937 on the internal validation set and 0.927 and 0.926 on the official challenge validation set. The code is open-sourced at: https://github.com/maenstru56/NeuroTS.

0.37

Quality-Governed Deep Learning Network for Brain Tumor MRI Segmentation

cs.CV cs.AI ·2026-11-03 ·Asifiqbal Saiyed, Nitesh Chilakala, Jimmy Joseph, Praneetha Goli, Rohini Maskar
published similarity 0.68
Abstract

The segmentation of brain tumors from magnetic resonance imaging (MRI) is an essential step for computer-aided neuro-oncology, treatment planning and follow-up. While effective encoder-decoder representations are achieved by U-Net and Attention U-Net, the skip sections of the network can generate weak-contrast or noisy responses in the case of heterogeneous boundaries of the tumor. In this paper, we introduce a Quality-Governed Deep Learning Network (QGDL-Net) that can be used for binary tumor segmentation from FLAIR MRI slices. The proposed model is able to predict the slice quality based on contrast and SNR statistics and to fine-tune the encoder features prior to decoding by learnable quality gates. We used the 80:20 train-validation split for experiments with BraTS 2021. QGDL-Net achieved a Dice of 0.9747, IoU of 0.9506, precision of 0.9755, recall of 0.9739, F1 of 0.9747 and accuracy of 0.9982, outperforming U-Net and Attention U-Net. The EigenCAM maps and segmentation overlays provide better tumor localization and interpretable activation around the lesion regions.

0.30

CarveMix-RC: Addressing Rare-Class Imbalance Through Lesion-Aware Synthetic Augmentation for Brain Metastasis Segmentation

cs.CV cs.AI ·2026-09-28 ·Md Shibly Sadique, Md Fayaz Bin Hossen, Michael L. Evans, Walia Farzana, Asfaqur Rahman +2 more
benchmark similarity 0.68
Abstract · 14 pages, 2 figures, 2 tables

Accurate segmentation of post-treatment brain metastases is essential for treatment planning, longitudinal disease monitoring, and quantitative assessment of therapeutic response. The BraTS-MET 2026 Task 1 challenge introduces a clinically relevant segmentation problem involving four anatomically distinct tumor subregions: non-enhancing tumor core (NETC), surrounding non-enhancing FLAIR hyperintensity (SNFH), enhancing tumor (ET), and the resection cavity (RC). Among these, RC segmentation is particularly challenging because of its low prevalence, heterogeneous postoperative appearance, and lesion-wise evaluation protocol, leading conventional segmentation networks to prioritize dominant tumor classes during optimization. The proposed nnU-Net-based framework explicitly addresses RC segmentation through four complementary components: (i) RC-weighted Dice and Cross-Entropy optimization to alleviate class imbalance, (ii) anatomically consistent cavity augmentation to increase the diversity of postoperative cavity appearances, (iii) a residual encoder architecture for enhanced multi-scale feature learning, and (iv) lesion-aware morphological post-processing to suppress false-positive cavity predictions while preserving anatomically plausible structures. The framework is evaluated on the BraTS-MET 2026 Task 1 online validation benchmark. Among the evaluated configurations, the ensemble model (Residual Encoder nnU-Net + nnU-Net + RC-aware CarveMix) achieves the best performance, with lesion-wise Dice scores of 0.732, 0.752, 0.708, and 0.575 and corresponding NSD scores of 0.794, 0.798, 0.727, and 0.474 for ET, TC, WT, and RC, respectively. These experimental results show that integrating RC-aware optimization, anatomically consistent augmentation, and lesion-aware post-processing provides an effective strategy for improving rare resection cavity segmentation in post-treatment brain metastases.

0.08