CS Paper Radar

3D CT-to-PET Translation via Latent Brownian Bridge Diffusion

Sarita Mourya, Francesco Di Feola, Pierangelo Veltri, Paolo Soda

cs.CV cs.AI ·submitted 2026-09-11 13:47 UTC · v1

Abstract

Computed tomography (CT) and positron emission tomography (PET) provide complementary anatomical and functional information for cancer diagnosis and treatment planning. However, the widespread use of PET is limited by high radiation exposure, elevated costs, and restricted availability. To address these limitations, deep learning-based CT-to-PET translation has emerged as a promising approach for synthesizing PET-like information directly from CT images, although accurately modeling the large cross-modal gap remains challenging. In this work, we propose a 3D CT-to-PET translation framework based on latent Brownian Bridge Diffusion (BBDM). The method consists of two stages. First, a Variational Autoencoder (VAE) is trained on paired CT-PET patches, integrating contrastive learning to improve latent alignment between anatomical and metabolic representations. Second, a BBDM is trained in the latent space to translate CT latent representations into their corresponding PET counterparts. The translated PET latents are then decoded and stitched to reconstruct the final 3D PET volume. We evaluate the proposed approach on two publicly available datasets. Quantitative results based on image fidelity and lesion-level PET-specific metrics demonstrate improved performance compared with competing methods. In particular, the proposed approach improves PET signal fidelity, better preserves clinically relevant uptake patterns, and shows improved performance in preserving small-lesion metabolic activation, paving the way for virtual imaging applications.

Closest papers

Nearest neighbours by meaning across the whole index.

Domain-Adapted Latent Diffusion Models for CT-to-PET Image Translation

cs.CV ·2026-10-26 ·Yann Bourdé, Lea Bogensperger, Arnela Hadzic, Michael Krauthammer
similarity 0.82
Abstract

Positron Emission Tomography (PET) provides important metabolic information for tumor detection and staging but remains significantly less accessible than Computed Tomography (CT) due to its high cost, infrastructure requirements, and reliance on injected radioactive tracers. CT-to-PET image translation using generative models aims to address this disparity, yet state-of-the-art diffusion-based methods are limited by the scarcity of paired training data. To overcome this, we propose a domain-adapted latent diffusion framework that transfers natural-image priors using a relatively small dataset of 21,930 paired CT/PET slices, incorporating a signed power transform to resolve extreme intensity sparsity in PET data. Compared to CPDM, a state-ofthe-art baseline for CT-to-PET image translation, our approach yields superior performance in pixel-wise reconstruction and localized tumor fidelity, demonstrating effective transfer of natural-image priors to the medical domain. We further provide a systematic analysis of evaluation metric reliability for sparse PET data, showing that standard full-image metrics can be misleading indicators of translated image quality, and propose background-filtered and mask-restricted metrics as more clinically meaningful alternatives.

0.16

3D Diffusion Models for Medical Imaging

cs.CV ·2026-10-19 ·Frank-Peter Schilling, Daniel Barco, Philipp Denzel, Marc Stadelmann
publishedsurvey similarity 0.74
Abstract · 27 pages, accepted for publication in Informatics in Medicine Unlocked

Generative deep learning methods such as Variational Autoencoders, Generative Adversarial Networks or Diffusion Models have achieved remarkable results in image synthesis. In particular, Diffusion Models have demonstrated superior image fidelity and sample diversity compared to other approaches on standard benchmarks, while also offering more flexible training dynamics as evidenced both in natural image domains and in medical applications. In medical imaging including Computed Tomography, Magnetic Resonance Imaging or Positron Emission Tomography, such models have various important use-cases including data augmentation, domain transfer, image reconstruction, inpainting, image augmentation and artifact correction. Further, generated images can be conditioned on patient characteristics, medical reports, segmentation masks or other images. Specific challenges arise due to the 3D volumetric nature of medical images, which translate to substantial demands in terms of memory, compute, and training data. This article provides a comparative overview of 3D Diffusion Models which have been developed for medical images, with a focus on current performance, limitations, and an outlook for future work.

0.23

MedicalDPO: Multi-Objective Direct Preference Optimization for CT to PET Translation

cs.CV ·2026-11-16 ·Huiting Zhang, Yingxin Cai, Siyuan Wang, Xi Yang, Yuyao Yan +2 more
similarity 0.72
Abstract

CT-to-PET synthesis estimates functional PET images from anatomical CT scans for auxiliary analysis, representation pretraining, and missing-modality completion. Brownian Bridge diffusion models can produce multiple PET candidates of different quality under the same CT condition, exposing an intra-condition quality hierarchy. Candidate quality spans complementary spatial, structural, and intensity dimensions, while DPO-only fine-tuning may compromise absolute synthesis fidelity. We propose MedicalDPO which converts this hierarchy into preference supervision automatically constructed from paired CT-PET training data. Multiple candidates are ranked across the three fidelity dimensions, and strict cross-metric verification retains preferred-rejected pairs with consistent quality separation. Relative denoising-error preference optimization is jointly trained with the original Brownian Bridge objective to anchor the pretrained CT-to-PET mapping, while condition-balanced multi-pair rotation distributes preference supervision across CT conditions. Experiments on BBDM and CPDM show improvements across LPIPS, MAE, SSIM, and PSNR. Further analyses demonstrate metric complementarity and clear pair separation, while ablations show that the original training objective prevents the substantial degradation caused by DPO-only fine-tuning.

0.24

Efficient 3D Whole-Body PET Image Denoising via Conditional Rectified Flow With Optimized Sampling Strategy

cs.CV ·2026-09-15 ·Jiale Shen, Guolin Wang, Chenhao Wang, Xinhui Su, Wei Luo +1 more
similarity 0.72
Abstract

Reducing radiation exposure in Positron Emission Tomography (PET) is important for patient safety; however, ultra-low-dose imaging suffers from severe noise, which may affect diagnostic interpretation without appropriate image enhancement. While current 3D deep generative models, particularly diffusion models, have shown strong reconstruction fidelity, their practical use can be limited by long inference times. In contrast, faster 2D-based alternatives may have difficulty maintaining volumetric consistency, an important consideration for whole-body PET imaging analysis. To bridge this gap, we propose a one-pass conditional 3D rectified flow (3D Flow) framework for whole-body PET image denoising that incorporates a novel optimized non-uniform sampling strategy. The model is trained with a one-pass linear-interpolant velocity-matching objective. This approach reconstructs a full 3D volume in approximately 30 seconds in our implementation, compared with multi-hour inference for the evaluated 3D DDPM baseline. Evaluations including zero-shot transfer to an independent clinical dataset show that our model achieves favorable global image quality and lesion conspicuity compared with the evaluated 3D DDPM and DDIM baselines, including on challenging short-acquisition data. Furthermore, the proposed method shows promising zero-shot transfer performance across the evaluated datasets and unseen dose levels (down to 1/100 of the standard dose), with artifact-focused visual comparisons supporting the need for further lesion-level validation. By balancing reconstruction fidelity and computational efficiency, this work presents a candidate approach for ultra-low-dose whole-body PET image denoising.

0.08

Generative Priors for Total-Body PET Reconstruction

eess.IV cs.CV ·2026-09-18 ·Movindu Dassanayake, George Webber, Denis Prokopenko, Julia A. Schnabel, Andrew J. Reader
published similarity 0.72
Abstract · MICCAI RIME 2026 (Accepted Poster)

Total-body positron emission tomography (TB-PET) enables fast, low-dose, and dynamic imaging over a long axial field of view, but reconstruction remains challenging due to reduced counts, large image volumes, and increased data dimensionality. Generative models offer powerful learned priors for low-count PET, yet explicit PET measurement conditioning at TB scale has not been demonstrated. Inspired by PET decomposed diffusion sampling (PET-DDS), we propose TB-PET-DDS, a reconstruction framework that combines a CT-conditioned generative prior with patient-specific list-mode PET data. During reverse diffusion, PET consistency is enforced using a closed-form 3D TB-PET maximum-a-posteriori expectation maximisation fusion update, rather than relying solely on image-domain conditioning. The synthetic measurements are generated from the low-dose vendor reconstruction, providing a controlled inverse problem and retaining a full-dose reference. Proof-of-concept evaluation was performed on a single clinical TB-PET acquisition, with reconstruction hyperparameters selected against the full-dose reconstruction from the same case for all models. TB-PET-DDS improved NRMSE and SSIM relative to the DDIM and Image-DDS baselines, improving through-plane consistency in coronal views while enhancing agreement with the measured PET data. Although smoothed low-dose vendor reconstructions achieved the best global voxel-wise metrics, TB-PET-DDS produced the lowest liver coefficient of variation. These results demonstrate the feasibility of measurement conditioned diffusion reconstruction at TB scale and provide an initial route towards learned, projector-consistent generative reconstruction for low-count TB-PET imaging.

0.13

Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI

cs.CV ·2026-08-28 ·Meng Zhou, Wenhao You, Yuxing Chen, Yueying Tian
similarity 0.69
Abstract · Preprint, code will be released after review

Joint-embedding predictive architectures (JEPAs) have primarily been developed for self-supervised representation learning. Denoising JEPA (D-JEPA) recently demonstrated strong generative capabilities on natural images, yet the applicability to 3D medical imaging remains unexplored. Building on the D-JEPA framework, we present Med-D-JEPA, a systematic adaptation and evaluation of joint-embedding predictive generation for 3D brain MRI. Med-D-JEPA operates on continuous latent tokens produced by a 3D KL-regularized adversarial variational autoencoder, and combines masked context prediction, representation-level alignment, per-token diffusion, and iterative next-set-of-token sampling. We evaluate unconditional and class-conditional generation quality on BraTS2019 and OASIS-1 datasets; downstream classification utility; and preliminary whole-tumor segmentation on BraTS2020. Across different generation settings, Med-D-JEPA achieves superior or competitive performance compared to several strong baselines on fidelity and diversity metrics. Compared to training with real samples, Med-D-JEPA-based synthetic pretraining improves classification AUC from 0.63 to 0.85 on BraTS2019 and from 0.78 to 0.87 on OASIS-1. In the segmentation study, pretraining on Med-D-JEPA samples improves Dice from 0.74 to 0.80 and reduces HD95 from 13.40 to 9.56 mm. These findings establish joint-embedding predictive generation as a promising direction for 3D medical image synthesis and encourage further research in this direction.

0.47

Manifold-Constrained PET Reconstruction with Learned Flow-Matching Priors

eess.IV ·2026-08-29 ·Hengjia Ran, Jie Luo, Yutao Zhu, Rui Hu, Fenglin Zhan +3 more
similarity 0.68
Abstract

Image reconstruction for positron emission tomography (PET) is an ill-posed Poisson inverse problem. In this work, we introduce an unsupervised, optimization-based reconstruction framework that employs a flow-matching generative model as a learned manifold prior. We train the generative model on high-quality PET images to learn a differentiable ordinary differential equation (ODE)-based transport from a Gaussian latent distribution to the PET image distribution. We incorporate this generator as an explicit manifold constraint into a regularized Poisson likelihood formulation. To solve the resulting problem, we develop an alternating direction method of multipliers (ADMM) algorithm that integrates an expectation-maximization (EM)-type surrogate update for Poisson data fidelity with gradient-based latent-space optimization. Numerical simulations and in vivo PET experiments demonstrate improved reconstruction accuracy compared with conventional reconstruction methods and recent deep learning-based approaches, particularly in low-count settings, with competitive computational efficiency.

0.07

Accurate MRI-free PET Quantification and Reliability Assessment via CT-to-MRI Synthesis and Conformal Prediction

cs.CV ·2026-10-29 ·Jungwoo Seo, Seung Yun Choi, Kun Ho Lee, Seun Jeon, Byoung Seok Ye +1 more
similarity 0.68
Abstract · 28 pages, 8 figures, including supplementary material. Submitted to Medical Image Analysis

Standardized uptake value ratio (SUVR) quantification of amyloid PET commonly relies on a subject-specific T1-weighted MRI, yet a usable MRI is not always available. We therefore combined CT-to-MRI synthesis with conformal prediction for MRI-free PET quantification with reliability assessment. A slice-consistent Brownian Bridge Diffusion Model was strengthened with multi-dataset training and data-source conditioning to enrich the anatomical prior learned from MRI, and with expanded multi-slice CT context to exploit the through-plane continuity of subject-specific anatomy in CT. Synthetic MRI was used for FreeSurfer-based anatomical parcellation and PET quantification, while deep-ensemble uncertainty was calibrated with conformal prediction to estimate a plausible range for the corresponding real MRI-based SUVR. On $^{11}$C-PiB PET from OASIS-3, the proposed method achieved the highest synthesis and parcellation fidelity among the compared methods. Mean cortical SUVR from the proposed synthetic MRI agreed closely with the real MRI-based reference (MAE $0.016 \pm 0.015$, Pearson $r = 0.9987$) and yielded the same amyloid-positivity classification as the real MRI in all 87 test subjects at the prespecified cut-off. Conformal prediction achieved empirical coverage close to the prespecified levels, and at 90% target coverage, 85 of 87 subjects had prediction intervals that supported an unambiguous amyloid-positivity decision. Zero-shot evaluation on an independent external cohort showed that the proposed CT-to-MRI model could support PET quantification without retraining, although conformal calibration required target-cohort recalibration to recover the intended coverage. These findings support CT-to-MRI-based MRI-free PET quantification as a promising approach for providing accurate SUVR measurements and an explicit assessment of their reliability.

0.31