CS Paper Radar

Generative Translation Priors: Bayesian Imaging with Cross-Modality Image Translation

Evan Bell, Jiaming Liu, Yifan Chen, Yu Sun

eess.IV cs.CVcs.LG ·submitted 2026-08-28 21:16 UTC · v1
code/data

Abstract

The ability to leverage images from co-available modalities to inform target-domain reconstruction is highly desirable in imaging algorithms. In this work, we introduce Generative Translation Priors (GTP)--a Bayesian framework that transforms diffusion-based image-to-image translation models into cross-modality image priors for ill-posed imaging inverse problems. GTP incorporates target-domain measurements through likelihood guidance, steering the translation process toward the desired posterior distribution. The framework is grounded in a theoretical analysis of the resulting posterior dynamics, which reveals an intrinsic bias introduced by likelihood guidance. We further characterize this bias and derive a ground-truth-free formulation for its estimation, enabling it to serve as a practical metric for assessing posterior sampling quality. Building on this analysis, we derive two discretized GTP algorithms based on gradient and proximal likelihood guidance, respectively. We validate GTP on computed tomography reconstruction with magnetic resonance side information, and on positron emission tomography reconstruction with computed tomography side information. Experiments demonstrate that GTP effectively incorporates complementary cross-modality information and achieves high-fidelity reconstruction even under severely undersampled measurements.

Comment
51 pages, 12 figures. Code is available at https://github.com/Hopkins-CIG/GTP

Closest papers

Nearest neighbours by meaning across the whole index.

Picard Proximal Monte Carlo for Parallel Bayesian Imaging with Score-Based Generative Priors

cs.LG ·2026-08-18 ·Deliang Wei, Evan Bell, Wenhan Guo, Yifan Chen, Yu Sun
similarity 0.73
Abstract

Bayesian imaging inverse problems often require sampling from high-dimensional posterior distributions. While recent score-based and diffusion models provide expressive Bayesian priors, their sampling procedures remain inherently sequential and computationally expensive for large-scale imaging applications. We propose PiX-MC, a time-parallel posterior sampling framework based on proximal Langevin dynamics and Picard iteration. The proximal-likelihood formulation exploits the fact that many imaging likelihoods admit efficient, problem-specific proximal operators, while Picard refinement exposes parallelism across discretization nodes and naturally supports multi-GPU implementation. To further improve practical scalability and sampling performance, we develop multi-block and annealed variants of the proposed framework. We establish convergence guarantees under transparent assumptions, accommodating non-log-concave posteriors, imperfect learned score models, multi-block implementations, and annealing schedules. Experiments on a diverse collection of imaging inverse problems demonstrate that PiX-MC substantially reduces wall-clock time while preserving reconstruction quality. On a $512\times512\times80$ sparse-view computed tomography (CT) problem, annealed multi-block PiX-MC achieves up to a $50\times$ runtime speedup over the standard Langevin sampler using eight GPUs.

0.09

A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors

cs.AI stat.MLcs.LG ·2026-08-15 ·Zhaoqiang Liu, Tongyao Pang, Ruibing Wang, Yang Zheng
theory similarity 0.73
Abstract · 26 pages, 5 figures, 3 tables

Pretrained diffusion models represent image distributions through a continuum of progressively smoothed distributions. This multiscale structure organizes generation from global structure to fine detail and supports high-quality, diverse samples. We exploit the same multiscale diffusion prior for linear imaging inverse problems. Rather than using the pretrained model only as a denoiser in an outer iteration, we define a surrogate likelihood whose center is aligned with the clean-image coordinate and whose covariance accounts for residual diffusion uncertainty. This construction defines an explicit surrogate posterior path, from which we derive continuous posterior dynamics. A tunable Langevin component supports target tracking and allows the amount of posterior exploration to be adapted to the application. We prove endpoint consistency and a finite-horizon tracking bound and, in the exact-score setting, first-order weak accuracy. For computation, we derive the Posterior-Dynamics Implicit--Explicit sampler (PD-IMEX), a stable method using one score evaluation per diffusion scale and an implicit data-consistency update. Experiments on deblurring, super-resolution, and inpainting show strong reconstruction quality at 100 score evaluations, coarse-grid stability, and controllable fidelity--diversity behavior.

0.40

Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures

cs.CV cs.AI ·2026-10-02 ·Elena Morotti, Davide Evangelista, Elena Loli Piccolomini
similarity 0.72
Abstract · 21 pages, 7 figures, 2 tables

Solving severely ill-posed imaging inverse problems requires recovering image structures that are unobservable or weakly constrained by the measurements. Diffusion models provide expressive learned priors for inferring such missing information, while posterior sampling incorporates measurement consistency along the reverse process. Standard diffusion posterior samplers, however, rely on instantaneous measurement-aware estimates, without explicitly exploiting information carried by previous posterior corrections. We introduce Consecutive Posterior Fusion Denoising Diffusion Null-Space Models (CPF-DDNM), an inference-time strategy that fuses consecutive measurement-aware estimates to improve the diffusive recovery of unobservable image structures, without requiring retraining or additional denoiser evaluations. We instantiate this principle within DDNM, whose range/null-space decomposition reveals that consecutive fusion preserves the measurement-determined component while acting exclusively on the prior-driven null-space estimate. We thus provide a geometric interpretation of CPF-DDNM and a local error analysis that characterizes the optimal time-dependent fusion coefficient, including the extrapolative regime. Experiments on sparse-view and simulated low-dose computed tomography, as well as medical image super-resolution, show consistent improvements over DDNM and competitive performance against diffusion-based inverse solvers.

0.14

Domain-Adapted Latent Diffusion Models for CT-to-PET Image Translation

cs.CV ·2026-10-26 ·Yann Bourdé, Lea Bogensperger, Arnela Hadzic, Michael Krauthammer
similarity 0.72
Abstract

Positron Emission Tomography (PET) provides important metabolic information for tumor detection and staging but remains significantly less accessible than Computed Tomography (CT) due to its high cost, infrastructure requirements, and reliance on injected radioactive tracers. CT-to-PET image translation using generative models aims to address this disparity, yet state-of-the-art diffusion-based methods are limited by the scarcity of paired training data. To overcome this, we propose a domain-adapted latent diffusion framework that transfers natural-image priors using a relatively small dataset of 21,930 paired CT/PET slices, incorporating a signed power transform to resolve extreme intensity sparsity in PET data. Compared to CPDM, a state-ofthe-art baseline for CT-to-PET image translation, our approach yields superior performance in pixel-wise reconstruction and localized tumor fidelity, demonstrating effective transfer of natural-image priors to the medical domain. We further provide a systematic analysis of evaluation metric reliability for sparse PET data, showing that standard full-image metrics can be misleading indicators of translated image quality, and propose background-filtered and mask-restricted metrics as more clinically meaningful alternatives.

0.16

CLIMB-flow: Coupled Linear Inverse posterior sampling via Multiscale-Based flow

cs.CV cs.LG ·2026-09-27 ·Zeqiu Yu, Ruizhi Yuan, Mathews Jacob
similarity 0.70
Abstract · 5 pages, 3 figures, 1 table. Submitted to ICASSP 2027

Diffusion models are now widely used in Bayesian inverse problems in imaging as priors, where latent diffusion models are often used for larger scale problems to keep the computational complexity and model-size manageable. Unfortunately, the auto-encoder based compression results in loss of spatial detail. In addition, the optimization is converted to a non-linear problem. In this paper, we introduce a posterior sampling algorithm customized for the pyramidal/cascaded architecture, which relies on a coarse to fine hierarchical strategy to generate images in the pixel domain. We present CLIMB-Flow which alternates between three steps: an end-point estimation from the current coarse and noisy image, data-consistent update of the clean image, and re-noising it back to the level the network expects. Together these steps sample the posterior at that scale using an approximate Gibbs sampling from two conditional distributions. Experiments on ImageNet, CelebA, AFHQ and fastMRI span inpainting, deblurring, super-resolution and accelerated MRI, with PSNR gains of 1.37-7.66 dB over the strongest competing method on CelebA and pixel-domain reconstruction up to 512x512.

0.26

Geometry-Aware Diffusion Approximate Posterior Sampling for Sparse-View and Limited-Angle CT

eess.IV cs.LG ·2026-10-05 ·Honglei Brinkmann, Carola-Bibiane Schönlieb, Ander Biguri
similarity 0.69
Abstract

Sparse-view computed tomography (CT) reduces radiation dose and acquisition time and may mitigate motion artifacts. However, angular undersampling provides insufficient information to determine the image uniquely and stably. Limited-angle CT, arising from restricted angular coverage, produces strongly directional information loss associated with the missing angular range. In both settings, image directions may be strongly observed, weakly constrained, or unobservable, leading to severe ill-posedness and reconstruction ambiguity. Existing diffusion-based approaches incorporate measurement information through likelihood guidance, data-consistency operations, or range-null-space corrections. However, they do not generally use the continuously varying measurement sensitivity of the acquisition to jointly shape both reconstruction updates and stochastic exploration. We propose a geometry-aware diffusion-guided stochastic reconstruction framework for sparse-view and limited-angle CT. Its central component is a regularized noise-weighted pullback metric constructed from the CT forward operator and measurement-noise covariance. This metric continuously adapts both the measurement-aware update and stochastic exploration according to directional measurement sensitivity, suppressing changes along strongly constrained directions while permitting greater exploration along weakly constrained and unobservable directions. We complement this geometry-aware update with a regularized data-consistency correction and approximately null-space-restricted stochastic perturbations, implemented matrix-free using forward and backprojection operations together with conjugate-gradient solves. Experiments on sparse-view, noisy, and limited-angle CT demonstrate competitive reconstruction quality, strong measurement consistency, and spatially resolved empirical uncertainty estimates.

0.22

Physics-Guided Flow Matching for CT Image Reconstruction

cs.AI cs.CV ·2026-08-28 ·Davide Evangelista
similarity 0.69
Abstract · 16 pages, 6 figures, 2 tables

Deep generative models have recently emerged as powerful priors for solving ill-posed inverse problems in CT, with diffusion-based approaches achieving state-of-the-art reconstruction performance. However, diffusion models typically rely on stochastic sampling procedures, long inference trajectories, and carefully tuned noise schedules, which can limit computational efficiency and numerical stability, especially at high spatial resolutions. In this work, we investigate Flow Matching as an alternative generative prior for CT reconstruction. We train a high-resolution Rectified Flow Matching model on 256x256 chest images from the Mayo Clinic Low-Dose CT dataset. To mitigate overfitting and limited anatomical variability, we employ a two-stage training strategy consisting of an initial phase with strong, anatomically informed data augmentation, followed by a fine-tuning phase with reduced or no augmentation to refine structural fidelity. The resulting model is capable of generating high-quality and anatomically coherent CT-like images, serving as a strong learned prior. We then evaluate multiple reconstruction methods specifically designed for Flow Matching models, including Plug-and-Play Flow, FlowDPS, Flower, and Flow-Priors (ICTM), and compare them against state-of-the-art diffusion-based reconstruction algorithms such as DDRM, DPS, and DiffPIR. Experimental results across several CT inverse problem settings show that Flow Matching-based approaches consistently outperform diffusion-based methods in terms of PSNR, SSIM, and perceptual quality, while requiring fewer sampling steps. Finally, we publicly release the trained Flow Matching model and accompanying code to facilitate reproducibility and future research. Overall, this work demonstrates that Flow Matching provides a stable, efficient, and effective alternative to diffusion models for high-resolution CT image reconstruction.

0.42

Guidance-Coupled Nullspace Drifting for One-Step Medical Image Reconstruction

eess.IV ·2026-10-28 ·M. Tuna Alatan, Agah Server Tapan, Şaban Öztürk, Muhammad Usama Mirza, Bilal Kabas +2 more
similarity 0.69
Abstract

Generative reconstruction can recover high-quality images from undersampled acquisitions, but state-of-the-art generative priors commonly rely on iterative sampling. Reducing the number of iterations lowers inference cost but also removes opportunities for progressive distributional refinement, making it difficult to retain image realism without sacrificing reconstruction fidelity. Drift modeling offers an alternative by shifting progressive refinement to training, thereby enabling one-step sampling without an iterative inference trajectory. Existing drifting methods, however, do not account for the imaging operator when modeling distributional drift. We propose DriftRecon, a generative method for one-step medical image reconstruction that performs drifting directly in the nullspace of the imaging operator. DriftRecon uses nullspace-restricted noise to construct training samples and a multiscale generator that incorporates measurement conditioning across resolution levels, with its generated component projected onto the operator nullspace. To control the fidelity--realism trade-off at inference, a conditional guidance parameter continuously steers the same generator between measurement-conditioned and unconditional generation. We derive a guidance-dependent similarity-kernel temperature schedule that preserves the guidance-weighted mass receiving strengthened supervision, thereby progressively localizing drift interactions as guidance increases to limit the associated loss of reconstruction fidelity. Experiments in sparse-view CT and accelerated MRI reconstruction show that DriftRecon outperforms established generative reconstruction methods and recent drifting models while producing reconstructions in a single forward pass.

0.25