CS Paper Radar

CLIMB-flow: Coupled Linear Inverse posterior sampling via Multiscale-Based flow

Zeqiu Yu, Ruizhi Yuan, Mathews Jacob

cs.CV cs.LG ·submitted 2026-09-27 18:34 UTC · v1

Abstract

Diffusion models are now widely used in Bayesian inverse problems in imaging as priors, where latent diffusion models are often used for larger scale problems to keep the computational complexity and model-size manageable. Unfortunately, the auto-encoder based compression results in loss of spatial detail. In addition, the optimization is converted to a non-linear problem. In this paper, we introduce a posterior sampling algorithm customized for the pyramidal/cascaded architecture, which relies on a coarse to fine hierarchical strategy to generate images in the pixel domain. We present CLIMB-Flow which alternates between three steps: an end-point estimation from the current coarse and noisy image, data-consistent update of the clean image, and re-noising it back to the level the network expects. Together these steps sample the posterior at that scale using an approximate Gibbs sampling from two conditional distributions. Experiments on ImageNet, CelebA, AFHQ and fastMRI span inpainting, deblurring, super-resolution and accelerated MRI, with PSNR gains of 1.37-7.66 dB over the strongest competing method on CelebA and pixel-domain reconstruction up to 512x512.

Comment
5 pages, 3 figures, 1 table. Submitted to ICASSP 2027

Closest papers

Nearest neighbours by meaning across the whole index.

Cascaded Posterior Sampling With Diffusion Priors for highly Accelerated MRI

eess.IV ·2026-10-25 ·Jyothi Rikhab Chand, Sahil Murtaza, Patrick Nicholas Nowak, Mathews Jacob
similarity 0.78
Abstract

Diffusion models are powerful priors for inverse problems, including accelerated MRI. However, modeling the distribution of high-resolution images requires large networks with high computational cost. We propose a posterior sampling framework that uses cascaded diffusion models as multiscale priors. Conditioned on a coarse image, the distribution of fine-scale detail is local and well conditioned, and it can therefore be captured by a small network. Similarly, a small unconditional network is sufficient to represent low-resolution images, and it is used to recover the coarse image from the k-space center. This estimate then conditions the high-resolution prior, which is combined with all measurements to recover the final image. Both priors are trained on images alone, so they apply to any sampling pattern, and data consistency remains linear at every scale. In multi-coil brain MRI, the proposed method improves on the best single-scale diffusion baseline by 4-6 dB in PSNR at 15x acceleration, while each of its separately trained networks is about 10x smaller. The gain grows as the problem becomes more ill-posed, and ablations show that it arises from informative low-resolution conditioning.

0.06

SNaP: One-Step Posterior Sampling for Noisy Inverse Problems

cs.CV ·2026-09-28 ·Shirin Shoushtari, Edward P. Chandler, Xiao Shi, Ulugbek S. Kamilov
similarity 0.77
Abstract

Diffusion and flow-matching models can produce high-quality posterior samples for inverse problems, but typically require tens to thousands of network evaluations per draw. MeanFlow enables one-step generation, yet applying it to inverse problems leaves no intermediate steps at which to enforce measurement consistency. We introduce SNaP, a one-step MeanFlow posterior sampler for linear inverse problems with Gaussian noise. Its central innovation is a measurement-adapted source: a Gaussian distribution whose mean and anisotropic covariance are determined by the measurement operator, observation, and noise level. The source anchors well-measured directions while preserving variation where the measurements are weak or uninformative. We show that the exact conditional flow transports this source to the true posterior. Across natural-image restoration and multi-coil MRI, SNaP produces diverse, high-quality samples with one network evaluation per draw, 30 to 2250 $\times$ faster than iterative samplers.

0.15

FlowSGS: Improving Flow Priors for Inverse Imaging with Stochastic Interpolants

cs.CV ·2026-09-17 ·Tianao Li, Xinhui Qian, Emma Alexander
similarity 0.73
Abstract

Flow matching has emerged as the state-of-the-art generative model and has been used for plug-and-play (PnP) priors to solve inverse problems in computational imaging. However, existing flow-based inverse solvers make simplifying approximations in posterior sampling and/or assume linear forward models. In contrast, principled diffusion-based methods exist but are computationally expensive. To circumvent these problems, we introduce FlowSGS, a flow-based posterior sampling method using Split Gibbs Sampling (SGS) with annealed coupling, and make flow-specific interventions to the prior sampling and annealing steps, theoretically grounded in the Stochastic Interpolants (SI) framework. Using a novel timestep correction and accelerated warm-up with one-step flow models, our method is faster and more accurate than the state of the art across a range of imaging problems. We demonstrate the first use of flow-based samplers for a nonlinear inverse problem (Fourier phase retrieval) and apply one-step flow models to principled Bayesian inverse imaging.

0.29

A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors

cs.AI stat.MLcs.LG ·2026-08-15 ·Zhaoqiang Liu, Tongyao Pang, Ruibing Wang, Yang Zheng
theory similarity 0.72
Abstract · 26 pages, 5 figures, 3 tables

Pretrained diffusion models represent image distributions through a continuum of progressively smoothed distributions. This multiscale structure organizes generation from global structure to fine detail and supports high-quality, diverse samples. We exploit the same multiscale diffusion prior for linear imaging inverse problems. Rather than using the pretrained model only as a denoiser in an outer iteration, we define a surrogate likelihood whose center is aligned with the clean-image coordinate and whose covariance accounts for residual diffusion uncertainty. This construction defines an explicit surrogate posterior path, from which we derive continuous posterior dynamics. A tunable Langevin component supports target tracking and allows the amount of posterior exploration to be adapted to the application. We prove endpoint consistency and a finite-horizon tracking bound and, in the exact-score setting, first-order weak accuracy. For computation, we derive the Posterior-Dynamics Implicit--Explicit sampler (PD-IMEX), a stable method using one score evaluation per diffusion scale and an implicit data-consistency update. Experiments on deblurring, super-resolution, and inpainting show strong reconstruction quality at 100 score evaluations, coarse-grid stability, and controllable fidelity--diversity behavior.

0.40

Principled MAP estimation for inverse problems: bridging the gap between convergence and performance

cs.CV cs.LG ·2026-09-29 ·Alexandre Lagier, Valentine Tosel, Anne Gagneux, Mathurin Massias, Ségolène Martin
theory similarity 0.70
Abstract

Pretrained denoisers provide a powerful way to incorporate image priors into restoration algorithms. Plug-and-Play and RED approaches exploit fixed-noise-level denoisers within first-order optimization schemes, with convergence guarantees, but often struggle to achieve high-quality reconstruction on severely ill-posed inverse problems. In contrast, recent state-of-the-art approaches leverage denoisers derived from flow- or diffusion-based generative models and evaluate them along a sequence of decreasing noise levels. While these methods achieve strong empirical performance, their convergence theory remains limited. In this paper, we bridge this gap by specifically designing an algorithm that combines denoisers at decreasing noise levels with a schedule tailored to ensure convergence. From a Bayesian perspective, we prove that our method converges to a $\textit{Maximum a Posteriori}$ (MAP) estimate, under suitable assumptions. Subsequently, we apply our method to various ill-posed inverse problems and show that it surpasses convergent methods while competing with state-of-the-art empirical ones.

0.17

Generative Translation Priors: Bayesian Imaging with Cross-Modality Image Translation

eess.IV cs.CVcs.LG ·2026-08-28 ·Evan Bell, Jiaming Liu, Yifan Chen, Yu Sun
code/data similarity 0.70
Abstract · 51 pages, 12 figures. Code is available at https://github.com/Hopkins-CIG/GTP

The ability to leverage images from co-available modalities to inform target-domain reconstruction is highly desirable in imaging algorithms. In this work, we introduce Generative Translation Priors (GTP)--a Bayesian framework that transforms diffusion-based image-to-image translation models into cross-modality image priors for ill-posed imaging inverse problems. GTP incorporates target-domain measurements through likelihood guidance, steering the translation process toward the desired posterior distribution. The framework is grounded in a theoretical analysis of the resulting posterior dynamics, which reveals an intrinsic bias introduced by likelihood guidance. We further characterize this bias and derive a ground-truth-free formulation for its estimation, enabling it to serve as a practical metric for assessing posterior sampling quality. Building on this analysis, we derive two discretized GTP algorithms based on gradient and proximal likelihood guidance, respectively. We validate GTP on computed tomography reconstruction with magnetic resonance side information, and on positron emission tomography reconstruction with computed tomography side information. Experiments demonstrate that GTP effectively incorporates complementary cross-modality information and achieves high-fidelity reconstruction even under severely undersampled measurements.

0.38

Picard Proximal Monte Carlo for Parallel Bayesian Imaging with Score-Based Generative Priors

cs.LG ·2026-08-18 ·Deliang Wei, Evan Bell, Wenhan Guo, Yifan Chen, Yu Sun
similarity 0.70
Abstract

Bayesian imaging inverse problems often require sampling from high-dimensional posterior distributions. While recent score-based and diffusion models provide expressive Bayesian priors, their sampling procedures remain inherently sequential and computationally expensive for large-scale imaging applications. We propose PiX-MC, a time-parallel posterior sampling framework based on proximal Langevin dynamics and Picard iteration. The proximal-likelihood formulation exploits the fact that many imaging likelihoods admit efficient, problem-specific proximal operators, while Picard refinement exposes parallelism across discretization nodes and naturally supports multi-GPU implementation. To further improve practical scalability and sampling performance, we develop multi-block and annealed variants of the proposed framework. We establish convergence guarantees under transparent assumptions, accommodating non-log-concave posteriors, imperfect learned score models, multi-block implementations, and annealing schedules. Experiments on a diverse collection of imaging inverse problems demonstrate that PiX-MC substantially reduces wall-clock time while preserving reconstruction quality. On a $512\times512\times80$ sparse-view computed tomography (CT) problem, annealed multi-block PiX-MC achieves up to a $50\times$ runtime speedup over the standard Langevin sampler using eight GPUs.

0.09

Perturb-and-Solve: Efficient Learned-Operator Conditioning for Latent Diffusion Inverse Problems

cs.LG cs.CV ·2026-09-27 ·Abduragim Shtanchaev, Arip Asadulaev, Luiza Labazanova, Aidar Alimbayev, Karim Salta +1 more
similarity 0.69
Abstract

Latent diffusion models serve as powerful priors for solving inverse problems in image restoration, such as deblurring, inpainting, and super-resolution. Current methods have a trade-off between generality and efficiency. Solvers that are restricted to a fixed set of degradation operators are fast and efficient. Methods that support arbitrary degradation operators are slow and require gradients through the diffusion network. To break this bottleneck, we introduce PASEO (Perturb-And-Solve for Efficient Operator conditioning), a method that uses a small (1M parameters) learned network to degrade diffusion model predictions in latent space. PASEO supports learned degradation operators without back-propagating through the diffusion network. We efficiently sample reconstructions from an approximate posterior by combining the diffusion model's prediction with the observed image. We do this by adding noise and solving linear equations based on a local linear approximation of the learned network, without building or inverting large covariance matrices. Across super-resolution, deblurring, and inpainting on FFHQ and COCO, PASEO achieves strong perceptual quality while running up to 9x faster and using up to 34% less peak memory than the tested baselines, with the same or fewer model evaluations.

0.19