CS Paper Radar

Deep-Unfolded Penalized MLEM for Rapid Poisson Image Reconstruction

Zohar Davidov, Alon Osovizky, Max Ghelman, Nir Shlezinger

eess.SP ·submitted 2026-10-08 15:53 UTC · v1

Abstract

Maximum likelihood expectation maximization (MLEM) is a common approach for Poisson image reconstruction, but accurate recovery requires many iterations and is sensitive to mismatch in the assumed acquisition model. We propose a deep-unfolded penalized MLEM framework that maps a prescribed small number of iterations into trainable layers while retaining the analytical forward/backward projections and the multiplicative structure of MLEM. The unfolded architecture learns layer-dependent regularization and Poisson-model parameters, together with a data-dependent correction of the sensitivity normalization to mitigate model mismatch. We numerically show that our method improves reconstruction resolution at a fixed iteration budget and attains reconstruction quality comparable to long MLEM runs and direct data-driven models.

Comment
5 pages, 4 figures. Submitted to IEEE ICASSP 2027 (under review)

Closest papers

Nearest neighbours by meaning across the whole index.

Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems

eess.IV cs.CV ·2026-08-20 ·Laura C. Diaz-Delgado, Emmanuel Martinez, Henry Arguello
top venue similarity 0.64
Abstract

Self-supervised learning for imaging inverse problems is increasingly important in photon-limited settings, where acquiring clean ground truth is impractical and reconstruction must remain stable under dataset and acquisition shifts. This challenge is amplified under Poisson noise, whose signal-dependent statistics interact with sampling operators (e.g., CFA mosaicing). Meanwhile, foundation vision encoders trained at web scale offer distortion-invariant, content-related representations that generalize well across domains, suggesting a promising route to build priors that transfer beyond the training distribution without expensive fine-tuning. This paper proposes an ADMM-inspired unrolled plug-and-play solver for Poisson inverse problems that decouples a closed-form data-consistency update from a parameter-efficient prior. The prior is implemented as a lightweight decoder operating on frozen CLIP RN50 dense multi-scale features, adapting foundation representations with less trainable parameters. For self-supervision, the method integrates GR2R measurement-domain re-corruption with an Equivariant Imaging regularizer via virtual acquisitions. Experiments on Poisson CFA demosaicing and deblurring show competitive quality, improved robustness under shifts, and self-supervised performance approaching supervised training.

0.55

Scalable Unrolled Chains for MRI Reconstruction

cs.CV ·2026-10-24 ·Emiljo Mëhillaj, Ender Konukoglu
publishedcode/data similarity 0.63
Abstract · 23 pages (including supplementary material), 14 figures. Accepted at WACV 2027

Unrolled variational networks achieve state-of-the-art performance for accelerated MRI reconstruction, but standard end-to-end training becomes prohibitively memory intensive as the number and width of cascades increase. We propose a memory-efficient training framework that updates a randomly sampled cascade while retaining supervision from the final reconstruction loss. The error signal is propagated from the end of the chain to the sampled cascade using an activation-light backward pass that avoids storing full chain activations, thereby decoupling training memory from chain length. A time-conditioned network shared across cascades further keeps the parameter count independent of chain length. The backward pass is approximate only through frozen normalization statistics, and a trained exact gradient control shows the approximation leaves reconstruction quality unchanged. The framework remains trainable at chain lengths and cascade widths where standard end-to-end backpropagation exhausts GPU memory. On fastMRI single-coil knee and multi-coil brain reconstruction, our method consistently outperforms other local training approaches. On high-SNR knee slices, our method surpasses E2E-VarNet at $8\times$ and matches it at $4\times$, while on the complete brain validation set it surpasses E2E-VarNet at $8\times$ and achieves comparable performance at $4\times$, with fewer parameters, lower peak memory, and faster per-iteration training. Code is available at https://github.com/emehillaj/scalable-unrolled-mri.

0.50

Manifold-Constrained PET Reconstruction with Learned Flow-Matching Priors

eess.IV ·2026-08-29 ·Hengjia Ran, Jie Luo, Yutao Zhu, Rui Hu, Fenglin Zhan +3 more
similarity 0.63
Abstract

Image reconstruction for positron emission tomography (PET) is an ill-posed Poisson inverse problem. In this work, we introduce an unsupervised, optimization-based reconstruction framework that employs a flow-matching generative model as a learned manifold prior. We train the generative model on high-quality PET images to learn a differentiable ordinary differential equation (ODE)-based transport from a Gaussian latent distribution to the PET image distribution. We incorporate this generator as an explicit manifold constraint into a regularized Poisson likelihood formulation. To solve the resulting problem, we develop an alternating direction method of multipliers (ADMM) algorithm that integrates an expectation-maximization (EM)-type surrogate update for Poisson data fidelity with gradient-based latent-space optimization. Numerical simulations and in vivo PET experiments demonstrate improved reconstruction accuracy compared with conventional reconstruction methods and recent deep learning-based approaches, particularly in low-count settings, with competitive computational efficiency.

0.07

UMPIRE-Net: Unrolled Magnitude-Phase Regularization Network for Accelerated MRI

eess.IV cs.CVeess.SPphysics.med-ph ·2026-08-14 ·Mahdi Saberi, Toygan Kiliç, Mehmet Akçakaya
code/data similarity 0.63
Abstract · IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net

0.59

Newton Deep Unfolding for Compressed Sensing

cs.CV ·2026-09-13 ·Changhua He, Xianchao Xiu
code/data similarity 0.63
Abstract

Compressed sensing (CS) reconstructs images from highly limited measurements, but existing deep unfolding methods are typically driven by first-order optimization and weakly exploit the optimization states generated during reconstruction. To address these limitations, we propose a Newton deep unfolding network (NDU-Net), which, to the best of our knowledge, is the first deep unfolding framework that leverages second-order optimization for CS reconstruction. Specifically, NDU-Net introduces a Newton update (NU) module to estimate Newton-type update directions and generate optimization states that characterize the current reconstruction process. Furthermore, a Newton-guided multi-scale prior (MP) module is designed to incorporate these optimization states into multi-scale feature restoration, thereby enabling the learned prior to adapt to the current reconstruction stage. Experimental results under different CS ratios confirm that our proposed NDU-Net achieves promising reconstruction performance and exhibits enhanced robustness. Our code is available at https://github.com/xianchaoxiu/DNU-Net.

0.30

A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors

cs.AI stat.MLcs.LG ·2026-08-15 ·Zhaoqiang Liu, Tongyao Pang, Ruibing Wang, Yang Zheng
theory similarity 0.62
Abstract · 26 pages, 5 figures, 3 tables

Pretrained diffusion models represent image distributions through a continuum of progressively smoothed distributions. This multiscale structure organizes generation from global structure to fine detail and supports high-quality, diverse samples. We exploit the same multiscale diffusion prior for linear imaging inverse problems. Rather than using the pretrained model only as a denoiser in an outer iteration, we define a surrogate likelihood whose center is aligned with the clean-image coordinate and whose covariance accounts for residual diffusion uncertainty. This construction defines an explicit surrogate posterior path, from which we derive continuous posterior dynamics. A tunable Langevin component supports target tracking and allows the amount of posterior exploration to be adapted to the application. We prove endpoint consistency and a finite-horizon tracking bound and, in the exact-score setting, first-order weak accuracy. For computation, we derive the Posterior-Dynamics Implicit--Explicit sampler (PD-IMEX), a stable method using one score evaluation per diffusion scale and an implicit data-consistency update. Experiments on deblurring, super-resolution, and inpainting show strong reconstruction quality at 100 score evaluations, coarse-grid stability, and controllable fidelity--diversity behavior.

0.40

Perturb-and-Solve: Efficient Learned-Operator Conditioning for Latent Diffusion Inverse Problems

cs.LG cs.CV ·2026-09-27 ·Abduragim Shtanchaev, Arip Asadulaev, Luiza Labazanova, Aidar Alimbayev, Karim Salta +1 more
similarity 0.61
Abstract

Latent diffusion models serve as powerful priors for solving inverse problems in image restoration, such as deblurring, inpainting, and super-resolution. Current methods have a trade-off between generality and efficiency. Solvers that are restricted to a fixed set of degradation operators are fast and efficient. Methods that support arbitrary degradation operators are slow and require gradients through the diffusion network. To break this bottleneck, we introduce PASEO (Perturb-And-Solve for Efficient Operator conditioning), a method that uses a small (1M parameters) learned network to degrade diffusion model predictions in latent space. PASEO supports learned degradation operators without back-propagating through the diffusion network. We efficiently sample reconstructions from an approximate posterior by combining the diffusion model's prediction with the observed image. We do this by adding noise and solving linear equations based on a local linear approximation of the learned network, without building or inverting large covariance matrices. Across super-resolution, deblurring, and inpainting on FFHQ and COCO, PASEO achieves strong perceptual quality while running up to 9x faster and using up to 34% less peak memory than the tested baselines, with the same or fewer model evaluations.

0.19

FIRM: Flow-based Imaging via Regularized Minimization

cs.CV ·2026-09-11 ·Shirin Shoushtari, Edward P. Chandler, Xiao Shi, Ulugbek S. Kamilov
similarity 0.61
Abstract

Flow matching methods for imaging inverse problems typically incorporate measurements through network conditioning or guidance during sampling. Neither approach explicitly applies the forward operator within the learned conditional velocity field. We develop a principled measurement-conditional velocity parameterization that does. For a linear interpolation path, we express the optimal velocity through the posterior mean $E[x_1|x_t, y]$ and show that this mean is the unique minimizer of a variational objective with an explicit data-consistency term. The velocity defined by this minimizer provably transports the source distribution to the measurement-conditioned posterior. This result leads to a forward operator-aware velocity field that is trained end-to-end and requires no separate guidance during sampling. Across five imaging tasks, our method achieves leading reconstruction quality with up to $50\times$ fewer network evaluations than competitive flow-based methods. Varying the number of sampling steps also controls the distortion-perception trade-off without retraining.

0.17