CS Paper Radar

Learning spatially varying regularisation parameters of low regularity for image reconstruction

Kostas Papafitsoros, Luca Calatroni, Andreas Kofler

eess.IV cs.CVmath.OC ·submitted 2026-08-25 20:25 UTC · v1

Abstract

In this chapter, we review and discuss the regularity properties of spatially adaptive regularisation weight functions used in variational image reconstruction. Incorporating such weights into classical model-based regularisers, such as Total Variation (TV) and Total Generalised Variation (TGV), allows the regularisation strength to vary across the image and adapt to local image content. When appropriately estimated, these weights can thus significantly improve edge and detail preservation in the reconstructions. We review the existing theoretical literature on this topic for different regularity classes, including constant, continuous, and piecewise constant functions. Our discussion is motivated by recent work on hybrid image reconstruction methods that combine model-based regularisation with deep neural networks to learn highly adaptive regularisation weights. In particular, we discuss how the structural properties of these weights influence the reconstruction from both theoretical and practical perspectives. Through representative examples in image denoising and magnetic resonance imaging (MRI) reconstruction, we demonstrate that the learned weights are often of low regularity and can adapt not only to the image structure but also to the specific noise realisation. We conclude by highlighting several directions for future research on this topic.

Closest papers

Nearest neighbours by meaning across the whole index.

Consistency Models for Fast MRI Reconstruction Using Regularization by Denoising

eess.IV cs.AIcs.CVcs.LG+1 ·2026-08-20 ·Merve Gülle, Junno Yun, Yaşar Utku Alçalar, Mehmet Akçakaya
code/data similarity 0.69
Abstract

Diffusion models (DMs) have emerged as powerful generative priors for MRI reconstruction with promising results. Yet DM-based methods require extensive iterative refinement, limiting their practical deployment. Consistency models (CMs) provide a compelling alternative, aiming to map out the diffusion trajectory in a single pass, enabling faster generation. In this work, we propose CM-RED, a novel MRI reconstruction method that integrates a pretrained CM into the regularization by denoising (RED) scheme. Our method builds on accelerated proximal gradient RED (RED-APG), and further incorporates controlled noise injection during the update steps to enhance generative diversity and accelerate convergence. Extensive experiments on the fastMRI knee and brain datasets demonstrate that CM-RED achieves high-quality reconstructions across multiple anatomies, contrast weights, acceleration factors, and undersampling patterns, using only 4 network function evaluations (NFEs). The proposed method consistently outperforms existing DM- and CM-based approaches in both quantitative metrics and visual fidelity, and exhibits strong robustness to hyperparameter variations, highlighting CM-RED as an efficient and effective generative framework for accelerated MRI reconstruction. The source code and pretrained models are publicly available at https://github.com/MerveGulle/CM-RED.

0.31

Directional Total Variation-Regularized Implicit Neural Representations (DTV-INR) for Continuous Super-Resolution in Degraded Imaging Domains

cs.CV ·2026-09-21 ·Mahmoud Saeedi Kelishami
similarity 0.66
Abstract · 18 pages, 8 figures, 3 tables

In this paper, we introduce the Directional Total Variation-Regularized Implicit Neural Representation (DTV-INR), an advanced variational paradigm that synergistically integrates coordinate-driven implicit neural networks with an anisotropic, structure-tensor-informed total variation regularizer tailored for resolution-agnostic image super-resolution. Casting the continuous-to-discrete acquisition process into an ill-posed inverse problem framework, our formulation equips a SIREN-architected coordinate network with a dynamic Riemannian metric tensor field D(x). By leveraging its spectral decomposition, the proposed regularizer preferentially directs diffusion parallel to dominant structural contours while penalizing cross-edge dissipation, successfully circumventing the classical staircasing artifacts inherent to scalar total variation schemes. We rigorously prove the well-posedness of this formulation in H^1(Omega) by establishing the existence, uniqueness, and metric stability of the variational minimizer, and realize this via an alternating projected optimization algorithm that decouples network parameter tuning from adaptive tensor field updates. Comprehensive experiments conducted on clinical brain magnetic resonance imaging (MRI) and biomedical transmission electron microscopy confirm substantial quantitative and qualitative improvements, yielding PSNR enhancements reaching +5.05 dB over baseline unregularized INRs and +1.71-2.85 dB over isotropic TV-INR across continuous (non-integer) upsampling factors, alongside remarkable noise robustness up to sigma_eta = 0.10 and monotonic preconditioned convergence behavior.

0.33

UMPIRE-Net: Unrolled Magnitude-Phase Regularization Network for Accelerated MRI

eess.IV cs.CVeess.SPphysics.med-ph ·2026-08-14 ·Mahdi Saberi, Toygan Kiliç, Mehmet Akçakaya
code/data similarity 0.65
Abstract · IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net

0.59

Beyond Sparsity: Weight Location and Network Context in Pruned MRI Reconstruction

eess.IV cs.CV ·2026-09-25 ·Mohammed Wattad, Tamir Shor, Alexander M. Bronstein
similarity 0.65
Abstract

Pruning reduces the number of weights in magnetic resonance imaging (MRI) reconstruction networks. Equal sparsity, however, can retain weights with different computational roles and different compatibility with the trained network. We study these effects across 120 convolutional U-Net and vision transformer models using controlled edits evaluated before retraining. In U-Net, preserving high-resolution computation improves reconstruction at equal deletion counts across all tested sparsity levels. Equal-operation controls reveal additional sensitivity of the first convolution, which operation count alone cannot explain. In transformers, retained pretrained weight energy correlates with quality within sparsity levels, yet the same masks reverse their reconstruction ranking when the surrounding trained weights change. At 90\% sparsity, matching intermediate output scales largely removes a high-energy-mask penalty while retaining an advantage for the network's original mask. Thus sparsity alone does not characterize reconstruction quality: architecture-specific descriptors are informative, but mask quality can still depend on the surrounding trained network.

0.28

Using Channel Representations in Regularization Terms: A Case Study on Image Diffusion

cs.CV ·2026-08-29 ·Christian Heinemann, Freddie Åström, George Baravdish, Kai Krajsek, Michael Felsberg +1 more
top venue similarity 0.64
Abstract

In this work we propose a novel non-linear diffusion filtering approach for images based on their channel representation. To derive the diffusion update scheme we formulate a novel energy functional using a soft-histogram representation of image pixel neighborhoods obtained from the channel encoding. The resulting Euler-Lagrange equation yields a non-linear robust diffusion scheme with additional weighting terms stemming from the channel representation which steer the diffusion process. We apply this novel energy formulation to image reconstruction problems, showing good performance in the presence of mixtures of Gaussian and impulse-like noise, e.g. missing data. In denoising experiments of common scalar-valued images our approach performs competitive compared to other diffusion schemes as well as state-of-the-art denoising methods for the considered noise types.

0.53

Learned Regularization for Sparse-View CT: Accuracy, Lesion Detectability and Distribution Shift of a Plug-and-Play Prior against Tuned Total Variation

eess.IV cs.CVeess.SP ·2026-11-13 ·Mohammed Abo Oraig
code/data similarity 0.64
Abstract · 62 pages, 22 figures, and 30 tables. Preprint (not peer-reviewed); also available on Zenodo: https://doi.org/10.5281/zenodo.24107061. Code a…

Learned image priors are often proposed to replace hand-crafted regularizers in sparse-view computed tomography (CT), yet they are usually judged by PSNR on data resembling their training set. We evaluate one noise-conditioned DnCNN denoiser used as a Plug-and-Play prior against filtered back-projection (FBP), Tikhonov and total-variation (TV) regularization, with every method tuned on validation data and all differences paired. On synthetic 28x28 digit images, the prior beats box-constrained TV by about 3.4 dB at moderate noise (sigma = 0.05, 20 angles), but the advantage shrinks at low noise and reverses under distribution shift: an MNIST-trained prior is 3.1 dB (Fashion-MNIST) and 4.3-4.6 dB (Shepp-Logan phantom) below TV, whereas a Fashion-MNIST-trained prior beats TV by 2.2 dB on Fashion-MNIST, consistent with prior mismatch rather than a failure of PnP itself. In a lesion-insertion test the prior detects lesions worse than TV in distribution despite its higher PSNR, and under mismatch it produces more lesion-like false blobs than box-constrained TV for seven of eight lesion types. On real LoDoPaB-CT slices (patient-disjoint split; 30, 60 and 120 angles; three dose levels; 40 test patients), the prior does not consistently outperform a well-tuned TV in PSNR (-0.93 to +0.33 dB) and has lower SSIM in eight of nine conditions. Its lesion-detection AUC is higher than this TV's in all nine conditions (significant in six) but never significantly higher than that of Hann-filtered FBP, which the PSNR-tuned TV falls below in detection in all nine conditions (seven significant). On non-anatomical phantoms its PSNR falls below TV in all six conditions. PSNR and lesion detectability thus rank the methods differently. Our conclusions concern one small denoiser, and the CT analysis was developed after seeing results, without pre-specified primary comparisons.

0.42

Accelerating Variational Cone-Beam CT Reconstruction with Learned Warm Starts

eess.IV cs.AIcs.CV ·2026-11-13 ·Héloïse Dudoignon, Clément Delmas, Laurent Facq, Clair Poignard, Baudouin Denis de Senneville
similarity 0.63
Abstract · Submitted to IEEE ISBI 2027

Variational reconstruction provides a rigorous framework for cone-beam computed tomography (CBCT) by combining an explicit acquisition model with image priors. However, iterative optimization remains computationally demanding, particularly under severe noise and sparse-view conditions. Although learning-based methods achieve high reconstruction quality, they often replace the original variational formulation with learned optimization schemes or nonlinear equilibrium models. We propose a neural network-guided warm-start framework that accelerates variational reconstruction while preserving its original formulation. Projection data are first reconstructed using the Feldkamp-Davis-Kress (FDK) algorithm, and the resulting image is refined by an image-domain neural network. The network output is used solely to initialize the subsequent model-based optimization, leaving the forward model, data-fidelity term, regularization, and optimization scheme unchanged. A pre-regularization step further improves compatibility with the variational priors. Experiments on pelvic CT images from the SynthRAD2025 challenge show a more than threefold reduction in reconstruction time while maintaining comparable image quality.

0.21

Characterizing the Edge of Stability in Variational Training Without Priors

cs.LG stat.ML ·2026-11-11 ·Juraj Marusic, Jonathan Wenger, Beau Coker, John P. Cunningham
top venuebenchmark similarity 0.63
Abstract · Accepted at NeurIPS 2026. 21 pages, 7 figures

Variational approaches in deep learning promise to deliver improved uncertainty quantification and out-of-distribution generalization by inferring a distribution over weights, regularized by a divergence to a chosen prior. However, prior elicitation presents a significant challenge in deep learning, resulting in the common practice of significantly downweighting the regularization term in the variational objective. Recently, it was proposed to train solely via the expected loss by relying on implicit regularization from the optimizer, rather than explicit regularization from the divergence to the prior. While this approach largely sidesteps the issue of prior elicitation, current theory lacks an understanding of how key optimization hyperparameters impact the implicit regularization. Here, we theoretically and empirically demonstrate that larger learning rates and fewer parameter samples lead to flatter minima of the loss landscape, which are known to generalize better. We show that training on the expected loss operates at a modified edge of stability, characterized by the signal-to-noise ratio of the gradient estimates and the number of Monte Carlo samples. Experiments on out-of-distribution benchmark datasets confirm the practical significance of the theoretical results.

0.35