CS Paper Radar

Joint Image Denoising and Interpolation via Mixed Graph Filtering

Gene Cheung, Niruhan Viswarupan, Romisaa Elsaidy

eess.IV cs.CVeess.SP ·submitted 2026-11-18 11:21 UTC · v1

Abstract

Images often require both denoising and interpolation, yet treating the two tasks separately is suboptimal: interpolation introduces correlated noise that complicates subsequent denoising, while denoising may remove image details useful for interpolation. In this paper, we study joint image denoising and interpolation from a mixed graph filtering perspective, where denoising is modeled using undirected graph filters and interpolation using directed graph filters. We first establish that, under mild conditions, any (pseudo-)linear denoiser and interpolator can be interpreted as solution filters of maximum a posteriori (MAP) estimation problems regularized by undirected and directed graph smoothness priors, respectively. Guided by these results, we formulate graph-based joint denoising and interpolation problems using both directed and undirected graph structures. We characterize when joint denoising/interpolation reduces to a separable pipeline and when a genuinely coupled optimization is required. For the non-separable case, we recover sparse graph operators from given denoisers and interpolators, yielding an efficient linear-system formulation solvable via conjugate gradient. Experimental results demonstrate that our proposed joint framework consistently outperforms separate denoising and interpolation pipelines across multiple denoiser-interpolator combinations.

Closest papers

Nearest neighbours by meaning across the whole index.

Principled MAP estimation for inverse problems: bridging the gap between convergence and performance

cs.CV cs.LG ·2026-09-29 ·Alexandre Lagier, Valentine Tosel, Anne Gagneux, Mathurin Massias, Ségolène Martin
theory similarity 0.64
Abstract

Pretrained denoisers provide a powerful way to incorporate image priors into restoration algorithms. Plug-and-Play and RED approaches exploit fixed-noise-level denoisers within first-order optimization schemes, with convergence guarantees, but often struggle to achieve high-quality reconstruction on severely ill-posed inverse problems. In contrast, recent state-of-the-art approaches leverage denoisers derived from flow- or diffusion-based generative models and evaluate them along a sequence of decreasing noise levels. While these methods achieve strong empirical performance, their convergence theory remains limited. In this paper, we bridge this gap by specifically designing an algorithm that combines denoisers at decreasing noise levels with a schedule tailored to ensure convergence. From a Bayesian perspective, we prove that our method converges to a $\textit{Maximum a Posteriori}$ (MAP) estimate, under suitable assumptions. Subsequently, we apply our method to various ill-posed inverse problems and show that it surpasses convergent methods while competing with state-of-the-art empirical ones.

0.17

Unrolling a Graph-Laplacian Denoiser Realizes Only Compositions of Polynomial Graph Filters

eess.SP eess.IV ·2026-08-10 ·Seyed Alireza Hosseini
theory similarity 0.61
Abstract

A recent construction of unrolled networks for graph-based image restoration forms a system matrix from a graph-Laplacian denoiser through a truncated Taylor expansion, then inverts it with a fixed number of conjugate-gradient steps, with the coefficients of both stages learned. This paper shows the resulting map is a polynomial in the denoising operator, of degree at most the product of the two truncation orders, for every setting of those coefficients and therefore at every point of training: the learned steps select an element of a Krylov subspace they cannot enlarge. At the orders used in practice the reachable set is moreover a measure-zero subset of the polynomial class of the network's own degree budget, so the composition constrains the hypothesis space rather than enlarging it. At the standard initialization the realized spectral response is obtained in closed form, exceeding the intended response throughout the interior of the spectrum and approaching a nonzero floor. A lower bound on the operator's condition number, internal to the graph construction rather than to image content, then places the order required for a prescribed accuracy well above the order used in practice. The confining class is precisely the spectral graph filters for which a direct, convex parameterization has long been available.

0.04

Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures

cs.CV cs.AI ·2026-10-02 ·Elena Morotti, Davide Evangelista, Elena Loli Piccolomini
similarity 0.61
Abstract · 21 pages, 7 figures, 2 tables

Solving severely ill-posed imaging inverse problems requires recovering image structures that are unobservable or weakly constrained by the measurements. Diffusion models provide expressive learned priors for inferring such missing information, while posterior sampling incorporates measurement consistency along the reverse process. Standard diffusion posterior samplers, however, rely on instantaneous measurement-aware estimates, without explicitly exploiting information carried by previous posterior corrections. We introduce Consecutive Posterior Fusion Denoising Diffusion Null-Space Models (CPF-DDNM), an inference-time strategy that fuses consecutive measurement-aware estimates to improve the diffusive recovery of unobservable image structures, without requiring retraining or additional denoiser evaluations. We instantiate this principle within DDNM, whose range/null-space decomposition reveals that consecutive fusion preserves the measurement-determined component while acting exclusively on the prior-driven null-space estimate. We thus provide a geometric interpretation of CPF-DDNM and a local error analysis that characterizes the optimal time-dependent fusion coefficient, including the extrapolative regime. Experiments on sparse-view and simulated low-dose computed tomography, as well as medical image super-resolution, show consistent improvements over DDNM and competitive performance against diffusion-based inverse solvers.

0.14

Unaligned Image Guided Denoising via Cross-modal Conditional Flow Matching

cs.CV ·2026-11-04 ·Runmin Zhang, Linshan Li, Si-Yuan Cao, Zhu Yu, Lingyu Zhu +2 more
top venue similarity 0.59
Abstract · Accepted by NeurIPS 2026

This work presents UGD-FM, a novel unaligned image guided denoising framework based on cross-modal conditional flow matching. Unlike previous approaches that assume spatially aligned inputs or only handle small-baseline rectified pairs, we address a more challenging setting where severe target noise and large-range two-dimensional cross-modal misalignment coexist. Specifically, we formulate guided denoising as a progressive flow matching process, allowing image restoration and aligned guidance aggregation to mutually reinforce each other. To support efficient few-step inference, we introduce a stage-focused and inference-consistent training strategy that focuses on task-critical denoising stages, and mitigates the training-inference mismatch. We further propose adaptive sparse guidance propagation for efficient and reliable large-range matching, regularized by perceptual and geometric auxiliary losses. Experiments demonstrate that UGD-FM achieves state-of-the-art denoising performance with only one or two inference steps, and is compatible with modern single-image restoration backbones.

0.37

Dual Flow: Joint Image-Measurement Flow for Inverse Problems

eess.IV cs.CV ·2026-11-04 ·Sevket Ege Yesilyurt, Figen S. Oktem
code/data similarity 0.59
Abstract · 17 pages, 8 figures. Our code is available at https://github.com/METU-SPACE-Lab/Dual-Flow

Existing generative model-based approaches to linear inverse problems typically use the acquired noisy measurement to condition or guide sampling in the image domain. In this work, we introduce Dual Flow, a novel joint flow model for solving linear inverse problems by jointly estimating the clean image and its corresponding noise-free measurement from the observation. Specifically, Dual Flow formulates image reconstruction and measurement denoising as a coupled estimation problem, using coupled flows in the image and measurement domains. The acquired noisy measurement $\mathbf{y}_0$ is used only to initialize the measurement state; thereafter, the image and measurement states are jointly updated based on their current values. By construction, the final image and measurement estimates are guaranteed to satisfy the underlying forward model. We derive the sampling updates for the joint flow and show that they are governed by the conditional mean of the clean image given the current joint state. We further derive a closed-form expression for a sufficient statistic of the joint state and show that the required conditional mean can be obtained by solving an image-domain Gaussian denoising problem involving operator-dependent, correlated noise. We train a velocity-prediction network using this formulation to estimate the conditional mean from the derived sufficient statistic. Dual Flow requires no hyperparameter tuning beyond selecting the number of inference steps and achieves substantially shorter reconstruction times than competing methods. Extensive experiments across various linear inverse problems and image datasets demonstrate state-of-the-art performance in both distortion metrics and perceptual quality. Additional analyses assess robustness to model mismatch, as well as the ability to generate diverse plausible reconstructions and characterize reconstruction uncertainty.

0.40

Graph Signal Estimation With Unknown Topology

eess.SP ·2026-10-25 ·Tirza Routtenberg
similarity 0.58
Abstract

Graph-signal estimation is commonly designed assuming that the underlying topology is known. In this paper, we consider estimation from general nonlinear measurements when the active topology is latent but is known to belong to a given family of candidate graphs. We first develop a class of topology-blind graph-spectral estimators that jointly exploit the candidate graphs, and characterize the performance loss compared to unconstrained linear estimation. We derive the minimum-mean-squared-error (MSE) multi-basis estimator and show that its optimal operator is the weighted projection of the topology-blind linear MMSE (LMMSE) operator onto the multi-graph filter space. This characterization provides exact expressions for the excess MSE and conditions for attaining the topology-blind LMMSE. To reduce the number of parameters, we develop estimators based on shared spectral responses and low-rank representations, and consider data-dependent estimators that infer the topology from the measurements, by maximum a-posteriori probability (MAP) selection or posterior weighting (multiple-model). We further extend the framework to networks of different sizes by jointly optimizing a common spectral function. We derive its MSE-optimal coefficients and decompose the resulting estimation loss into graph-filter approximation error and the additional cost of sharing a spectral response across networks. The proposed estimators admit sample-based implementations, while the shared spectral function can be applied to unseen graphs without retraining its coefficients. Simulations on IEEE power networks demonstrate the benefits of the proposed graph-spectral estimators under topology uncertainty and cross- network transfer.

0.42

Fidelity-Constrained Anchoring for Black-Box Denoisers

cs.CV ·2026-08-13 ·Masaki Satoh
similarity 0.58
Abstract · 5 pages, 5 figures. Supplementary material is available as an ancillary file

We propose a fidelity-constrained framework that anchors the output of a black-box denoiser to its input without retraining and with little additional computation. The method linearly blends the denoised image with the input and selects the maximum blending factor that satisfies a prescribed local fidelity constraint using Peak Signal-to-Noise Ratio (PSNR) or Structural Similarity Index (SSIM). For PSNR control, a closed-form solution is obtained under a local constant-blending assumption. For SSIM control, we derive a tractable formulation based on inverse SSIM under the same assumption and solve it efficiently using iterative root finding. Experiments on DIV2K images with synthetic Gaussian noise and outputs from Real-ESRGAN and a non-local means denoiser show that the proposed anchoring strategy provides effective fidelity control while balancing denoising performance and statistical naturalness, as measured by the excess kurtosis of residual noise. In particular, SSIM-based anchoring yields more consistent behavior across noise levels than PSNR-based anchoring.

0.07

CLIMB-flow: Coupled Linear Inverse posterior sampling via Multiscale-Based flow

cs.CV cs.LG ·2026-09-27 ·Zeqiu Yu, Ruizhi Yuan, Mathews Jacob
similarity 0.58
Abstract · 5 pages, 3 figures, 1 table. Submitted to ICASSP 2027

Diffusion models are now widely used in Bayesian inverse problems in imaging as priors, where latent diffusion models are often used for larger scale problems to keep the computational complexity and model-size manageable. Unfortunately, the auto-encoder based compression results in loss of spatial detail. In addition, the optimization is converted to a non-linear problem. In this paper, we introduce a posterior sampling algorithm customized for the pyramidal/cascaded architecture, which relies on a coarse to fine hierarchical strategy to generate images in the pixel domain. We present CLIMB-Flow which alternates between three steps: an end-point estimation from the current coarse and noisy image, data-consistent update of the clean image, and re-noising it back to the level the network expects. Together these steps sample the posterior at that scale using an approximate Gibbs sampling from two conditional distributions. Experiments on ImageNet, CelebA, AFHQ and fastMRI span inpainting, deblurring, super-resolution and accelerated MRI, with PSNR gains of 1.37-7.66 dB over the strongest competing method on CelebA and pixel-domain reconstruction up to 512x512.

0.26