CS Paper Radar

One Step Is Optimal: Unconditional Rectified Flows as Noise2Noise Denoisers for Low-Dose CT

Timothy Sereda, Debesh Jha

cs.CV ·submitted 2026-09-15 19:53 UTC · v2
benchmark

Abstract

We study rectified flows for denoising without clean training targets. For an unconditional rectified flow trained on Noise2Noise pairs, the optimal velocity field yields the minimum mean squared error (MMSE) denoiser in one step. In a jointly Gaussian model, we show that integrating the flow before applying its denoising readout increases error with integration time. The flow transports between noisy distributions, so its endpoint is not a clean-image estimate. Experiments on low-dose CT and Gaussian-corrupted natural images follow this pattern: one-step flow performs similarly to direct regression on the same pairs, whereas additional Euler steps reduce PSNR. A direct regressor using spatially separated, similar patches gives our best label-free CT result, a $1.99$\,dB gain over the noisy input. We report these results in CTDenoiser, a benchmark covering five architectures, supervised and self-supervised training, and two per-image methods. Supervised CNNs gain about $4$\,dB, while label-free performance depends strongly on how training pairs account for correlated CT noise. A channelized Hotelling observer also shows that fidelity gains need not improve lesion detectability: detectability falls at $160$\,HU despite higher PSNR and SSIM, while changes at $40$--$80$\,HU are small. Code, model definitions, and data-loading utilities will be released publicly; the repository link is withheld for anonymous review.

Comment
15 pages, 3 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Fast Self-Supervised Generative CT Denoising via Few-Step Sampling

cs.CV ·2026-11-19 ·Xingyi Yao, Zhengtao Ma, Zhennong Chen
similarity 0.73
Abstract · 30 pages, 4 figures, 2 tables. Xingyi Yao and Zhengtao Ma contributed equally to this work. Zhennong Chen is the corresponding author

Low-dose and thin-slice computed tomography (CT) images suffer from elevated noise that obscures anatomical detail, while clean references for supervised denoising are often unavailable. Although Noise2Noise permits self-supervised training from noisy pairs, direct regression tends to oversmooth fine structure. Averaging multiple independently generated samples mitigates this blur, though repeating multi-step diffusion sampling is costly. We introduce Noise2Noise with Improved Mean Flow (N2N-iMF) to accelerate this process via few-step sampling. N2N-iMF learns to generate one noisy image conditioned on its paired counterpart; at inference, independent outputs are sampled and averaged to suppress noise. We evaluated image quality and sampling efficiency on simulated thin-slice brain and low-dose abdominal CT across four sampling methods and averaging counts from 1 to 20, and validated the approach on real-world photon-counting CT (PCCT) brain scans. With ten samples per conditioning input and three network evaluations per sample, N2N-iMF achieved a mean absolute error of 2.60 HU on brain CT and 14.02 HU on abdominal CT, outperforming 50-evaluation denoising diffusion implicit model (DDIM) sampling (2.91 and 14.53 HU). On the same GPU, per-output generation time dropped from 7.29 to 0.43 s. Across eight PCCT cases, N2N-iMF reached a mean gray-white matter contrast-to-noise ratio of 1.341, versus 0.916 for Noise2Noise and 1.176 for DDIM. N2N-iMF accelerates self-supervised generative CT denoising without distillation while keeping the number of averaged outputs adjustable at inference.

0.24

Coarse-to-Fine Diffusion with Residual Prior for Low-Dose CT Denoising

eess.IV ·2026-09-30 ·Ping Wu, Pengcheng Zheng, Jiahao Zhang, Bohao Chen, Yazhou Ren +1 more
similarity 0.71
Abstract · 10 pages

Low-dose CT (LDCT) reduces radiation exposure but often introduces severe noise and streak artifacts that obscure subtle anatomical structures. Existing diffusion-based denoising methods commonly rely on implicit assumptions about the noise distribution, which may not hold in practical LDCT scenarios and can degrade denoising performance. To address this limitation, we propose a Residual-Guided Diffusion framework that effectively incorporates an explicit difference prior to inform the diffusion process of noise distribution. The difference prior is computed as the residual between the LDCT image and a coarse clean estimate, constraining diffusion sampling to a plausible residual space. We further adopt a coarse-to-fine strategy in which a pre-trained RED-CNN provides the coarse estimate to anchor global anatomy, and the diffusion model refines the remaining details under the prior guidance. For efficiency, we employ accelerated sampling with 20 steps at inference. Experiments on three representative datasets demonstrate that our approach outperforms existing methods in both quantitative and qualitative performance measures.

0.14

Noise2Match: Self-Supervised Low-Dose CT Denoising via Adaptive Inter-Slice Matching

cs.CV ·2026-10-13 ·Langrui Zhou, Guang Li, Xinyu Huang, Ziteng Zhou, Zuyang Huang +3 more
top venue similarity 0.70
Abstract

With the rapid development of deep learning, supervised convolutional neural network methods have greatly improved the performance of low-dose computed tomography (CT) denoising. However, they require paired noisy-clean training data, which is difficult to obtain in practice. Some classic self-supervised denoising methods rely on the assumption of pixel-wise independent noise, making them ineffective for correlated noise in low-dose CT (LDCT) images. Considering the high similarity and weaker noise correlation between adjacent CT slices, several recently proposed self-supervised methods use adjacent LDCT slices for training. Nevertheless, these approaches fail to effectively account for the non-rigid misalignment between slices caused by anatomical variation, hindering them from satisfying the equal-mean condition required by the classic Noise2Noise framework. In this paper, we propose Noise2Match, a self-supervised LDCT denoising method based on adaptive inter-slice matching. Noise2Match introduces an inter-slice matching network to model the label transition process between adjacent slices, and then applies correction to the denoiser's outputs to better satisfy the equal-mean condition. We theoretically prove that, under idealized conditions, training Noise2Match using adjacent LDCT slices is equivalent to supervised training with paired noisy-clean images. We further find that Noise2Match can also effectively perform low-dose conebeam CT (CBCT) denoising, which could be attributed to its correction operation that reduces inter-slice noise correlation. To the best of our knowledge, Noise2Match is the first effective image-domain self-supervised method for low-dose CBCT. Extensive experiments demonstrate that Noise2Match outperforms existing image-domain selfsupervised methods, offering broader applicability and higher practical value.

0.33

Pixel-Space Diffusion via Observation Operators

cs.CV ·2026-08-22 ·Shaojie Guo, Lichen Ma, Haoyang Tong, Yu He, Zipeng Guo +6 more
similarity 0.66
Abstract

Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.

0.28

Efficient Noise Context-Aware Representation for Low-Dose CT Denoising

cs.CV physics.med-ph ·2026-08-11 ·Minwoo Yu, N. Robert Bennett, Jongduk Baek, Adam S. Wang
code/data similarity 0.65
Abstract

While deep learning-based denoising has become widely adopted in low-dose CT, conventional models use generic architectures designed for natural images, failing to account for non-stationary and spatially correlated CT noise characteristics. To address this, we propose an Efficient Noise COntext-aware REpresentation (ENCORE) framework that explicitly leverages CT noise characteristics and anatomical features. First, we reformulate the noise synthesis procedure based on a realistic noise distribution beyond the conventional Gaussian approximation, establishing a rigorous foundation for training pair generation. Next, we extract local noise power and correlation contexts to guide the denoising process. To fully leverage the potential of noise context, we propose a FlyingConv module, which adaptively changes convolution weights for each local image region. Notably, our approach demonstrates substantial gains in both denoising quality and computational efficiency. Furthermore, manipulating the intensity of the noise context maps at inference time enables zero-shot conditional denoising, allowing for dynamic control over the output image texture. The entire pipeline is available at https://github.com/minwoo-yu/ENCORE.git

0.24

Beyond MSE: Rician Likelihood Denoising for Self-Supervised Cardiac $T2$ and $T1ρ$ MRI

eess.IV cs.CV ·2026-09-24 ·Nicholas A. Jacobs, Jason Mendes, Ravi Ranjan, Edward DiBella, Shireen Elhabian
similarity 0.64
Abstract · Made minor spelling and punctuation corrections

Magnetic resonance imaging involves an inherent trade-off among spatial resolution, acquisition time, and noise. This trade-off contributes to long scan times and high cost. Deep learning has improved image denoising, but cardiac MRI remains difficult because high-resolution, rapid acquisitions generally lack corresponding low-noise ground truth. Self-supervised denoising offers a potential solution by learning from noisy image pairs or even single noisy acquisitions. However, we show that Noise2Void-style blind-spot denoising, which uses a mean squared error (MSE) loss and assumes zero-mean, independent and identically distributed (i.i.d.) noise, is poorly suited to MR magnitude images. When applied to short-axis $T2$-weighted and $T1ρ$-weighted cardiac MRI with synthetic Rician noise, it produces biased denoised images and biased parametric maps of $T2$ and $T1ρ$. To address this limitation, we formulate self-supervised denoising as maximum likelihood estimation under a known Rician noise model. This yields unbiased denoisers that are competitive with supervised baselines.

0.22

Physics-Guided Flow Matching for CT Image Reconstruction

cs.AI cs.CV ·2026-08-28 ·Davide Evangelista
similarity 0.64
Abstract · 16 pages, 6 figures, 2 tables

Deep generative models have recently emerged as powerful priors for solving ill-posed inverse problems in CT, with diffusion-based approaches achieving state-of-the-art reconstruction performance. However, diffusion models typically rely on stochastic sampling procedures, long inference trajectories, and carefully tuned noise schedules, which can limit computational efficiency and numerical stability, especially at high spatial resolutions. In this work, we investigate Flow Matching as an alternative generative prior for CT reconstruction. We train a high-resolution Rectified Flow Matching model on 256x256 chest images from the Mayo Clinic Low-Dose CT dataset. To mitigate overfitting and limited anatomical variability, we employ a two-stage training strategy consisting of an initial phase with strong, anatomically informed data augmentation, followed by a fine-tuning phase with reduced or no augmentation to refine structural fidelity. The resulting model is capable of generating high-quality and anatomically coherent CT-like images, serving as a strong learned prior. We then evaluate multiple reconstruction methods specifically designed for Flow Matching models, including Plug-and-Play Flow, FlowDPS, Flower, and Flow-Priors (ICTM), and compare them against state-of-the-art diffusion-based reconstruction algorithms such as DDRM, DPS, and DiffPIR. Experimental results across several CT inverse problem settings show that Flow Matching-based approaches consistently outperform diffusion-based methods in terms of PSNR, SSIM, and perceptual quality, while requiring fewer sampling steps. Finally, we publicly release the trained Flow Matching model and accompanying code to facilitate reproducibility and future research. Overall, this work demonstrates that Flow Matching provides a stable, efficient, and effective alternative to diffusion models for high-resolution CT image reconstruction.

0.41

Polynomial Denoisers on the Image Manifold: Volterra Networks for Self-Contained Pixel Diffusion

cs.AI ·2026-11-07 ·Siddharth Roheda, Rohit Chowdhury, Amit Satish Unde, Aniruddha Bala
theory similarity 0.63
Abstract

Natural images are often conjectured to lie on a low-dimensional manifold within the high-dimensional pixel space. Recent work leverages this to build self-contained pixel-space diffusion models without specialized machinery or pretrained components. A plain Transformer on raw image patches suffices, provided it predicts the clean image rather than the noise and compresses each patch through an aggressive bottleneck. The mixing operator, however, has remained softmax attention, inherited from sequence modeling rather than derived from denoising. For Gaussian noise, the optimal denoiser admits a canonical expansion in polynomial functionals of the observation, the Wiener--Volterra series. We prove that softmax attention, and any normalized mixing rule (including linear attention), cannot realize any polynomial map beyond an affine one. In contrast, Volterra layers realize this class directly and, on a data manifold, achieve approximation rates governed by the manifold dimension rather than the ambient pixel dimension. We therefore propose the architecture these results prescribe; raw image patches passed through a bottleneck embedding, followed by cascaded low-rank Volterra layers, which carry no activation function because each layer is nonlinear in its own right. To our knowledge this is the first pixel-space diffusion architecture whose mixing operators are Volterra layers throughout, with no attention, no convolution, no pretrained components, and no activation function on the residual path. On ImageNet $256 \times 256$ and $512 \times 512$, the resulting model is competitive with self-contained pixel-space diffusion at matched parameter and FLOP budgets.

0.15