CS Paper Radar

Noise2Noise Revisited: Training Pair Distributions Dominate Loss Choice in Self-Supervised Denoising

Dingyan Shang, Zhenyu Xu, Youting Wang, Bonan Shen, Bowen Liu

cs.LG cs.CVeess.IV ·submitted 2026-09-15 07:57 UTC · v1
publishedbenchmarkcode/data

Abstract

Noise2Noise (N2N) trains denoisers on pairs of independently corrupted observations, eliminating clean references. We stress-test two natural conjectures about why the L1 loss outperforms L2 here. First, the hypothesis that the L1 loss confers robustness via parameter sparsity confuses the loss with Lasso regularization: an explicit Lasso penalty produces the predicted sparsity yet fails to reproduce L1's cross-noise behavior, while L1- and L2-trained weight distributions are indistinguishable. Second, the population optima of the two losses coincide exactly for symmetric signal posteriors and nearly so for concentrated ones. Measured differences are therefore dominated by optimization dynamics (bounded-influence gradients), which we probe with gradient statistics and contaminated-target training. On Kodak24 with five synthetic noise families, the L1 loss holds a statistically significant edge over L2, below 1 dB PSNR, holding across three seeds on 13 of the 14 noise columns. On real camera noise the loss is not the decisive variable in distribution: on official SIDD validation blocks, synthetic-Gaussian-trained N2N models gain only 0.8 to 3.7 dB over the noisy input regardless of loss, while retraining on SIDD's own noisy pairs, never reading ground truth, gains 9.4 to 11.0 dB, far ahead of BM3D. All metrics are on raw network outputs, and the study makes no leaderboard claim. The training pair distribution, not the loss, carries the inductive bias. That design rule applies wherever clean references are unobtainable, from microscopy to industrial inspection sensors.

Comment
8 pages, 3 figures, 3 tables. Accepted to The 8th International Conference on Video, Signal and Image Processing (VSIP 2026). Code and data: https://github.com/dyshang/noise2noise-revisited

Closest papers

Nearest neighbours by meaning across the whole index.

Analyzing Learning-Dynamics Across Loss and Prediction Choices for Diffusion Models

cs.LG ·2026-11-13 ·Dongwoo Kim
theory similarity 0.64
Abstract · NuerIPS2026

Denoising generative models predict clean data ($x$), noise ($ε$), or velocity ($v$), while training losses can be measured in any of these spaces. Although the resulting nine combinations are algebraically related, they can yield substantially different denoising accuracy and sample quality. We disentangle the effects of prediction and loss spaces. For a fixed prediction target, we show that changing the loss space is exactly equivalent to timestep reweighting and provide a heuristic analysis of how this reweighting affects generation quality. We then show that a rank-$m$ linear bottleneck compressing a $D$-dimensional noisy input imposes an irreducible squared-error floor of $D-m$ on noise and velocity prediction, whereas clean-data prediction can exploit low-dimensional data structure. Combining this bound with prediction-dependent error conversion yields distinct necessary conditions on bottleneck capacity. Experiments with U-Net and JiT across CIFAR-10, Imagenette, and ImageNet-256 support these theoretical predictions. Under compression, prediction choice strongly affects both denoising accuracy and sample quality, with noise-prediction errors closely matching the theoretical lower bound. Our results provide a quantitative understanding of how architectural bottlenecks interact with prediction and loss choices in denoising generative models.

0.39

Learned Regularization for Sparse-View CT: Accuracy, Lesion Detectability and Distribution Shift of a Plug-and-Play Prior against Tuned Total Variation

eess.IV cs.CVeess.SP ·2026-11-13 ·Mohammed Abo Oraig
code/data similarity 0.62
Abstract · 62 pages, 22 figures, and 30 tables. Preprint (not peer-reviewed); also available on Zenodo: https://doi.org/10.5281/zenodo.24107061. Code a…

Learned image priors are often proposed to replace hand-crafted regularizers in sparse-view computed tomography (CT), yet they are usually judged by PSNR on data resembling their training set. We evaluate one noise-conditioned DnCNN denoiser used as a Plug-and-Play prior against filtered back-projection (FBP), Tikhonov and total-variation (TV) regularization, with every method tuned on validation data and all differences paired. On synthetic 28x28 digit images, the prior beats box-constrained TV by about 3.4 dB at moderate noise (sigma = 0.05, 20 angles), but the advantage shrinks at low noise and reverses under distribution shift: an MNIST-trained prior is 3.1 dB (Fashion-MNIST) and 4.3-4.6 dB (Shepp-Logan phantom) below TV, whereas a Fashion-MNIST-trained prior beats TV by 2.2 dB on Fashion-MNIST, consistent with prior mismatch rather than a failure of PnP itself. In a lesion-insertion test the prior detects lesions worse than TV in distribution despite its higher PSNR, and under mismatch it produces more lesion-like false blobs than box-constrained TV for seven of eight lesion types. On real LoDoPaB-CT slices (patient-disjoint split; 30, 60 and 120 angles; three dose levels; 40 test patients), the prior does not consistently outperform a well-tuned TV in PSNR (-0.93 to +0.33 dB) and has lower SSIM in eight of nine conditions. Its lesion-detection AUC is higher than this TV's in all nine conditions (significant in six) but never significantly higher than that of Hann-filtered FBP, which the PSNR-tuned TV falls below in detection in all nine conditions (seven significant). On non-anatomical phantoms its PSNR falls below TV in all six conditions. PSNR and lesion detectability thus rank the methods differently. Our conclusions concern one small denoiser, and the CT analysis was developed after seeing results, without pre-specified primary comparisons.

0.42

Beyond MSE: Rician Likelihood Denoising for Self-Supervised Cardiac $T2$ and $T1ρ$ MRI

eess.IV cs.CV ·2026-09-24 ·Nicholas A. Jacobs, Jason Mendes, Ravi Ranjan, Edward DiBella, Shireen Elhabian
similarity 0.61
Abstract · Made minor spelling and punctuation corrections

Magnetic resonance imaging involves an inherent trade-off among spatial resolution, acquisition time, and noise. This trade-off contributes to long scan times and high cost. Deep learning has improved image denoising, but cardiac MRI remains difficult because high-resolution, rapid acquisitions generally lack corresponding low-noise ground truth. Self-supervised denoising offers a potential solution by learning from noisy image pairs or even single noisy acquisitions. However, we show that Noise2Void-style blind-spot denoising, which uses a mean squared error (MSE) loss and assumes zero-mean, independent and identically distributed (i.i.d.) noise, is poorly suited to MR magnitude images. When applied to short-axis $T2$-weighted and $T1ρ$-weighted cardiac MRI with synthetic Rician noise, it produces biased denoised images and biased parametric maps of $T2$ and $T1ρ$. To address this limitation, we formulate self-supervised denoising as maximum likelihood estimation under a known Rician noise model. This yields unbiased denoisers that are competitive with supervised baselines.

0.22

One Step Is Optimal: Unconditional Rectified Flows as Noise2Noise Denoisers for Low-Dose CT

cs.CV ·2026-09-15 ·Timothy Sereda, Debesh Jha
benchmark similarity 0.61
Abstract · 15 pages, 3 figures

We study rectified flows for denoising without clean training targets. For an unconditional rectified flow trained on Noise2Noise pairs, the optimal velocity field yields the minimum mean squared error (MMSE) denoiser in one step. In a jointly Gaussian model, we show that integrating the flow before applying its denoising readout increases error with integration time. The flow transports between noisy distributions, so its endpoint is not a clean-image estimate. Experiments on low-dose CT and Gaussian-corrupted natural images follow this pattern: one-step flow performs similarly to direct regression on the same pairs, whereas additional Euler steps reduce PSNR. A direct regressor using spatially separated, similar patches gives our best label-free CT result, a $1.99$\,dB gain over the noisy input. We report these results in CTDenoiser, a benchmark covering five architectures, supervised and self-supervised training, and two per-image methods. Supervised CNNs gain about $4$\,dB, while label-free performance depends strongly on how training pairs account for correlated CT noise. A channelized Hotelling observer also shows that fidelity gains need not improve lesion detectability: detectability falls at $160$\,HU despite higher PSNR and SSIM, while changes at $40$--$80$\,HU are small. Code, model definitions, and data-loading utilities will be released publicly; the repository link is withheld for anonymous review.

0.31

Double Descent and Malign Overfitting in Diffusion Models

cs.LG cond-mat.dis-nn ·2026-09-22 ·Raphaël Urfin, Tony Bonnaire, Giulio Biroli, Marc Mézard
similarity 0.60
Abstract · 44 pages, 17 figures

Conventional wisdom in deep learning holds that overparameterization---having more parameters $p$ than training samples $n$---is benign: larger models generalize better and, even without regularization, interpolating models generalize well, the test error following a double-descent curve. One might expect the same benign overfitting for diffusion models, whose training reduces to regression, i.e. to minimizing a quadratic score-matching loss. Yet the opposite is observed: overfitting here is catastrophic, driving the model into a memorization regime. We resolve this paradox by combining experiments on U-Nets trained on CelebA with a random-features model for which we derive closed-form learning curves. We show that with a fixed number $m$ of noise realizations per training sample, an interpolation peak does occur, but at $p\sim nm$ rather than at $p\sim n$ as in standard regression. The rise of the test loss, however, sets in much earlier, at $p\sim n$, independently of $m$. This overfitting is malign because, although the implicit regularization of training is fully at work, it drives the model toward the empirical score, which memorizes the training set, rather than toward the true score. A bias-variance decomposition pinpoints the mechanism: the bias of the score estimator starts to grow at $p\sim n$; past the peak the variance decays, as in regression, whereas the bias keeps growing and both saturate at a large value. Since diffusion models are trained with $m\gg1$, the peak is pushed to very large model sizes, and therefore sit on the rising branch that precedes it, where malign overfitting is already in play. Nevertheless, overparameterization remains beneficial when paired with regularization: in the random-features theory and in U-Net experiments, optimally regularized large models---via a ridge penalty or early stopping, respectively---outperform any unregularized models.

0.32

SIDUMN: Self-Supervised Image Denoising Under Symmetric Multiplicative Noise

cs.CV ·2026-11-17 ·Nyan Htet Naing, Gyeongha Hwang
similarity 0.60
Abstract · 10 pages, 4 figures, 2 tables

Self-supervised denoising is challenging when the corruption is multiplicative and signal-dependent. In this letter, we propose SIDUMN, a symmetric noisier framework for self-supervised denoising under mean-one symmetric multiplicative noise. Given noisy observations and the noise law, the method samples an independent synthetic noise factor from the same law and constructs two complementary noisier images by applying the factor and its reflection about one. The denoising network is trained to predict one noisier image from the other, and at inference the reconstructions of $K$ such antithetic pairs are averaged. We show that the population target of the training loss is the clean conditional mean minus a multiplicative cross-term. We further prove that, for any trained network, antithetic averaging never increases the expected squared error of a single noisier-input reconstruction. Numerical results validate the theoretical findings and the proposed method.

0.35

Noise-Regularized Training for Learned Image Compression

eess.IV cs.CV ·2026-11-06 ·Renjie Zou, Zhiwei Huang, Dong Jiang
top venuecode/data similarity 0.60
Abstract · 22 pages, 4 figures. Accepted as a Spotlight paper at NeurIPS 2026

Learned image compression (LIC) is trained almost exclusively on clean images: the only stochastic perturbation in the loop is an additive uniform proxy injected in the latent domain to keep the entropy model differentiable. Outside compression, by contrast, a long line of work---from Tikhonov regularization and contractive autoencoders through denoising score matching and modern diffusion models---has established that Gaussian noise at the input of a network with a clean target acts as a structured probe of the data manifold rather than as data augmentation. Building on this view, we introduce noise-regularized training for LIC: at every training step we add Gaussian noise to the encoder input while keeping the distortion target, the latent uniform proxy, the hyperprior, and the entropy coding pipeline unchanged. The recipe is architecture-agnostic and adds essentially no training or inference overhead. Across backbones and operating regimes it yields consistent BD-Rate gains: -2.60% on a reproduced ELIC and -0.85% / -1.05% / -2.38% on the Base/Medium/Large scales of a variable-rate DMCI codec, with DMCI-Large reaching -22.02% against VTM-22.0. A second-order expansion of the noisy RD loss accounts for these gains: because the noise enters upstream of the analysis transform, it converts the clean RD objective into a structured $O(σ^{2})$ regularizer comprising an information-weighted encoder-Jacobian penalty (rate side) and a Frobenius contractive penalty on the end-to-end reconstruction map (distortion side). A finite-difference Lipschitz analysis shows corresponding sensitivity reductions of ~12% for the encoder and ~8% for the end-to-end codec, while an exact-JVP test further shows preferential contraction of high-information directions. Code and trained models are available at https://github.com/Googolxx/NoiseRegu-LIC.

0.52

Characterizing the Edge of Stability in Variational Training Without Priors

cs.LG stat.ML ·2026-11-11 ·Juraj Marusic, Jonathan Wenger, Beau Coker, John P. Cunningham
top venuebenchmark similarity 0.58
Abstract · Accepted at NeurIPS 2026. 21 pages, 7 figures

Variational approaches in deep learning promise to deliver improved uncertainty quantification and out-of-distribution generalization by inferring a distribution over weights, regularized by a divergence to a chosen prior. However, prior elicitation presents a significant challenge in deep learning, resulting in the common practice of significantly downweighting the regularization term in the variational objective. Recently, it was proposed to train solely via the expected loss by relying on implicit regularization from the optimizer, rather than explicit regularization from the divergence to the prior. While this approach largely sidesteps the issue of prior elicitation, current theory lacks an understanding of how key optimization hyperparameters impact the implicit regularization. Here, we theoretically and empirically demonstrate that larger learning rates and fewer parameter samples lead to flatter minima of the loss landscape, which are known to generalize better. We show that training on the expected loss operates at a modified edge of stability, characterized by the signal-to-noise ratio of the gradient estimates and the number of Monte Carlo samples. Experiments on out-of-distribution benchmark datasets confirm the practical significance of the theoretical results.

0.35