CS Paper Radar

Unified Residual Translation for Paired Image Restoration

Joyanta Jyoti Mondal, Mridul Banik, Ibne Farabi Shihab, Md. Shifatul Ahsan Apurba

cs.CV ·submitted 2026-11-17 12:12 UTC · v1

Abstract

Paired image restoration spans changes in imaging contrast, sensor modality, and spatial resolution. These settings differ in their input channels and target grids, raising the question of how much of the prediction pipeline must be specialized to each task. We present the Unified Residual Translator (URT), which separates fixed channel and scale mapping from learned residual prediction. A deterministic reference uses channel averaging, replication, or bicubic interpolation to match the target dimensions, while a NAFNet encoder-decoder predicts an additive correction from the complete input. Separately trained instances share the prediction rule, $\ell_1$ objective, and optimizer across MRI contrast synthesis, visible-to-infrared translation, SAR-to-optical translation, and real-camera super-resolution. Across six task and scale settings, URT achieves the highest PSNR and SSIM among the evaluated baselines on IXI, SEN1-2, and RealSR $\times3$ and $\times4$. It reaches 30.774dB on IXI and 13.478dB on SEN1-2, with luminance PSNR of 33.596, 28.742, and 27.342dB at the three RealSR scales. On LLVIP, it ranks second in PSNR and SSIM. A study of four spectral alternatives identifies complementary benefits of fitted references and bandwise residual gains. Together, these results support explicit dimensional alignment and learned residual correction as a common formulation for heterogeneous paired imaging tasks.

Comment
10 pages, 2 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Awaken, Then Scale: Tiny Adaptation for MRI Reconstruction

eess.IV cs.CV ·2026-09-25 ·Mohammed Wattad, Tamir Shor, Alexander M. Bronstein
similarity 0.68
Abstract

Dormant Awakening (DA) specializes a magnetic resonance imaging (MRI) reconstruction model by fitting a small set of zero weights to one labeled slice. Across fourteen U-shaped convolutional network (U-Net) and vision transformer (ViT) sources, fitting 1,004 or 10,560 weights gives mean peak signal-to-noise ratio (PSNR) gains of .430 and .509 dB. We analyze how scaling the fitted output correction changes evaluation PSNR, then use the calibration correction size to cap changes on new images. The cap bounds changes in root mean squared error (RMSE) relative to the source without an evaluation reference. At 10\% adaptation budget, we compare fixed halving and dynamic capping for DA, unrestricted sparse adaptation and low-rank adaptation (LoRA). The controls increase both measured calibration-evaluation correlations across all six tested architecture-adapter settings. Experiments concern one constructed fastMRI-to-M4Raw shift with fixed source checkpoints and participant panels.

0.19

MARR: Decoupling Policy, Execution, and Calibration for All-in-One Medical Image Restoration

cs.CV ·2026-09-06 ·Haobin Chen, Ao Chang, Heqin Zhu, Rundong Wang, Ting Liu +1 more
benchmarkcode/data similarity 0.67
Abstract · 8 pages, 4 figures, 2 tables

All-in-one medical image restoration seeks to recover heterogeneous clinical images with a single model, but PET, CT, and MRI differ substantially in degradation statistics, anatomical contrast, and output-space bias. A fully shared network can entangle modality-specific residual errors, whereas separate modality-specific networks sacrifice the practical advantages of unified deployment. We therefore recast all-in-one restoration as a question of where limited adaptation should be placed: policy selection, feature execution, or output calibration. We propose MARR, a compact restoration framework that constrains multi-modality adaptation into degradation-aware policy routing, modality-private residual execution, and image-domain residual correction without requiring degradation labels or separate modality-specific models. The policy branch forms a routing prompt from input statistics, latent content, and modality identity, and uses it only as a control signal. Prompt-gated modality-private adapters then perform lightweight residual refinement at intermediate decoder stages, while zero-initialized modality-specific output heads calibrate the final image-domain residual without perturbing the initial shared prediction. On an all-in-one PET, CT, and MRI restoration benchmark, MARR outperforms thirteen methods re-trained under the same protocol, achieving PSNR values of 37.34 dB, 33.85 dB, and 32.09 dB on PET, CT, and MRI, respectively, and the best modality-average PSNR of 34.43 dB. The code is publicly available at https://github.com/CHB-learner/MARR.

0.30

Beyond Sparsity: Weight Location and Network Context in Pruned MRI Reconstruction

eess.IV cs.CV ·2026-09-25 ·Mohammed Wattad, Tamir Shor, Alexander M. Bronstein
similarity 0.67
Abstract

Pruning reduces the number of weights in magnetic resonance imaging (MRI) reconstruction networks. Equal sparsity, however, can retain weights with different computational roles and different compatibility with the trained network. We study these effects across 120 convolutional U-Net and vision transformer models using controlled edits evaluated before retraining. In U-Net, preserving high-resolution computation improves reconstruction at equal deletion counts across all tested sparsity levels. Equal-operation controls reveal additional sensitivity of the first convolution, which operation count alone cannot explain. In transformers, retained pretrained weight energy correlates with quality within sparsity levels, yet the same masks reverse their reconstruction ranking when the surrounding trained weights change. At 90\% sparsity, matching intermediate output scales largely removes a high-energy-mask penalty while retaining an advantage for the network's original mask. Thus sparsity alone does not characterize reconstruction quality: architecture-specific descriptors are informative, but mask quality can still depend on the surrounding trained network.

0.28

SPARK: Input-Conditioned Sparse Activation Modulation for Frozen DiT-based Super-Resolution

cs.CV ·2026-09-03 ·Federico Putamorsi, Leonardo Zini, Marcella Cornia, Lorenzo Baraldi
similarity 0.64
Abstract

Real-world image super-resolution (SR) increasingly relies on Diffusion Transformer (DiT) backbones, whose internal activations can be dominated by a small number of massive channels. Yet improving perceptual quality in these models still typically requires fine-tuning the network or attaching additional adapters, leaving this structured activation space largely unexplored for adaptation. We investigate whether dominant channels can instead serve as a compact adaptation interface for frozen DiT-based SR models. We first characterize their behavior in pretrained SR backbones and show through controlled interventions that they strongly affect reconstruction quality. Building on this observation, we introduce SPARK, a lightweight input-conditioned controller that predicts bounded per-channel affine transformations for only the selected channels, while keeping the SR backbone and VAE frozen. Dominant channels are identified through an online activation-ranking procedure, and only a small predictor conditioned on the low-resolution VAE latent is optimized. Experiments on three DiT-based SR backbones across DIV2K, RealSR, and DRealSR show consistent gains in both fidelity and perceptual quality while modulating only eight channels per stream and block. Controlled comparisons further show that these gains cannot be explained by parameter budget or access to the selected channels alone.

0.20

Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI

eess.IV cs.CV ·2026-09-18 ·Changjing Chai, Bin Huang, Libo Xu, Jian Zhou, Boyang Pan +3 more
similarity 0.63
Abstract · 18 pages of main text, 2 pages of appendix, 6 figures, and 6 tables (including 2 appendix tables)

Background: Four-fold accelerated sensitivity encoding (SENSE4) can shorten brain MRI acquisition time but may amplify noise and result in residual aliasing artifacts after conventional reconstruction. Purpose: To evaluate whether an image-domain refinement framework can improve the quality of SENSE4 brain MRI while preserving anatomical information for quantitative measurements. Methods: In this prospective paired study, 80 participants underwent fully sampled and four-fold accelerated SENSE T1-weighted MRI. We developed an Anatomy-aware Residual Attention Network (ART-Net) to refine accelerated reconstructions through generalized self-attention and correlation-based residual artifact regularization. Participant-level splitting yielded training, validation, and independent test cohort (45/5/30 participants). The independent test cohort underwent quantitative, segmentation-based, and blinded radiologist assessments of image quality and anatomical preservation. Results: ART-Net demonstrated highly competitive reconstruction performance, achieving the highest peak signal-to-noise ratio (31.03 +/- 2.88 dB) and structural similarity index (0.963 +/- 0.022) among evaluated methods. It also demonstrated improved anatomical fidelity, with numerically highest Dice coefficients for medial temporal structures relevant to atrophy assessment (0.8824 +/- 0.0827) and whole-brain regions (0.8857 +/- 0.0885). Moreover, ART-Net improved gradient fidelity, regional contrast preservation, and radiologist-rated structural quality. Conclusion: ART-Net improved agreement between SENSE4 and fully sampled T1-weighted images in a single-center, held-out test cohort while maintaining segmentation-derived anatomical measurements. These findings suggest that ART-Net may support accelerated brain MRI by improving image fidelity and enabling reliable downstream anatomical analysis.

0.23

Beyond Training from Scratch: Foundation Models for Data-Efficient and Generalizable Cardiac MRI Reconstruction

cs.CV ·2026-10-06 ·Anam Hashmi, Mayug Maniparambil, Julia Dietlmeier, Kathleen M. Curran, Noel E. O'Connor
publishedcode/data similarity 0.63
Abstract · Accepted at ECCVW 2026

Cardiac magnetic resonance imaging reconstruction aims to recover high-quality images from undersampled acquisitions, enabling faster scans while preserving diagnostic fidelity. Recent reconstruction methods are typically trained from scratch and often require large amounts of task-specific data, limiting their robustness under data scarcity and distribution shifts. In this work, we investigate whether pretrained vision foundation models can serve as effective priors for accelerated cardiac MRI reconstruction. We propose a reconstruction framework that integrates frozen and parameter-efficiently adapted visual encoders, including CLIP, BiomedCLIP, and DINOv2, within a transformer-based reconstruction architecture. Extensive experiments on the CMRxRecon2023 and CMRxRecon2024 benchmarks demonstrate that pretrained representations consistently outperform a transformer trained from scratch across multiple acceleration factors. We further evaluate performance under limited supervision and cross-dataset transfer, showing that foundation models provide superior data efficiency and generalization. While frozen representations are particularly effective in extreme low-data regimes, Low-Rank Adaptation (LoRA) yields additional gains when moderate amounts of training data are available. Among the evaluated backbones, DINOv2 achieves the strongest overall performance. These findings highlight the potential of vision foundation models as robust and transferable priors for cardiac MRI reconstruction.

0.31

STAIRS: Staging the Inverse Problem via Admissible-Support Scheduling for Unrolled MRI Reconstruction

cs.CV ·2026-11-06 ·Xiangjian Hou, Chang Ni, Chao Qin, Zhiwei Tan, Xin Wang +4 more
similarity 0.62
Abstract

Accelerated magnetic resonance imaging (MRI) forms images from incomplete Fourier measurements, shifting acquisition burden to computational reconstruction. Deep unrolled networks interleave learned regularization and data consistency, yet typically estimate the full unmeasured spectrum at every cascade. We propose STAIRS (Staging the Inverse Problem via Admissible-Support Scheduling), which projects intermediate reconstructions onto nested Fourier supports that expand to the full spectrum and conditions each update on its support transition. Conditional increments of a regularized log-determinant score of training covariance define a normalized spectral coordinate, accounting for dependencies between newly and previously admitted frequencies. Dyadic targets allocate larger coordinate increments to earlier cascades and are mapped to fixed supports before training, enabling coarse-to-fine reconstruction with unchanged sampling masks and data consistency. On fastMRI and Stanford2D, STAIRS improves matched Transformer (HUMUSNet) and convolutional (NAFNet) backbones in single- and multi-coil reconstruction, including radiologist-annotated pathology regions. It also outperforms predictor-based progression with lower parameter overhead and inference latency. Stage-wise analysis shows repeated error correction by projection and lower intermediate reconstruction errors than the backbones alone throughout support expansion. Ablations favor dyadic allocation over uniform expansion for square and line-band supports and over manual front-loading for square windows. Support projection alone improves reconstruction, and transition conditioning strengthens the gain. Cross-dataset evaluation shows improvements for both backbones in both directions. Support allocation thus complements regularizer design in unrolled MRI reconstruction.

0.22

Frequency-consistent synthesis and selective transfer for medical image analysis

eess.IV cs.CV ·2026-11-06 ·Zhuhui Wang, Jianwei Zuo, Xin Peng, Kai Zhong, Xuliang Deng +1 more
similarity 0.62
Abstract · 40 pages, 5 figures

Complementary imaging is not always available, and realistic synthesis does not necessarily improve downstream analysis. Here we introduce a training framework linking medical image synthesis to task learning through adaptive frequency consistency and selective feature transfer. Image-specific frequency constraints encourage consistency of structure and detail. Features are transferred only when a teacher using synthetic images achieves a lower task-error score than the student by a task-specific margin on a labelled training sample. Evaluations across five datasets show improved translation fidelity with three adversarial and diffusion-based translators trained without paired supervision, alongside gains in brain-tumour segmentation on tumour-containing slices and lesion centre-point detection. All 105 reported paired comparisons yielded point estimates favouring the proposed methods, including 36 external translation comparisons on post?treatment MRI without retraining. These findings support synthetic modalities as task-oriented complements to acquired scans when complementary imaging is unavailable.

0.24