CS Paper Radar

Toward a Foundation Plug-and-Play Prior for Computed Tomography Reconstruction via a Multimodal Diffusion Model

Haley Duba-Sullivan, Patxi Fernandez-Zelaia, Obaidullah Rahman, Amirkoushyar Ziabari

cs.CV ·submitted 2026-08-24 12:41 UTC · v2
published

Abstract

Computed tomography (CT) throughput is limited by scan time, which grows with both the number of projections acquired and the detector integration time for each projection. Reconstructing high-quality volumes from sparse-view or low-dose measurements therefore depends on using an informative prior, typically a neural network trained for one specific scan setting and retrained whenever the modality, geometry, or material changes. We investigate whether a single diffusion model trained across several imaging domains can instead serve as a reusable prior for heterogeneous CT reconstruction problems. We evaluate the proposed method using the same diffusion visual transformer model and normalized denoising strength on three datasets that differ in modality, beam geometry, material, and degradation type, spanning additively manufactured metal parts and concrete microstructure imaged with cone-bean X-ray CT and parallel-beam neutron CT respectively. The proposed method improves upon analytic reconstructions in all three cases, demonstrating transferability across the evaluated problems and providing a step toward a reusable foundation prior for heterogeneous CT reconstruction.

Comment
To appear in SC26 Workshops proceedings

Closest papers

Nearest neighbours by meaning across the whole index.

Extremely Sparse-View Computed Tomography from 2D Projections via Pose-Aware Diffusion Priors

cs.CV cs.AI ·2026-10-28 ·Linrui Dai, Jinxiu Liang, Chu Zhou, Mae Yamaguchi, Ryuya Takahashi +1 more
published similarity 0.73
Abstract · NeurIPS 2026 poster

Extremely sparse-view computed tomography (xSV-CT) is critical when scanning time, motion, or radiation tolerance limits each scan to only a few projections. In many such scenarios, the same acquisition limits also constrain dataset construction, making pre-reconstructed 3D volumes from dense scans unavailable. This exposes a gap in current sparse-view approaches: Optimization-based methods, which use the sparse measurements directly but lack data-driven priors to suppress artifacts, and learning-based methods, which use strong priors but usually require densely scanned training volumes acquired outside the xSV-CT regime. We study this train-sparse / infer-sparse setting by learning a pose-aware diffusion prior from one 2D projection per training sample, then guiding diffusion sampling with measured-view fidelity, shared-volume reprojection, and projection-physics consistency for tomographic reconstruction. On two public CT datasets across 1-, 4-, and 8-view settings, the proposed method achieves the best novel-view synthesis scores and best or competitive reconstruction quality compared with baselines that use dense-volume supervision.

0.26

Feed-Forward Hierarchical Gaussian Diffusion for Extreme CT Reconstruction

cs.CV ·2026-08-15 ·Yuezhe Yang, Li Cheng
benchmarkcode/data similarity 0.71
Abstract

Reconstructing three-dimensional computed tomography (CT) from severely constrained projections is highly ill-posed. Sparse angular sampling, restricted angular coverage, and low photon counts can occur individually or jointly, obscuring global anatomy and local tissue detail. Many learned CT reconstruction methods are tailored to a single dominant degradation. Existing diffusion and Gaussian approaches commonly recover global structure and local detail within a shared representation. We propose HiGDiff, a feed-forward hierarchical Gaussian diffusion framework that decomposes reconstruction both spatially and from structure to detail. Physics-conditioned anatomical anchors and a foreground capacity field allocate learnable Gaussian primitives to informative regions. A structure diffusion stage first recovers global attenuation geometry, and its learned representation conditions a detail diffusion stage for residual boundaries and tissue transitions. The resulting Gaussian banks are rendered as attenuation fields and further refined by a gradient-isolated residual module. Experiments on three distinct CT benchmark datasets demonstrate state-of-the-art reconstruction performance across isolated, paired, and joint degradation settings, including improvements of 5.81 dB in macro-average peak signal-to-noise ratio (PSNR) and 0.113 in structural similarity index measure (SSIM) on the Low Dose CT Image and Projection Data (LDCT-PD) collection. Code and experimental configurations are openly available at https://github.com/Bean-Young/HiGDiff.

0.24

Coarse-to-Fine Diffusion with Residual Prior for Low-Dose CT Denoising

eess.IV ·2026-09-30 ·Ping Wu, Pengcheng Zheng, Jiahao Zhang, Bohao Chen, Yazhou Ren +1 more
similarity 0.71
Abstract · 10 pages

Low-dose CT (LDCT) reduces radiation exposure but often introduces severe noise and streak artifacts that obscure subtle anatomical structures. Existing diffusion-based denoising methods commonly rely on implicit assumptions about the noise distribution, which may not hold in practical LDCT scenarios and can degrade denoising performance. To address this limitation, we propose a Residual-Guided Diffusion framework that effectively incorporates an explicit difference prior to inform the diffusion process of noise distribution. The difference prior is computed as the residual between the LDCT image and a coarse clean estimate, constraining diffusion sampling to a plausible residual space. We further adopt a coarse-to-fine strategy in which a pre-trained RED-CNN provides the coarse estimate to anchor global anatomy, and the diffusion model refines the remaining details under the prior guidance. For efficiency, we employ accelerated sampling with 20 steps at inference. Experiments on three representative datasets demonstrate that our approach outperforms existing methods in both quantitative and qualitative performance measures.

0.14

PhyDiCT: Plug-and-Play CT Reconstruction from Sparse X-Rays via Differentiable Rendering and Strong Priors

cs.CV ·2026-10-07 ·Weicheng Dai, Shantanu Ghosh, Kayhan Batmanghelich
top venuecode/data similarity 0.69
Abstract · Accepted at MICCAI 2026; to appear in LNCS 16888

Reconstructing 3D Computed Tomography (CT) images from a few X-ray projections is a highly ill-posed inverse problem due to the loss of volumetric information. We propose PhyDiCT, a training-free framework that integrates a differentiable Physics-based forward model, grounded in the Beer-Lambert law, with a text-conditioned Diffusion as a strong prior to reconstruct 3D lung CT images. We refer to our approach as training-free since the prior model is used without fine-tuning, and our goal is to steer the denoising procedure to generate samples consistent with X-ray observations. We guide the diffusion generation using Split Gibbs sampling to jointly optimize for projection fidelity (reward) and consistency with prior knowledge. Also, we introduce a test-time refinement step that enhances image realism and anatomical coherence. We extensively evaluate our method on publicly available 3D CT datasets using both perceptual and semantic metrics, demonstrating that it surpasses existing plug-and-play diffusion and fully trained reconstruction approaches. Our findings highlight that combining a strong generative prior with the underlying physics of image formation substantially improves reconstruction quality, e.g., 7.5\% improvement on SSIM compared to full training methods. Code will be released at https://github.com/batmanlab/PhyDiCT.

0.44

Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling

cs.CV cs.GR ·2026-08-13 ·Kiseok Choi, Inchul Kim, Jaemin Cho, Hyeongjun Cho, Min H. Kim
published similarity 0.68
Abstract

Cone-beam computed tomography (CBCT) enables volumetric reconstruction from X-ray projections, but suffers from severe artifacts--especially beam hardening--when imaging materials with high attenuation such as metals. These artifacts arise from the polychromatic nature of X-rays and are not properly addressed by conventional monochromatic reconstruction algorithms. While recent neural representation-based methods offer improved reconstruction quality, they are computationally expensive and often impractical for deployment. We propose a novel physics-inspired, self-calibrating metal artifact reduction method that efficiently reconstructs 3D CBCT volumes while correcting beam hardening artifacts. Our method integrates a polychromatic X-ray projection model, material-dependent attenuation profiles, and system response modeling into a Gaussian Splatting framework. Unlike prior work, we eliminate the need for manual metal masks or strong prior assumptions, and we optimize both reconstruction parameters and X-ray spectral characteristics jointly during training. We further introduce a high-fidelity synthetic CBCT dataset generation pipeline validated on Monte-Carlo x-ray simulation toolbox and release new datasets with severe metal-induced artifacts to support the community. This is the first splat-based method for reducing beam hardening in CBCT. Extensive experiments on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art approaches in artifact suppression and reconstruction accuracy.

0.54

Physics-Guided Flow Matching for CT Image Reconstruction

cs.AI cs.CV ·2026-08-28 ·Davide Evangelista
similarity 0.67
Abstract · 16 pages, 6 figures, 2 tables

Deep generative models have recently emerged as powerful priors for solving ill-posed inverse problems in CT, with diffusion-based approaches achieving state-of-the-art reconstruction performance. However, diffusion models typically rely on stochastic sampling procedures, long inference trajectories, and carefully tuned noise schedules, which can limit computational efficiency and numerical stability, especially at high spatial resolutions. In this work, we investigate Flow Matching as an alternative generative prior for CT reconstruction. We train a high-resolution Rectified Flow Matching model on 256x256 chest images from the Mayo Clinic Low-Dose CT dataset. To mitigate overfitting and limited anatomical variability, we employ a two-stage training strategy consisting of an initial phase with strong, anatomically informed data augmentation, followed by a fine-tuning phase with reduced or no augmentation to refine structural fidelity. The resulting model is capable of generating high-quality and anatomically coherent CT-like images, serving as a strong learned prior. We then evaluate multiple reconstruction methods specifically designed for Flow Matching models, including Plug-and-Play Flow, FlowDPS, Flower, and Flow-Priors (ICTM), and compare them against state-of-the-art diffusion-based reconstruction algorithms such as DDRM, DPS, and DiffPIR. Experimental results across several CT inverse problem settings show that Flow Matching-based approaches consistently outperform diffusion-based methods in terms of PSNR, SSIM, and perceptual quality, while requiring fewer sampling steps. Finally, we publicly release the trained Flow Matching model and accompanying code to facilitate reproducibility and future research. Overall, this work demonstrates that Flow Matching provides a stable, efficient, and effective alternative to diffusion models for high-resolution CT image reconstruction.

0.41

Generative Priors for Total-Body PET Reconstruction

eess.IV cs.CV ·2026-09-18 ·Movindu Dassanayake, George Webber, Denis Prokopenko, Julia A. Schnabel, Andrew J. Reader
published similarity 0.67
Abstract · MICCAI RIME 2026 (Accepted Poster)

Total-body positron emission tomography (TB-PET) enables fast, low-dose, and dynamic imaging over a long axial field of view, but reconstruction remains challenging due to reduced counts, large image volumes, and increased data dimensionality. Generative models offer powerful learned priors for low-count PET, yet explicit PET measurement conditioning at TB scale has not been demonstrated. Inspired by PET decomposed diffusion sampling (PET-DDS), we propose TB-PET-DDS, a reconstruction framework that combines a CT-conditioned generative prior with patient-specific list-mode PET data. During reverse diffusion, PET consistency is enforced using a closed-form 3D TB-PET maximum-a-posteriori expectation maximisation fusion update, rather than relying solely on image-domain conditioning. The synthetic measurements are generated from the low-dose vendor reconstruction, providing a controlled inverse problem and retaining a full-dose reference. Proof-of-concept evaluation was performed on a single clinical TB-PET acquisition, with reconstruction hyperparameters selected against the full-dose reconstruction from the same case for all models. TB-PET-DDS improved NRMSE and SSIM relative to the DDIM and Image-DDS baselines, improving through-plane consistency in coronal views while enhancing agreement with the measured PET data. Although smoothed low-dose vendor reconstructions achieved the best global voxel-wise metrics, TB-PET-DDS produced the lowest liver coefficient of variation. These results demonstrate the feasibility of measurement conditioned diffusion reconstruction at TB scale and provide an initial route towards learned, projector-consistent generative reconstruction for low-count TB-PET imaging.

0.13

Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures

cs.CV cs.AI ·2026-10-02 ·Elena Morotti, Davide Evangelista, Elena Loli Piccolomini
similarity 0.67
Abstract · 21 pages, 7 figures, 2 tables

Solving severely ill-posed imaging inverse problems requires recovering image structures that are unobservable or weakly constrained by the measurements. Diffusion models provide expressive learned priors for inferring such missing information, while posterior sampling incorporates measurement consistency along the reverse process. Standard diffusion posterior samplers, however, rely on instantaneous measurement-aware estimates, without explicitly exploiting information carried by previous posterior corrections. We introduce Consecutive Posterior Fusion Denoising Diffusion Null-Space Models (CPF-DDNM), an inference-time strategy that fuses consecutive measurement-aware estimates to improve the diffusive recovery of unobservable image structures, without requiring retraining or additional denoiser evaluations. We instantiate this principle within DDNM, whose range/null-space decomposition reveals that consecutive fusion preserves the measurement-determined component while acting exclusively on the prior-driven null-space estimate. We thus provide a geometric interpretation of CPF-DDNM and a local error analysis that characterizes the optimal time-dependent fusion coefficient, including the extrapolative regime. Experiments on sparse-view and simulated low-dose computed tomography, as well as medical image super-resolution, show consistent improvements over DDNM and competitive performance against diffusion-based inverse solvers.

0.14