CS Paper Radar

Differentiable Jitter Correction using Deep Learning-based Image Quality Metric for Phase-Contrast Micro-CT

Junan Chen, Yiting Jia, Joscha Maier, Dominik John, Sami Wirtensohn, Imke Greving, Silja Flenner, Matthias Wieczorek, Julia Herzen

cs.CV ·submitted 2026-08-27 12:22 UTC · v3

Abstract

This paper proposes a fully differentiable jitter correction method for X-ray phase-contrast micro computed tomography using a deep learning-based image quality metric that estimates and compensates per-projection rigid jitter directly from the acquired projection data, without a pre-scan motion-free reference. The approach builds on a gradient-based auto-focus strategy adapted to parallel-beam geometry. A set of candidate objective functions is benchmarked in a controlled study, and the sensitivity of the visual information fidelity (VIF) metric to the jitter artifact is verified with the target phase-contrast data. To operate without a clean reference, a compact 3D convolutional neural network is trained to predict the VIF score from a single corrupted volume. A spatially selective total variation penalty applied exclusively to the image background is introduced to penalize spurious high-frequency structures that otherwise emerge during optimization. Experiments on biological specimens acquired at different synchrotron beamlines are conducted. Evaluation uses jitter motion applied to simulated and experimentally acquired projection data. The result confirms that the integrated pipeline reliably recovers fine structural detail lost due to jitter, with generalization demonstrated across morphologically distinct samples.

Closest papers

Nearest neighbours by meaning across the whole index.

Accelerating Variational Cone-Beam CT Reconstruction with Learned Warm Starts

eess.IV cs.AIcs.CV ·2026-11-13 ·Héloïse Dudoignon, Clément Delmas, Laurent Facq, Clair Poignard, Baudouin Denis de Senneville
similarity 0.63
Abstract · Submitted to IEEE ISBI 2027

Variational reconstruction provides a rigorous framework for cone-beam computed tomography (CBCT) by combining an explicit acquisition model with image priors. However, iterative optimization remains computationally demanding, particularly under severe noise and sparse-view conditions. Although learning-based methods achieve high reconstruction quality, they often replace the original variational formulation with learned optimization schemes or nonlinear equilibrium models. We propose a neural network-guided warm-start framework that accelerates variational reconstruction while preserving its original formulation. Projection data are first reconstructed using the Feldkamp-Davis-Kress (FDK) algorithm, and the resulting image is refined by an image-domain neural network. The network output is used solely to initialize the subsequent model-based optimization, leaving the forward model, data-fidelity term, regularization, and optimization scheme unchanged. A pre-regularization step further improves compatibility with the variational priors. Experiments on pelvic CT images from the SynthRAD2025 challenge show a more than threefold reduction in reconstruction time while maintaining comparable image quality.

0.21

OX-NeRF: 3D X-ray Tomography Reconstruction from Sparse Views Using Implicit Neural Representation

cs.CV ·2026-10-08 ·Thomas Welsch, Min-Hsin Tu, David J. Chapman, Daniel E. Eakins
similarity 0.62
Abstract

NeRF and Gaussian splatting methods have been successfully applied on X-ray scenes where the views are too sparse for 3D reconstruction via classical methods. Ultra-sparse scenes with 10 or fewer views such as those with high-rate or low-dose acquisition still, however, present a significant challenge. To address this problem we present a new framework, Optimised X-ray Neural Radiance Fields (OX-NeRF), that combines cross-scene feature learning with scene-specific optimisation to reconstruct sets of related scenes. OX-NeRF employs a convolutional neural network (CNN) to identify cross-scene features while maintaining scene-specific multi-resolution hash grids of spatial features. The paired representations are fused and passed to a multilayer perceptron (MLP); the CNN, hash grids and MLP are then jointly optimised end-to-end. Benchmarking on parallel-beam and cone-beam X-ray datasets shows OX-NeRF provides significantly higher reconstruction accuracy on ultra-sparse scenes compared to existing radiance field methods.

0.15

Bayesian Joint Reconstruction and Uncertainty Quantification for Limited-Data Multi-Contrast X-Ray CT

eess.IV physics.optics ·2026-10-15 ·Hassan Yazdanian, Henrik Mäkinen
similarity 0.62
Abstract

Multi-contrast X-ray computed tomography (CT) combines attenuation contrast with phase and dark-field contrast, which are sensitive to refraction and ultra-small-angle scattering, respectively. Common implementations record several intensity measurements per projection angle by phase or mask stepping, which lengthens acquisition and, at a fixed exposure per measurement, raises the dose. Limited-data acquisition via sparse angular sampling or reduced stepping lowers these costs but makes the data less informative, calling for prior information and uncertainty quantification. We study joint Bayesian reconstruction of attenuation, phase, and dark-field images from separately retrieved sinograms. A joint total variation term in the prior couples edge locations across the images but not their values. Posterior sampling with the No-U-Turn Sampler complements maximum a posteriori estimates with pixel-wise uncertainty. We compare this joint prior with channel-wise total variation alone on synthetic and experimental Talbot-Lau interferometry data under full, sparse-angle, sparse-step, and combined acquisition (up to 24 times fewer exposures). Both maximum a posteriori reconstructions suppressed undersampling artifacts, with synthetic relative errors 1.6-11 times lower than those of filtered backprojection. The joint prior gave modest synthetic accuracy gains, a cleaner experimental dark-field background, 23-30 % lower mean dark-field posterior standard deviation, and 4-38% higher median effective sample size in experimental limited-data runs. In the synthetic study, posterior standard deviations matched or exceeded the errors in flat regions but underestimated them at boundaries, especially in phase. Experimental phase chains mixed slowly under angular undersampling. The formulation also applies to edge illumination with adapted forward and noise models.

0.20

Dual-Domain Sparse-View 4D CBCT Reconstruction with Spatial-Temporal Consistency Learning

cs.CV ·2026-10-13 ·Qi Lai, YuTong He
similarity 0.61
Abstract

Four-dimensional cone-beam computed tomography (4D CBCT) provides phase-resolved volumetric images for image-guided radiotherapy. Yet good reconstruction quality usually needs many projections. This increases scan time and radiation dose. We propose STCNet, a sparse-view 4D CBCT reconstruction framework that uses spatial-temporal consistency learning. STCNet reconstructs high-quality images from only 16 projections in each respiratory phase. STCNet integrates physics-driven positional encoding to enforce geometric consistency in the projection domain and introduces temporal encoding in latent space to capture respiratory motion dynamics across phases to capture dynamic respiratory motion across phases. A dual-domain collaborative strategy jointly optimizes both projection and image domains, enhancing structural fidelity and temporal coherence. We tested STCNet on the TCIA-LUNG dataset and a CIRS thorax phantom dataset. STCNet performed better than conventional methods and recent deep learning baselines in image quality, artifact reduction, and structural preservation. On TCIA-LUNG, STCNet reached PSNR values of 33.311, 32.695, and 32.658 dB at phases 2, 5, and 8. The corresponding SSIM values were 0.845, 0.823, and 0.825. On CIRS, STCNet achieved PSNR values up to 36.497 dB and SSIM values up to 0.877. These results support STCNet as a promising framework for low-dose, phase-resolved 4D CBCT reconstruction in image-guided radiotherapy.

0.12

UMPIRE-Net: Unrolled Magnitude-Phase Regularization Network for Accelerated MRI

eess.IV cs.CVeess.SPphysics.med-ph ·2026-08-14 ·Mahdi Saberi, Toygan Kiliç, Mehmet Akçakaya
code/data similarity 0.61
Abstract · IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net

0.59

Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling

cs.CV cs.GR ·2026-08-13 ·Kiseok Choi, Inchul Kim, Jaemin Cho, Hyeongjun Cho, Min H. Kim
published similarity 0.61
Abstract

Cone-beam computed tomography (CBCT) enables volumetric reconstruction from X-ray projections, but suffers from severe artifacts--especially beam hardening--when imaging materials with high attenuation such as metals. These artifacts arise from the polychromatic nature of X-rays and are not properly addressed by conventional monochromatic reconstruction algorithms. While recent neural representation-based methods offer improved reconstruction quality, they are computationally expensive and often impractical for deployment. We propose a novel physics-inspired, self-calibrating metal artifact reduction method that efficiently reconstructs 3D CBCT volumes while correcting beam hardening artifacts. Our method integrates a polychromatic X-ray projection model, material-dependent attenuation profiles, and system response modeling into a Gaussian Splatting framework. Unlike prior work, we eliminate the need for manual metal masks or strong prior assumptions, and we optimize both reconstruction parameters and X-ray spectral characteristics jointly during training. We further introduce a high-fidelity synthetic CBCT dataset generation pipeline validated on Monte-Carlo x-ray simulation toolbox and release new datasets with severe metal-induced artifacts to support the community. This is the first splat-based method for reducing beam hardening in CBCT. Extensive experiments on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art approaches in artifact suppression and reconstruction accuracy.

0.54

TomoTransformer: Towards a Foundation Model for CT Reconstruction

cs.CV cs.LG ·2026-09-29 ·AmirEhsan Khorashadizadeh, Benjamín Béjar
benchmark similarity 0.60
Abstract

Supervised deep learning has advanced sparse-view tomographic reconstruction. However, conventional models, which typically map filtered back-projection (FBP) images or sinograms to clean reconstructions, are brittle under distribution shifts. Because they require retraining whenever projection counts and angles, detector resolutions, or data distributions change, their deployment in real-world applications remains limited. To address this, we introduce TomoTransformer, a transformer-based architecture that treats each \textit{local} filtered projection as an individual token and predicts missing views via self-attention. Crucially, TomoTransformer operates in a \emph{back-projection space} that separates projections across spatial locations, making view interpolation geometrically well-posed and invariant to detector size. This design yields a single foundation model that can process any number of input projections, at arbitrary angular locations and detector dimensions, and query any number of target angles without retraining. Trained on a large-scale dataset spanning diverse medical CT anatomies and natural images, TomoTransformer generalizes effectively across anatomies, materials, and resolutions. Extensive evaluations on several benchmark sparse-view datasets show that TomoTransformer significantly outperforms concurrent multi-purpose models like ViewTrans and matches or exceeds strong protocol-specific baselines, while remaining fully agnostic to the number of input and target projections. Furthermore, the model demonstrates robust zero-shot generalization on real experimental nanoscale brain data collected from an X-ray synchrotron, showcasing its practical utility for real-world applications.

0.19

CG-GLORE: A Conjugate Gradient-Based Global-Local Regularization Network for Sparse-View CT Reconstruction

cs.CV cs.AI ·2026-08-15 ·Tran Xuan Hieu Le, Doanh C. Bui, Vu Trung Duong Le, Hoai Luan Pham, Khang Nguyen +3 more
published similarity 0.60
Abstract · Accepted for presentation at BMVC2026

Sparse-view computed tomography (CT) reduces radiation dose by acquiring fewer projection views, but the resulting inverse problem is highly ill-posed and often produces severe streak artifacts. Existing deep reconstruction methods have achieved promising performance, yet many rely on first-order updates or large regularization networks, which can be less effective in ill-conditioned settings. We propose \textbf{CG-GLORE}, a compact deep unrolling framework inspired by second-order optimization for sparse-view CT reconstruction. Each unrolled stage uses a CG-solved linear system based on a structured Hessian surrogate: it retains the physics-induced curvature of the data-fidelity term while using an identity approximation for the learned regularization term. Thus, the method is second-order-inspired rather than an exact Newton method for the full learned objective. To model image priors, we design a Global-Local Regularization Network (GLORE), which combines convolutional local feature extraction with a Long-Range Dependency Representation module based on sparse patchification and Nyström attention. This design captures anatomical details and non-local dependencies while maintaining practical complexity. Experiments on AAPM and DeepLesion under multiple sparse-view and noise settings show that CG-GLORE achieves strong quantitative performance, stable convergence, lower noise power, and improved visual fidelity compared with representative reconstruction methods.

0.27