CS Paper Radar

Physics-Guided Multi-Objective Deep Learning for Ultrasound RF Data Interpolation in Resource-Constrained Imaging

Luoyuan Zhang, Yiyang You, Ananya Tandri, Yinan Feng, Hyunwoo Song, Jeeun Kang, Youzuo Lin

eess.IV cs.LG ·submitted 2026-09-23 20:37 UTC · v1

Abstract

Ultrasound imaging increasingly targets portable, point-of-care, and wearable settings where constraints on power, bandwidth, and hardware complexity often necessitate sparse data acquisition in spatiotemporal scanning. However, image reconstruction using the sparse data can introduce insufficient phase information in coherent beamforming process, resulting in grating-lobe artifacts that degrade imaging contrast resolution. We present a physics-guided, data-driven framework for sparse-to-dense radio-frequency (RF) reconstruction that aligns training with downstream image formation. Our approach trains an end-to-end interpolation network using a hybrid supervision scheme that combines an RF-domain and a beamforming-domain loss with exponential moving average (EMA) to stabilize the multi-objective training. To improve generalization under variable acquisition layouts, we also introduce a random-skip masking strategy that varies sparsity patterns during training so a single model can handle diverse decimation factors and irregular channel configurations. We evaluate the framework on a held-out test set using the mean structural similarity index measure (SSIM) between reconstructed and ground-truth beamformed images. Across decimation factors $\times 2$ to $\times 13$, the best-performing configuration maintains mean SSIM around 0.95. Overall, the results show consistent gains in RF reconstruction and post-beamforming image quality across diverse acquisition conditions. This approach enables robust, high-quality ultrasound imaging at resource-constrained settings by allowing more sparse scanning in spatiotemporal domain.

Comment
Submitted to the Journal of Computational Design and Engineering

Closest papers

Nearest neighbours by meaning across the whole index.

Physics-Grounded Objective-Conditioned Deep Beamforming for Adaptive Resolution-Contrast Control in Plane-Wave Ultrasound Imaging

eess.SP ·2026-10-05 ·Gopika Gopikrishnan, Mahesh Raveendranatha Panicker
similarity 0.72
Abstract

Plane-wave ultrasound enables ultrafast imaging but remains constrained by a receive-aperture-dependent resolution- contrast trade-off. Fine structures benefit from high spatial resolution, whereas diffuse tissue and lesions often require improved contrast and clutter suppression. These objectives favor different receive-aperture configurations, yet conventional beamformers operate at a fixed imaging point. We propose a physics-grounded, objective-conditioned deep beamformer that enables controllable image formation within a single network. From single-plane-wave channel data, the network predicts spatially varying receive-apodization weights, conditioned on the desired imaging objective through feature-wise linear modulation. The conditioning variable is explicitly tied to a physically defined receive-aperture configuration and supervised using the correspondingcoherent-plane-wave-compounding target. Differentiable, region-of-interest-aware, physics-guided quality losses further promote objective-specific resolution and contrast during end-to-end training. The model is trained exclusively on simulated channel data spanning diverse target morphologies and echogenicities, and evaluated zero-shot on the PICMUS and CUBDL datasets, including unseen probe geometries. The proposed framework generally improves upon single-plane-wave delay-and-sum reconstruction while providing objective-dependent control. On PICMUS, the proposed method improves gCNR by up to 16.8% and axial resolution by 22% compared with the reference beamforming method. Moreover, switching between the contrast- and resolution-oriented objectives enables controllable changes of up to 4.9% in lesion contrast and 11.4% in lateral resolution. Compared with the best-performing learning-based baselines, the proposed method reduces lateral full-width-at-half-maximum by 5.9% and improves generalized contrast-to-noise ratio by 6.6%.

0.29

CrossRAFT: Cross-Domain Complex-Valued Feature Extraction for Ultrasound Motion Estimation

eess.SP ·2026-09-08 ·Yang Leng, Yuchen Tang, Kai-Hang Yiu, Yik-Chung Wu, Wei-Ning Lee
similarity 0.66
Abstract

Accurate multi-dimensional motion estimation is fundamental to broad biomedical ultrasound applications, primarily performed using real-valued radio-frequency (RF), analytic, and in-phase and quadrature (IQ) signals. Real-valued RF and analytic signals offer high subsample accuracy but are computationally intensive. Regardless of the signal domain used, traditional algorithms suffer from interframe decorrelation, resolution tradeoffs, and a lack of a carrier and low sampling in the lateral direction. Emerging deep learning (DL) models demonstrate improved performance and faster inference. However, existing architectures are real-valued and disrupt inherent phase coupling crucial for accurate motion estimation by treating complex components as independent channels. To address this, we propose CrossRAFT, an end-to-end trainable network designed for subsample motion estimation directly from complex-valued ultrasound signals. Built on the RAFT architecture, CrossRAFT features complex-valued encoders and a custom correlation module to explicitly extract and use phase information. We evaluated CrossRAFT across real RF, analytic, and IQ signal presentations on simulated phantoms, synthetic echocardiographic, and private in vivo echocardiographic datasets. Experimental results show that CrossRAFT estimates displacements accurately under complex tissue motion and in the challenging lateral direction. Compared to real RF-based RAFT, analytic-based CrossRAFT reduces vertical and horizontal displacement errors by 69% and 51% on the synthetic echocardiographic data, respectively. These findings demonstrate that leveraging phase information via complex-valued neural networks provides a powerful framework for ultrasound motion estimation, showing potential for clinical elastography and functional imaging.

0.30

Diffusion Plug-in Priors for Self-Supervised Ultrasound Video Restoration

cs.CV ·2026-11-03 ·Chu Chen, Mingduo He, Yining Li, Yinhao Wu, Wei Tang +4 more
code/data similarity 0.65
Abstract

Ultrasound videos are limited by hardware-constrained spatial resolution and signal-dependent speckle, while paired low- and high-resolution acquisitions for supervised restoration are rarely available. We aim to jointly super-resolve and despeckle ultrasound videos without paired training data or network retraining. We propose UltraDiff, which uses a frozen pre-trained diffusion model (DM) as a plug-in prior and restores each frame by optimizing the latent seed of the DM sampler under a range-constrained maximum a posteriori formulation. We derive a speckle-aware data-fidelity term from a Rayleigh scale-family model and characterize its relative-residual and variance-adaptive weighting properties. We further introduce a stabilized fidelity that is bounded below and strictly convex in log intensity for positive observations in its unclamped form. A total-variation regularizer complements the DM prior, and a temporal seed update warm-starts each frame from the optimized seed of its predecessor. On EchoNet-LVH videos with simulated speckle and additive noise, UltraDiff with a natural-image prior improves PSNR by 1.24\,dB over the strongest baseline, and ultrasound-related priors improve it further. On real clinical echocardiography videos, UltraDiff reduces the mean absolute error of zero-shot ejection fraction (EF) prediction from 7.31 to 6.37 EF points relative to DUP, the strongest baseline. Combining a speckle-aware fidelity with frozen diffusion priors enables ground-truth-free ultrasound video restoration that benefits downstream measurement. UltraDiff needs neither paired data nor retraining and is not tied to a specific diffusion checkpoint. Code associated with this work will be made publicly available upon acceptance.

0.21

Zero-Shot Cross-Material Ptychographic Phase Reconstruction Using Deep Learning

cs.CV ·2026-09-12 ·Wen-Chun Lin, Kuan-Peng Chen, Nan-Yow Chen, Yu-Chee Tseng, Jen-Jee Chen
similarity 0.65
Abstract

Ptychographic phase reconstruction is commonly formulated as an iterative inverse problem, requiring repeated object-probe updates and resulting in substantial computational cost for large-scale 4D-STEM data. We present a direct local-to-global learning framework that reconstructs full-field phase maps from diffraction measurements without iterative refinement during inference. The proposed network predicts local wrapped-phase patches from individual diffraction patterns using a sine-cosine representation, and the predictions are assembled into a full-field reconstruction using calibrated scan positions and Gaussian-weighted stitching. To evaluate generalization beyond the training domain, the model is trained on one material and directly applied to another in a zero-shot setting without target-domain fine-tuning. Experiments on AuPd and MoS$_2$ demonstrate consistent cross-material transfer in both directions, with the proposed method achieving the best full-field MSE, PSNR, and MS-SSIM among the evaluated learning-based methods. Compared with the iterative ePIE approach, the proposed direct local-to-global pipeline reduces end-to-end reconstruction time by approximately 10$\times$, demonstrating its potential for efficient and transferable ptychographic reconstruction.

0.20

UMPIRE-Net: Unrolled Magnitude-Phase Regularization Network for Accelerated MRI

eess.IV cs.CVeess.SPphysics.med-ph ·2026-08-14 ·Mahdi Saberi, Toygan Kiliç, Mehmet Akçakaya
code/data similarity 0.65
Abstract · IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net

0.59

STAIRS: Staging the Inverse Problem via Admissible-Support Scheduling for Unrolled MRI Reconstruction

cs.CV ·2026-11-06 ·Xiangjian Hou, Chang Ni, Chao Qin, Zhiwei Tan, Xin Wang +4 more
similarity 0.65
Abstract

Accelerated magnetic resonance imaging (MRI) forms images from incomplete Fourier measurements, shifting acquisition burden to computational reconstruction. Deep unrolled networks interleave learned regularization and data consistency, yet typically estimate the full unmeasured spectrum at every cascade. We propose STAIRS (Staging the Inverse Problem via Admissible-Support Scheduling), which projects intermediate reconstructions onto nested Fourier supports that expand to the full spectrum and conditions each update on its support transition. Conditional increments of a regularized log-determinant score of training covariance define a normalized spectral coordinate, accounting for dependencies between newly and previously admitted frequencies. Dyadic targets allocate larger coordinate increments to earlier cascades and are mapped to fixed supports before training, enabling coarse-to-fine reconstruction with unchanged sampling masks and data consistency. On fastMRI and Stanford2D, STAIRS improves matched Transformer (HUMUSNet) and convolutional (NAFNet) backbones in single- and multi-coil reconstruction, including radiologist-annotated pathology regions. It also outperforms predictor-based progression with lower parameter overhead and inference latency. Stage-wise analysis shows repeated error correction by projection and lower intermediate reconstruction errors than the backbones alone throughout support expansion. Ablations favor dyadic allocation over uniform expansion for square and line-band supports and over manual front-loading for square windows. Support projection alone improves reconstruction, and transition conditioning strengthens the gain. Cross-dataset evaluation shows improvements for both backbones in both directions. Support allocation thus complements regularizer design in unrolled MRI reconstruction.

0.22

SONAR: A Structure-Consistent Neural Operator for Null-Space-Aware Sparse View CT Reconstruction

eess.IV cs.CV ·2026-09-12 ·Song Ni, Haijun Yu, Haodong Li, Changsheng Fang, Shuyi Fan +2 more
similarity 0.65
Abstract

Sparse-view computed tomography (CT) reduces radiation dose and acquisition time but remains severely ill-posed because incomplete projections poorly constrain null-space information. Existing learning-based methods often estimate this information in high-dimensional image space, conflate physical measurement errors with prediction errors, and depend on fixed discretizations. We propose SONAR, a Structure-Consistent Neural Operator for Null-Space-Aware Reconstruction. Instead of recovering the full null-space component, SONAR predicts a low-dimensional null-space-aware representation from the acquired projections as pseudo-measurements. It separates measurement and pseudo-measurement residuals, lifts them into the image domain through physics operators, and applies independent neural operators to constrain their structural effects, thereby accommodating admissible errors while suppressing unsupported structures. To support cross-discretization reconstruction, an anisotropic U-shaped neural operator models the periodic angular and nonperiodic detector dimensions using direction-dependent continuous supports, while image-domain neural operators re-discretize continuous kernels on target grids. These components form an optimization-inspired unrolled network. Experiments on simulated AAPM and clinical MARS photon-counting CT data demonstrate consistent improvements across seen and unseen view settings and unseen image resolutions. On AAPM dataset, SONAR improves PSNR by 1.87~dB at 62 views and by 7.63~dB under zero-shot transfer to a $512\times512$ grid over the strongest competing methods. SONAR also achieves the best overall performance in all clinical settings evaluated, demonstrating accurate, structurally reliable, and discretization-robust sparse-view CT reconstruction.

0.26

Unrolled RF Holographic Imaging: Structured Sparsity and Low-Rank EM Model Adaptation

eess.SP ·2026-08-23 ·Federica Fieramosca, Alexander Paulus, Richard Oliveira, Stefano Savazzi
similarity 0.64
Abstract · submitted for possible publication to IEEE

Radio-Frequency (RF) holographic imaging reconstructs a volumetric map of the permittivity contrast from phase-coherent samples of the scattered electromagnetic (EM) field. The resulting inverse problem is severely ill-posed, as the receivers are orders of magnitude fewer than the unknown 3D volume elements (voxels). It is classically regularized by sparsity-promoting solvers such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Two assumptions limit these solvers: the L1 penalty is spatially uniform, and the EM forward model is typically approximated as a linear operator. This paper revisits the problem through algorithm unrolling, in which the solver iterations become the layers of a compact trainable network that preserves the EM forward model and learns only a few interpretable parameters from limited data. Building on the Learned ISTA (LISTA), a Weighted LISTA (W-LISTA) is first proposed, which learns a spatially-varying L1 regularization, steering the sparsity prior towards target shapes consistent with the deployment. Second, the Low-Rank Weighted LISTA (LoRaW-LISTA) applies a low-rank adaptation (LoRa) of the holographic operator to compensate for model mismatches from linearized EM approximations. Both methods are validated on full-wave EM simulations and on a 2.45GHz indoor measurement campaign with human-body phantoms. Combining the spatially-varying regularization with the low-rank adaptation of the EM model improves the signal-to-clutter ratio by about 70% over the ISTA and LISTA baselines, recovering structural details where classical iterative solvers fail. Inference takes less than 30s to reconstruct 1m^3 of scene on conventional GPUs. The proposed tools are rapidly adaptable building blocks for the sensing layer of emerging smart radio environments.

0.14