CS Paper Radar

Semantic Reconstruction and 3-D Detection via Learned Multi-Pair Fusion in RF Imaging

Amir Rezaei, Wen-Xin Pan, Giuseppe Caire

cs.CV eess.SP ·submitted 2026-08-24 13:41 UTC · v1

Abstract

We consider a multistatic radio-frequency imaging problem with anisotropy, in which the reflection from a point depends on the positions of the transmit (Tx) and receive (Rx) arrays. The goal is to label the voxels of a field of view by a finite set of semantic classes and to group them into object instances. For the image formation of each Tx--Rx pair we apply a standard inverse-problem solver, and we feed the resulting per-pair reconstructions into a trained three-dimensional (3-D) U-Net that performs the fusion implicitly and the per-voxel classification explicitly. On a controlled, under-determined multistatic setup, we consider the following image formation methods: back-projection (BP) and the least absolute shrinkage and selection operator (LASSO) from a single deterministic snapshot, and incoherent BP and group-LASSO from multiple fading snapshots. For each imaging method we train a separate U-Net that fuses the six Tx--Rx pairs (its input channels) and assigns each voxel a probability vector over the classes. Taking the most probable class gives a labeled volume---the semantic reconstruction. Object instances and their oriented bounding boxes then follow by geometric post-processing (clustering and principal-component analysis). Across a wide range of signal-to-noise ratio, the semantic reconstruction (scored against ground truth by segmentation intersection-over-union) and the resulting 3-D detection degrade far more gracefully than the classical intensity reconstruction: the detection in particular stays reliable well into noise levels at which that reconstruction has dissolved. Because real scenes contain objects of classes the network was not trained on, we add an explicit unknown class trained by outlier exposure, which labels held-out novel objects as unknown instead of mislabeling them as a known class by reconstructed shape.

Closest papers

Nearest neighbours by meaning across the whole index.

Unrolled RF Holographic Imaging: Structured Sparsity and Low-Rank EM Model Adaptation

eess.SP ·2026-08-23 ·Federica Fieramosca, Alexander Paulus, Richard Oliveira, Stefano Savazzi
similarity 0.65
Abstract · submitted for possible publication to IEEE

Radio-Frequency (RF) holographic imaging reconstructs a volumetric map of the permittivity contrast from phase-coherent samples of the scattered electromagnetic (EM) field. The resulting inverse problem is severely ill-posed, as the receivers are orders of magnitude fewer than the unknown 3D volume elements (voxels). It is classically regularized by sparsity-promoting solvers such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Two assumptions limit these solvers: the L1 penalty is spatially uniform, and the EM forward model is typically approximated as a linear operator. This paper revisits the problem through algorithm unrolling, in which the solver iterations become the layers of a compact trainable network that preserves the EM forward model and learns only a few interpretable parameters from limited data. Building on the Learned ISTA (LISTA), a Weighted LISTA (W-LISTA) is first proposed, which learns a spatially-varying L1 regularization, steering the sparsity prior towards target shapes consistent with the deployment. Second, the Low-Rank Weighted LISTA (LoRaW-LISTA) applies a low-rank adaptation (LoRa) of the holographic operator to compensate for model mismatches from linearized EM approximations. Both methods are validated on full-wave EM simulations and on a 2.45GHz indoor measurement campaign with human-body phantoms. Combining the spatially-varying regularization with the low-rank adaptation of the EM model improves the signal-to-clutter ratio by about 70% over the ISTA and LISTA baselines, recovering structural details where classical iterative solvers fail. Inference takes less than 30s to reconstruct 1m^3 of scene on conventional GPUs. The proposed tools are rapidly adaptable building blocks for the sensing layer of emerging smart radio environments.

0.14

Physics-Guided Multi-Objective Deep Learning for Ultrasound RF Data Interpolation in Resource-Constrained Imaging

eess.IV cs.LG ·2026-09-23 ·Luoyuan Zhang, Yiyang You, Ananya Tandri, Yinan Feng, Hyunwoo Song +2 more
similarity 0.63
Abstract · Submitted to the Journal of Computational Design and Engineering

Ultrasound imaging increasingly targets portable, point-of-care, and wearable settings where constraints on power, bandwidth, and hardware complexity often necessitate sparse data acquisition in spatiotemporal scanning. However, image reconstruction using the sparse data can introduce insufficient phase information in coherent beamforming process, resulting in grating-lobe artifacts that degrade imaging contrast resolution. We present a physics-guided, data-driven framework for sparse-to-dense radio-frequency (RF) reconstruction that aligns training with downstream image formation. Our approach trains an end-to-end interpolation network using a hybrid supervision scheme that combines an RF-domain and a beamforming-domain loss with exponential moving average (EMA) to stabilize the multi-objective training. To improve generalization under variable acquisition layouts, we also introduce a random-skip masking strategy that varies sparsity patterns during training so a single model can handle diverse decimation factors and irregular channel configurations. We evaluate the framework on a held-out test set using the mean structural similarity index measure (SSIM) between reconstructed and ground-truth beamformed images. Across decimation factors $\times 2$ to $\times 13$, the best-performing configuration maintains mean SSIM around 0.95. Overall, the results show consistent gains in RF reconstruction and post-beamforming image quality across diverse acquisition conditions. This approach enables robust, high-quality ultrasound imaging at resource-constrained settings by allowing more sparse scanning in spatiotemporal domain.

0.18

STAIRS: Staging the Inverse Problem via Admissible-Support Scheduling for Unrolled MRI Reconstruction

cs.CV ·2026-11-06 ·Xiangjian Hou, Chang Ni, Chao Qin, Zhiwei Tan, Xin Wang +4 more
similarity 0.62
Abstract

Accelerated magnetic resonance imaging (MRI) forms images from incomplete Fourier measurements, shifting acquisition burden to computational reconstruction. Deep unrolled networks interleave learned regularization and data consistency, yet typically estimate the full unmeasured spectrum at every cascade. We propose STAIRS (Staging the Inverse Problem via Admissible-Support Scheduling), which projects intermediate reconstructions onto nested Fourier supports that expand to the full spectrum and conditions each update on its support transition. Conditional increments of a regularized log-determinant score of training covariance define a normalized spectral coordinate, accounting for dependencies between newly and previously admitted frequencies. Dyadic targets allocate larger coordinate increments to earlier cascades and are mapped to fixed supports before training, enabling coarse-to-fine reconstruction with unchanged sampling masks and data consistency. On fastMRI and Stanford2D, STAIRS improves matched Transformer (HUMUSNet) and convolutional (NAFNet) backbones in single- and multi-coil reconstruction, including radiologist-annotated pathology regions. It also outperforms predictor-based progression with lower parameter overhead and inference latency. Stage-wise analysis shows repeated error correction by projection and lower intermediate reconstruction errors than the backbones alone throughout support expansion. Ablations favor dyadic allocation over uniform expansion for square and line-band supports and over manual front-loading for square windows. Support projection alone improves reconstruction, and transition conditioning strengthens the gain. Cross-dataset evaluation shows improvements for both backbones in both directions. Support allocation thus complements regularizer design in unrolled MRI reconstruction.

0.22

DISTA-Net++: Rethinking Infrared Small Target Unmixing Beyond Sub-Pixel Separation

cs.CV ·2026-09-16 ·Mengze Xu, Zhu Liu, Weidong Sheng, Boyang Li, Yimian Dai +2 more
benchmarkpositioncode/data similarity 0.61
Abstract

Long-range infrared imaging frequently confronts dense target clusters whose diffraction-limited signatures merge into a single indistinguishable blob, concealing the number, sub-pixel positions, and radiant intensities of the underlying sources. While deep learning has advanced general object detection, resolving such Closely-Spaced Infrared Small Targets (CSIST) remains largely unexplored, owing to a systemic infrastructure void and a fundamental paradigm mismatch. The dominant formulation, which reduces unmixing to a blind, discrete sub-pixel separation, is inherently insufficient: without semantic guidance, the ill-posed inverse problem admits ambiguous solutions plagued by false and missed detections, while grid-based discretization locks predictions onto fixed lattice centers, chaining precision to prohibitively expensive grid refinement. We argue that CSIST unmixing should instead be informed and continuous. To ground this paradigm shift, we establish the first comprehensive open-source ecosystem for the field, comprising the large-scale CSIST-100K benchmark, a tailored metric suite, and the GrokCSO toolkit. Upon this foundation, we propose DISTA-Net++, which anchors a dynamic deep unfolding backbone with two synergistic mechanisms: a Count-Guided Prior that injects the global target count as an explicit semantic constraint to regularize the solution space, and a Continuous Coordinate Rectification that regresses off-grid offsets to decouple localization accuracy from grid resolution. Extensive experiments validate our paradigm: even under the most economical 3x division, DISTA-Net++ surpasses 7x-division state-of-the-art methods by 16.15% in CSO-mAP and 62.96% in count accuracy at merely one-sixth of their computation, demonstrating that unmixing precision need not be purchased with finer discretization. The complete ecosystem is available at https://github.com/GrokCV/GrokDet.

0.32

View optimization in Computed Tomography

eess.IV ·2026-11-02 ·Seemeen Karimi, Christopher McGuire
published similarity 0.60
Abstract · All figures are in the PDF. presented at a conference, conference proceedings pending

Many emerging CT imaging applications must operate with data from sparse projection angles, on the order of 10 views, such as first responder scenarios, dynamic imaging of detonation events, and flash imaging of materials under extreme conditions in high energy-density science. Few-view imaging is a data undersampling problem, that degrades tomographic reconstructions with streaks, shadows, and other aliasing artifacts, due to ill-conditioning. In few- view CT, the specific set of projection angles can strongly impact reconstruction quality, and the optimal angles depend on the object being scanned. Despite a surge of recent research, there is much to explore in this problem. We present an object-aware performance prediction framework for few-view projection datasets based on a matrix decomposition of the discretized forward model augmented with expected object gradient information. The method yields a quantitative score for a candidate set of view angles that can underpin a view selection recommendation algorithm. A key feature is that it can be applied at multiple stages of acquisition: a priori, before any radiographs are taken, or adaptively, after some radiographs are collected, to determine the next best view. We demonstrate the approach using simulated CT data with 5 view and 15 view configurations. Preliminary results are encouraging; images reconstructed using a standard statistical algorithm show that reconstruction accuracy agrees with our performance score. Reconstruction accuracy was evaluated against a known ground truth using an information theoretic score. Continued testing with complex objects and multiple geometries is necessary.

0.14

Uncovering the Invisible in Routine Radiology: Cross-Modal Detection of MRI-Verified Soft-Tissue Pathologies from CBCT via Physics-Guided 3D Self-Supervised Learning

eess.IV cs.CVcs.LG ·2026-11-17 ·Evgeny Alves Limarenko
similarity 0.60
Abstract

Routine X-ray modalities like cone-beam computed tomography (CBCT) are optimized for high-contrast mineralized tissues, leaving soft-tissue abnormalities buried beneath photon noise and below human visual perception. Thus, detecting non-calcified pathologies requires secondary magnetic resonance imaging (MRI). We demonstrate that sub-visual radiographic signatures of soft-tissue pathology are physically preserved within routine CBCT scans and can be extracted for opportunistic screening using a targeted, physics-guided deep learning pipeline, even under extreme paired-data scarcity. Using the temporomandibular joint (TMJ) as a model system (N = 212 paired CBCT-MRI joints), we address the severe overfitting of high-capacity 3D networks through a two-stage framework. First, we employ a frozen full-grid 3D masked autoencoder (BertsWin) pre-trained on 6,550 unlabeled CBCT volumes via the GradientConductor (GCond) optimizer and an anatomy-aware objective (PhysLoss) redirecting gradient flow into the [-300, 300] HU soft-tissue window. Second, automated localization of the condylar zenith drives a deterministic 3D cropping that eliminates 81% of background osseous variance. Evaluated via a patient-isolated 3x10-fold stratified cross-validation protocol, a statistically robust sub-visual signal for MRI-verified synovial effusion (ROC AUC = 0.793) emerges exclusively from representations pre-trained with the PhysLoss and GCond regime. Crucially, only this setup captures true 3D anatomical chirality (p < 0.001) and high intra-patient structural consistency (0.791) over inter-patient noise; conversely, identical architectures pre-trained with standard L2 loss or unmasked variance decomposition (MVC) collapse to random guessing. These findings establish a generalizable paradigm for repurposing routine, low-contrast radiographic scans into opportunistic screening tools for occult soft-tissue disease.

0.19

PhyDiCT: Plug-and-Play CT Reconstruction from Sparse X-Rays via Differentiable Rendering and Strong Priors

cs.CV ·2026-10-07 ·Weicheng Dai, Shantanu Ghosh, Kayhan Batmanghelich
top venuecode/data similarity 0.60
Abstract · Accepted at MICCAI 2026; to appear in LNCS 16888

Reconstructing 3D Computed Tomography (CT) images from a few X-ray projections is a highly ill-posed inverse problem due to the loss of volumetric information. We propose PhyDiCT, a training-free framework that integrates a differentiable Physics-based forward model, grounded in the Beer-Lambert law, with a text-conditioned Diffusion as a strong prior to reconstruct 3D lung CT images. We refer to our approach as training-free since the prior model is used without fine-tuning, and our goal is to steer the denoising procedure to generate samples consistent with X-ray observations. We guide the diffusion generation using Split Gibbs sampling to jointly optimize for projection fidelity (reward) and consistency with prior knowledge. Also, we introduce a test-time refinement step that enhances image realism and anatomical coherence. We extensively evaluate our method on publicly available 3D CT datasets using both perceptual and semantic metrics, demonstrating that it surpasses existing plug-and-play diffusion and fully trained reconstruction approaches. Our findings highlight that combining a strong generative prior with the underlying physics of image formation substantially improves reconstruction quality, e.g., 7.5\% improvement on SSIM compared to full training methods. Code will be released at https://github.com/batmanlab/PhyDiCT.

0.44

Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstruction

cs.CV ·2026-10-08 ·Mingyu Hu, Siquan Zhu, Xijun Zhong, Qiegen Liu
similarity 0.60
Abstract

Parallel magnetic resonance imaging reconstruction is an ill-posed inverse problem under undersampling. Multi-coil acquisition and Hankel lifting expose complementary repeated information: observations of the same anatomy across coils and repeated local k-space neighborhoods in overlapping windows. These dependencies guide recovery of missing k-space data. However, splitting lifted Hankel entries for self-supervision can place the original sample in both input and target, causing data leakage. We propose Hankel Subspace Self-Supervised Reconstruction (HSSRecon), a scan-specific reconstruction framework for parallel magnetic resonance imaging. HSSRecon partitions data by physical acquisition units before Hankel lifting and applies multiplicity normalization to repeated Hankel copies in overlapping windows. Rather than learning a mapping that directly predicts missing data, the network learns a compact complex-valued Hankel subspace operator. Reconstruction is performed over the original k-space variables using a conjugategradient solver with hard data consistency. This design separates structural learning in the Hankel domain from data consistency in the physical domain: the former exploits multi-coil and local Hankel correlations, while the latter solves over unacquired degrees of freedom. We provide theoretical analyses of physicalgroup splitting and multiplicity normalization, and establish positive definiteness, uniqueness, hard data consistency, and a finite-step conjugate-gradient error bound for the system. On fastMRI brain data with three contrasts and three sampling masks, HSSRecon achieves competitive peak signal-to-noise ratio, structural similarity, and normalized mean squared error across six aggregated conditions.

0.16