CS Paper Radar

Self-Supervised Multibeam Sonar Restoration via Coherent Forward Modeling

Zixin Wang, James Hopgood, Mike Davies

eess.IV cs.CVeess.SP ·submitted 2026-10-22 16:09 UTC · v1

Abstract

Multibeam imaging sonar produces intensity images degraded by coherent speckle and system-induced blur, while clean reflectivity targets are rarely available. Existing despeckling methods often rely on simplified intensity-domain noise models, synthetic clean targets, or blind-spot self-supervision, and typically do not jointly model deblurring and speckle suppression. We propose a physics-consistent self-supervised framework for joint despeckling and deblurring of multibeam imaging sonar. A stochastic coherent image-formation model yields a conditional-mean forward operator that relates latent scene reflectivity to expected intensity through the squared magnitude of the system point spread function. We then use registered multi-frame sonar sequences to train without clean ground truth images, showing that, under an idealized inter-frame conditional-mean condition, the expected paired loss equals the corresponding forward-prediction loss up to a network-independent constant. To stabilize the ill-conditioned inverse problem, we further adapt robust equivariant imaging using stochastic coherent simulation and introduce a paired forward prediction error metric for ground-truth-free evaluation. Experiments on two real multibeam sonar datasets demonstrate a favourable balance between forward-prediction agreement, homogeneous-region speckle suppression, and preservation of visible structural boundaries compared with representative baselines.

Comment
16 pages, 8 figures, includes supplementary material

Closest papers

Nearest neighbours by meaning across the whole index.

Self-Supervised Deconvolution of In-Air Sonar Images Using Sensor Ego-Motion

eess.SP ·2026-10-07 ·Jan Steckel
similarity 0.65
Abstract

Broadband in-air sonar sensors with a sparse microphone array form images through delay-and-sum beamforming, which leaves high sidelobes and an angular resolution that degrades strongly towards the sides of the field of view. Deconvolving these images requires access to the point-spread function of the complete imaging chain, including the emitter spectrum and directivity and the array imperfections. In practice, these aspects are hard to calibrate for. In this letter, we propose a self-supervised method that learns a deconvolution network together with a physics-structured model of the point-spread function, requiring only the sonar data itself and the odometry of a moving robot on which the sensor is mounted. Using acoustic flow warping, the internal representation of the model is warped and subsequently rendered through the learned point-spread function. This is then compared to the measured images under a speckle likelihood in accordance with the statistical model of image formation. In simulation, the learned model recovers the unknown emitter directivity, and the deconvolved images reach a constant angular resolution of 5 to 6 degrees over the full field of view, against 12 to 30 degrees for delay-and-sum and 7 to 23 degrees for delay-multiply-and-sum with coherence factor. The method outperforms classical deconvolution with the nominal point-spread function, and even outperforms CLEAN with the true one.

0.48

Mask2Restore: Self-Supervised Ultrasound Despeckling via Inpainting

eess.IV cs.CV ·2026-09-26 ·Xuesong Li, Yingtai Xu, Zhongliang Jiang, Nassir Navab, Yuan Bi
similarity 0.64
Abstract

Medical ultrasound (US) is inherently degraded by speckle, a granular interference pattern that is often treated as a complex form of noise in image restoration. However, unlike random noise, US speckle originates from coherent scattering within tissue and is therefore highly spatially dependent and deterministic under fixed acquisition conditions, making US speckle suppression fundamentally different from natural image denoising. Because speckle-free US targets are unavailable in practice, self-supervised denoising is necessary. Blind-spot networks (BSN) are the dominant self-supervised paradigm for natural images, but their pixel-wise masking strategy assumes spatially independent noise, an assumption poorly matched to US speckle, which is spatially correlated over multiple pixels rather than pixel-wise independent. To address this mismatch, we propose Mask2Restore, a self-supervised US despeckling framework that reformulates despeckling as contextual inpainting with block-wise masking on single noisy images. Unlike pixel-wise BSN masking, block-wise masking addresses this multi-pixel speckle correlation by removing locally correlated speckle neighborhoods and shifting the reconstruction cues used by the network from adjacent speckle correlations to broader anatomical context. We further introduce cross-resolution context regularization (CRCR), which suppresses residual speckle bias by enforcing consistency across multi-resolution predictions. Experiments on simulated and in vivo carotid US, unseen fine-structure cases, and downstream cardiac segmentation demonstrate improved speckle-detail trade-offs, better preservation of fine anatomical structures, and practical value for subsequent image analysis.

0.20

Diffusion Plug-in Priors for Self-Supervised Ultrasound Video Restoration

cs.CV ·2026-11-03 ·Chu Chen, Mingduo He, Yining Li, Yinhao Wu, Wei Tang +4 more
code/data similarity 0.62
Abstract

Ultrasound videos are limited by hardware-constrained spatial resolution and signal-dependent speckle, while paired low- and high-resolution acquisitions for supervised restoration are rarely available. We aim to jointly super-resolve and despeckle ultrasound videos without paired training data or network retraining. We propose UltraDiff, which uses a frozen pre-trained diffusion model (DM) as a plug-in prior and restores each frame by optimizing the latent seed of the DM sampler under a range-constrained maximum a posteriori formulation. We derive a speckle-aware data-fidelity term from a Rayleigh scale-family model and characterize its relative-residual and variance-adaptive weighting properties. We further introduce a stabilized fidelity that is bounded below and strictly convex in log intensity for positive observations in its unclamped form. A total-variation regularizer complements the DM prior, and a temporal seed update warm-starts each frame from the optimized seed of its predecessor. On EchoNet-LVH videos with simulated speckle and additive noise, UltraDiff with a natural-image prior improves PSNR by 1.24\,dB over the strongest baseline, and ultrasound-related priors improve it further. On real clinical echocardiography videos, UltraDiff reduces the mean absolute error of zero-shot ejection fraction (EF) prediction from 7.31 to 6.37 EF points relative to DUP, the strongest baseline. Combining a speckle-aware fidelity with frozen diffusion priors enables ground-truth-free ultrasound video restoration that benefits downstream measurement. UltraDiff needs neither paired data nor retraining and is not tied to a specific diffusion checkpoint. Code associated with this work will be made publicly available upon acceptance.

0.21

One Model, Two Worlds: Bidirectional Sonar-Optical Translation

cs.CV ·2026-09-05 ·Shengji Jin, Trung Tien Dong, Ahmed Lamidi, Chen Chen, Xiaomin Lin +1 more
position similarity 0.60
Abstract · 10 pages, 5 figures, 3 tables

Translating between imaging sonar and optical cameras is valuable for underwater perception, but supporting both directions with separate models duplicates storage and computation. A unified bidirectional model is therefore attractive, yet existing approaches largely treat the two directions symmetrically despite their fundamentally different image-formation physics. We argue that sharing a generative model does not require sharing the physics. We introduce the Direction-Asymmetric Realism Bridge (DARB), which retains a shared diffusion-bridge trunk while routing direction-specific physical priors through asymmetric pathways: range-aware modulation for sonar-to-optical translation and polar ray-dependent processing for optical-to-sonar translation. We further show that symmetry in training is also costly: applying a common realism schedule reduces sonar-to-optical PSNR by 2.60 dB. Our Adaptive Realism Supervision (ARS) instead determines when, where, and how strongly perceptual supervision is applied from reconstruction quality and gradient balance. Together, DARB and ARS enable one bidirectional model to match the sonar-to-optical specialist within 0.11 dB PSNR, outperform the optical-to-sonar specialist by 0.70 FID, and surpass two independently trained BBDMs on seven of eight metrics.

0.18

Physics-Grounded Objective-Conditioned Deep Beamforming for Adaptive Resolution-Contrast Control in Plane-Wave Ultrasound Imaging

eess.SP ·2026-10-05 ·Gopika Gopikrishnan, Mahesh Raveendranatha Panicker
similarity 0.60
Abstract

Plane-wave ultrasound enables ultrafast imaging but remains constrained by a receive-aperture-dependent resolution- contrast trade-off. Fine structures benefit from high spatial resolution, whereas diffuse tissue and lesions often require improved contrast and clutter suppression. These objectives favor different receive-aperture configurations, yet conventional beamformers operate at a fixed imaging point. We propose a physics-grounded, objective-conditioned deep beamformer that enables controllable image formation within a single network. From single-plane-wave channel data, the network predicts spatially varying receive-apodization weights, conditioned on the desired imaging objective through feature-wise linear modulation. The conditioning variable is explicitly tied to a physically defined receive-aperture configuration and supervised using the correspondingcoherent-plane-wave-compounding target. Differentiable, region-of-interest-aware, physics-guided quality losses further promote objective-specific resolution and contrast during end-to-end training. The model is trained exclusively on simulated channel data spanning diverse target morphologies and echogenicities, and evaluated zero-shot on the PICMUS and CUBDL datasets, including unseen probe geometries. The proposed framework generally improves upon single-plane-wave delay-and-sum reconstruction while providing objective-dependent control. On PICMUS, the proposed method improves gCNR by up to 16.8% and axial resolution by 22% compared with the reference beamforming method. Moreover, switching between the contrast- and resolution-oriented objectives enables controllable changes of up to 4.9% in lesion contrast and 11.4% in lateral resolution. Compared with the best-performing learning-based baselines, the proposed method reduces lateral full-width-at-half-maximum by 5.9% and improves generalized contrast-to-noise ratio by 6.6%.

0.29

Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems

eess.IV cs.CV ·2026-08-20 ·Laura C. Diaz-Delgado, Emmanuel Martinez, Henry Arguello
top venue similarity 0.59
Abstract

Self-supervised learning for imaging inverse problems is increasingly important in photon-limited settings, where acquiring clean ground truth is impractical and reconstruction must remain stable under dataset and acquisition shifts. This challenge is amplified under Poisson noise, whose signal-dependent statistics interact with sampling operators (e.g., CFA mosaicing). Meanwhile, foundation vision encoders trained at web scale offer distortion-invariant, content-related representations that generalize well across domains, suggesting a promising route to build priors that transfer beyond the training distribution without expensive fine-tuning. This paper proposes an ADMM-inspired unrolled plug-and-play solver for Poisson inverse problems that decouples a closed-form data-consistency update from a parameter-efficient prior. The prior is implemented as a lightweight decoder operating on frozen CLIP RN50 dense multi-scale features, adapting foundation representations with less trainable parameters. For self-supervision, the method integrates GR2R measurement-domain re-corruption with an Equivariant Imaging regularizer via virtual acquisitions. Experiments on Poisson CFA demosaicing and deblurring show competitive quality, improved robustness under shifts, and self-supervised performance approaching supervised training.

0.55

BenthicDINO: Physics-Informed Self-Distillation for View-Invariant Side-Scan Sonar Representations

cs.CV cs.AIcs.LG ·2026-08-24 ·Taqi Hamoda, Hayat Rajani, Nuno Gracias
benchmarkhot direction similarity 0.59
Abstract

Automated interpretation of side-scan sonar (SSS) imagery is traditionally hindered by view-dependence, as recorded intensities inextricably conflate intrinsic seabed reflectivity with transient acquisition geometries and acoustic artifacts. To address this, we introduce BenthicDINO, a physics-informed self-supervised learning framework that decouples acquisition dynamics from seabed representations. Utilizing a ConvNeXt-v2 backbone, physics-guided augmentations, and an HSIC penalty, BenthicDINO explicitly enforces feature invariance to physical viewing parameters like slant range and incidence angle. Evaluations demonstrate exceptional data efficiency - achieving near-peak performance in benthic habitat mapping with only 10% of available labels - and strong cross-domain generalization, outperforming fully supervised baselines on the AI4Shipwrecks benchmark using frozen representations.

0.55

Robust Cross-Modal Foundation Model Perception for Underwater Robots under Degraded Visual Conditions

cs.CV cs.AI ·2026-08-20 ·Mohammad Arif Ul Alam
benchmark similarity 0.59
Abstract

Reliable underwater robotic perception remains difficult because optical imagery degrades under turbidity, wavelength-dependent attenuation, low illumination, scattering, and blur. Although sonar provides complementary information that is less affected by optical visibility, prior visual-sonar research has largely focused on feature alignment and nominal detection performance. We investigate cross-modal robustness as visual reliability deteriorates and assess whether pretrained visual foundation-model representations can be complemented by sonar under severe degradation. We use frozen DINOv2 as the visual encoder and construct a controlled five-level benchmark ranging from clean to extreme visual conditions. We compare conventional visual detection, frozen foundation-model representations, sonar context, fixed multimodal fusion, clean-trained adaptive gating, and degradation-aware gated fusion. Our method trains the fusion mechanism across the full range of degradation while keeping the visual and sonar encoders frozen, allowing modality contributions to adapt without fine-tuning the pretrained backbone. Under extreme combined degradation, the DINOv2 baseline achieves 0.4610 balanced accuracy, while degradation-aware visual-sonar fusion reaches 0.6152, a 33.5% relative improvement. The learned sonar contribution increases from 14.2% under clean conditions to 41.3% under extreme degradation, demonstrating adaptive redistribution of cross-modal reliance. Fusion provides the largest gains under severe turbidity and blur, whereas color attenuation alone yields little additional benefit. These results show that foundation-model representations remain valuable but insufficient under severe information loss, and that explicitly adapting fusion to modality reliability can improve robust underwater multimodal perception.

0.39