CS Paper Radar

ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolution

Byoungwoo Kim, Munchurl Kim

cs.CV ·submitted 2026-09-02 09:50 UTC · v1
top venuebenchmark

Abstract

High-resolution Synthetic Aperture Radar (SAR) imagery is critical for precision analysis such as automatic target recognition, yet its acquisition is costly. Although generative image super-resolution (ISR) models offer a promising alternative, current smooth-approximation based diffusion frameworks often struggle to preserve the coherent scattering statistics, causing stochastic structural distortions that are less consistent with real SAR physics. To address this, we propose Semantic Prototype-Guided Super-Resolution (ProSR), reformulating SAR ISR as a semantically-guided discrete token prediction task within a quantized latent space. By mapping signal features to discrete scattering primitives, ProSR preserves the impulsive nature of SAR without over-smoothing. Furthermore, we integrate a Self-Supervised Learning backbone into SAR ISR to extract label-free semantic priors, overcoming label scarcity. Guided by these priors, we introduce Semantic-Aligned Detail Encoding to decouple high-frequency signals into discrete scattering primitives. In parallel, the Semantic Prototype Map Generator explicitly constructs semantic prototype maps, allowing Prototype-Map-Guided Attention to route the information flows within identical categories and mitigate inter-class interference. To validate our approach, we present a large-scale 0.25m resolution benchmark from the Umbra Open Dataset. Experimental results show ProSR achieves superior visual quality while preserving essential scattering characteristics required for practical SAR applications.

Comment
Accepted to ECCV 2026

Closest papers

Nearest neighbours by meaning across the whole index.

SARVIA: Fast-Adapting the Strong SAR Foundation Models That Are Already in Your MLLMs

cs.CV ·2026-11-17 ·Yuxuan Li, Zichen Tian, Qianru Sun
code/data similarity 0.69
Abstract

Synthetic aperture radar (SAR) foundation models provide transferable representations for diverse perception tasks in all-weather Earth observation. However, their development often relies on costly large-scale SAR pretraining, raising the question of whether such extensive domain-specific pretraining is necessary. We find that modern multimodal large language models (MLLMs) already provide visual encoders that can outperform dedicated SAR foundation models as downstream initializations. This motivates a new paradigm: reuse general visual capabilities and devote domain training to brief specialization. We therefore introduce SARVIA, an adaptive post-pretraining method that specializes modern MLLMs using self-supervised visual questions with computable answers. These questions are constructed from unlabeled observations through general image tasks that capture spatial relations and SAR-specific tasks that exploit native measurements and SAR--optical correspondence. A shared answer-prediction objective jointly trains low-rank adapters across visual and language components, with loss-driven task sampling. We then export the adapted visual encoder as a standalone backbone. With 600 adaptation steps and 2 GPU-hours, SARVIA outperforms the compared foundation models on all six SAR detection and segmentation benchmarks. Compared with dedicated SAR pretraining, SARVIA reduces domain-training costs by orders of magnitude while improving visual transfer across architectures and scales. This new paradigm shifts the emphasis from repeated, costly pretraining to a reusable specialization process that can benefit from advances in open MLLMs. Dataset and code: https://github.com/zcablii/SARVIA.

0.39

XuanJian-DINOSAR: A SAR Foundation Model Based on Global and Local Semantic Consistency

cs.CV ·2026-11-04 ·Chunxiao Wu, Huixin Huang, Jialei Pan, Qiang Liang, Tao Wu +7 more
hot direction similarity 0.68
Abstract

Self-supervised pre-training on synthetic aperture radar (SAR) imagery enables transferable representations, but the optical-SAR domain gap and speckle perturbations limit representation stability. Most SAR foundation models use masked image modeling (MIM) through pixel reconstruction or structural feature prediction, which is sensitive to speckle or relies on predefined operators. Joint modeling of cross-view semantics and perturbation stability at corresponding spatial locations remains underexplored. We propose XuanJian-DINOSAR, a SAR foundation model based on global and local semantic consistency. We curate over 360K publicly available SAR target chips, detection images, and scene images spanning diverse targets, scenes, and sensors, and adapt an optically pre-trained DINOv2 model to SAR through self-supervised learning. The framework combines DINO global semantic self-distillation, iBOT local masked modeling, and KoLeo feature-distribution regularization to learn globally discriminative and locally structure-aware representations. We introduce a local semantic consistency branch tailored to SAR intensity statistics and coherent imaging characteristics. Shared geometric transformations produce spatially aligned teacher weak views and student strong views. Intensity transformations and Gamma multiplicative speckle perturbations are applied to student views, while a cosine consistency loss aligns patch tokens at corresponding locations, promoting stability under radiometric perturbations. This objective complements the cross-region and cross-scale semantic consistency of DINOv2 multi-crop training, jointly enforcing global and local semantic consistency. Experiments on multiple downstream classification and detection datasets demonstrate state-of-the-art performance on most evaluation metrics, validating the generality and transferability of the learned representations.

0.24

Super-Resolution of Range-Doppler Maps: A Case Study with Chirp-Sequence Radar and Transformer

eess.SP ·2026-08-27 ·Sven Hinderer, Jonathan Riese, Zheming Yin, Bin Yang
similarity 0.65
Abstract

Range-Doppler (rD) maps produced by chirp- sequence (CS) radar systems are fundamentally limited in reso- lution by bandwidth, carrier frequency, and coherent processing interval constraints. Improving resolution through hardware is often impractical due to regulatory, cost, and real-time operation requirements. In this work, we investigate deep learning-based super- resolution of rD maps in both range and Doppler using a real- world dataset collected with an Infineon millimeter-wave CS radar. We propose a memory-efficient transformer architecture based on dual-path shifted window (DPSWIN) attention, which combines axial/dual-path attention with 1D shifted window (SWIN) attention for scalable processing of high-dimensional radar data. Our model is benchmarked against existing 2D SWIN attention-based super-resolution models, which we adapt to the rD-map super-resolution task. We prioritize reconstruction fidelity over perceptual quality and employ root mean squared error (RMSE)-based training objectives. We avoid adversarial or perceptual losses that may introduce visually plausible but physically incorrect structures. In addition, we incorporate CFAR-based target-detection losses to optimize downstream target detectability in the super-resolved rD maps. We further study the impact of signal processing and training design choices on the super-resolution, including magnitude compression, spatial upsampling strategies, and loss formulations. Experimental results demonstrate that the proposed framework achieves computationally efficient rD map super-resolution on previously unseen real-world environments.

0.24

Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation

cs.CV ·2026-09-04 ·Siyuan Liu, Xuze Zhang, Yongshun Wang, Licong Pan, Hang Liu +1 more
code/data similarity 0.65
Abstract

Synthetic Aperture Radar (SAR) images have all-weather, day-and-night observation capabilities. However, compared with optical images, their speckle noise and non-intuitive scattering mechanism limit the interpretability of the images. Generative models for SAR-to-optical (S2O) conversion can improve visual interpretability, but existing methods often ignore the constraints on semantic structure, which are necessary for downstream tasks, for the sake of visual effects. We propose a unified collaborative dual-task learning framework, termed BMT (Bridging Modalities and Tasks), that jointly optimizes S2O image translation and semantic segmentation through a shared hierarchical Vision Transformer. The framework integrates: (1) a LocalViTBlock that fuses global self-attention with spatial depthwise convolution through a learnable gating mechanism; (2) an enhanced output module combining multi-scale refinement processing, color correction and anti-aliasing, which calibrates channel-level color statistics through feature fusion; (3) a ControlNet-style conditional injection mechanism that encodes SAR wavelet features and segmentation labels into a multi-scale feature pyramid and injects them at each encoder layer through zero-initialized convolution; (4) a bounded Kendall uncertainty weighting scheme that prevents either task from dominating the shared representation. We evaluate the framework under both paired and unpaired translation settings, on the public WHU-OPT-SAR paired dataset and a self-constructed unpaired ship dataset built from HRSID and DIOR, respectively. The experimental results show that the proposed method achieves competitive S2O translation quality and semantic segmentation performance. The dataset and source code have been publicly released at https://github.com/Lewisyuaner/BMT-S2O-main.

0.28

SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models

cs.CV ·2026-10-07 ·Jeonghyeok Do, Munchurl Kim
code/data similarity 0.65
Abstract · Please visit our project page at https://kaist-viclab.github.io/SAREO-FM_site/

Synthetic aperture radar (SAR) and electro-optical (EO) imagery provide complementary observations: SAR enables day-and-night, weather-resilient sensing, whereas EO provides rich appearance and fine-grained semantic cues. We introduce SAREO-FM, which avoids forcing a single token stream to serve two distinct roles: modality tokens preserve how each sensor observes the scene through masked reconstruction, while learnable semantic queries capture what the scene contains under guidance from a pretrained vision foundation model (VFM). By jointly encoding these queries with SAR and EO tokens, the queries acquire modality-grounded semantic context, while the modality-token outputs remain the explicit targets of masked reconstruction. This design assigns semantic and reconstruction supervision to separate token streams while preserving their interaction within the shared encoder. Pretrained on the million-scale SAR-1M corpus, SAREO-FM achieves strong unimodal transfer for both SAR-only and EO-only inputs, while delivering substantial gains from joint SAR--EO observations on tasks that benefit from complementary sensing.

0.22

Diffusion Meets Unrolling: Compressive SAR Image Reconstruction with Interleaved Learned Corrections

eess.IV ·2026-10-05 ·Odysseas Pappas, Andrew C. M. Austin, Perla Mayo, Mohammad Golbabaee, Alin Achim
similarity 0.63
Abstract

Compressive Synthetic Aperture Radar (SAR) imaging, typically formulated as an inverse problem and solved with traditional iterative optimisation methods, can be very computationally expensive. We investigate the use of denoising diffusion probabilistic models (DDPMs) for compressive SAR image reconstruction, where the diffusion model is guided by a poor initial reconstruction from sub-sampled data obtained via standard imaging methods. We augment this data-driven method with model-driven interleaved refinement processes, inspired by traditional compressed sensing (CS) methods, to enhance sparsity and heavy tails in SAR images. Experimental results on real ERS-1 SAR datasets demonstrate consistent improvements over baseline DDPM and state-of-the-art methods, with notable gains in reconstruction fidelity and structural similarity, while incurring only modest computational overhead. The proposed hybrid framework effectively combines the representational power and efficiency of diffusion models with the interpretability and robustness of model-based optimisation, enabling accurate compressive SAR imaging.

0.30

UAV SAR Imaging via Diffusion Posterior Sampling under Non-Ideal Motion in ISAC Systems

eess.SP cs.IT ·2026-10-10 ·Keying Zhu, Le Liang, Jie Yang, Fan Liu, Shi Jin
similarity 0.63
Abstract

Unmanned aerial vehicle-enabled synthetic aperture radar (SAR) offers significant potential for providing communication services to ground users while sensing the surrounding environment in low-altitude integrated sensing and communication (ISAC) systems. However, its practical deployment is challenged by known non-ULM trajectories and unknown position errors, which violate conventional SAR assumptions and cause severe image defocusing. We address these non-ideal impacts by formulating the ISAC SAR imaging as an exact linear inverse problem to accurately model arbitrary trajectories with multiple-input multiple-output orthogonal frequency division multiplexing waveforms. Based on this formulation, we develop a diffusion posterior sampling (DPS)-based super-resolution SAR framework, where a pre-trained diffusion model provides a data-driven image prior and the exact physical model enforces measurement consistency during posterior inference. The inference process is further accelerated for practical implementation. For unknown position errors, we develop a joint iterative DPS and motion compensation (MoCo) optimization algorithm with discrete cosine transform reparameterization and coarse-to-fine spectral scheduling. Simulations demonstrate that our framework achieves high-accuracy reconstruction across diverse trajectories and remarkable super-resolution, maintaining greater than 21.3 dB peak signal-to-noise ratio (PSNR) even under half physical resolution truncation. Under unknown motion errors, the joint DPS and MoCo algorithm achieves 23.65 dB PSNR with a residual position-error estimation error of 0.19 cm.

0.25

SPIRIT: Sparse Physics-Informed Inverse Rendering for SAR Imaging

cs.CV cs.AI ·2026-10-01 ·Yimeng Liu, Maolin Gan, Jingkai Lin, Jialuo Du, Mi Zhang +1 more
similarity 0.62
Abstract

Radio-frequency (RF) and wave-based imaging systems play a critical role in sensing under adverse conditions, but are fundamentally constrained by a trade-off between collection speed and spatial resolution. Reducing measurements to enable rapid collection of fragment geometric information across sensing dimensions, leading to highly non-injective inverse problems that destabilize conventional image-domain reconstruction and super-resolution methods. Synthetic aperture radar (SAR) exemplifies this challenge in sparse-aperture sampling. We introduce SPIRIT, a physics-informed inverse rendering framework for sparse-aperture SAR. Rather than enhancing formed images, SPIRIT reconstructs an explicit three-dimensional surface. By adopting an optimization strategy and explicitly modeling visibility, phase coherence, and wave propagation, SPIRIT aggregates distributed geometric features across sparse aperture views into a coherent reconstruction. Extensive experiments on synthetic and real-world data demonstrate that SPIRIT recovers accurate geometry and signal under extreme sparsity, reducing data collection by over 90% while achieving low geometric and signal error and consistently outperforming baselines.

0.17