CS Paper Radar

Stacked Intelligent Metasurface-Diffractive Deep Neural Networks for Onboard Terrain Classification from SAR Level-0 Raw Data

Mengbing Liu, Xin Li, Jiancheng An, Chau Yuen

eess.SP ·submitted 2026-09-28 05:10 UTC · v1
top venue

Abstract

Real-time terrain classification directly from Level-0 raw Synthetic Aperture Radar (SAR) data remains restricted by traditional digital-centric paradigms, where the processing of noisy, high-dimensional patches is hindered by computationally intensive processors and significant downlink latency. To address these fundamental limitations, this work establishes a new research paradigm for autonomous on-board sensing by proposing a Stacked Intelligent Metasurface-Diffractive Deep Neural Network (SIM-D$^2$NN). This architecture leverages the physical wave-propagation medium to offload inference tasks from digital processors to a physical device. By executing in-wave feature mapping, the SIM-D$^2$NN facilitates a move toward an integrated `compute-while-transmitting' framework, providing an alternative to the traditional `digitize-then-process' sequence. The multi-layer metasurface is positioned at the forefront of the satellite communication module. The initial layer modulates the raw SAR data through both amplitude and phase adjustments, where a 90$^\circ$ phase rotation is introduced as a lightweight but effective augmentation strategy to enhance robustness against noise and Doppler distortions. Subsequent layers learn variable phase shifts, enabling advanced feature mapping for the classification task. The classification results at the terrestrial station can be directly obtained based on the signal amplitude received at each antenna. This design reduces reliance on downlink bandwidth and high-power terrestrial computing, achieving performance around 90% in the binary task directly from real raw SAR data in terms of accuracy, precision, recall, and F1 Score. Therefore, our method helps bridge the gap between next-generation remote sensing tasks and in-orbit processing needs, paving the way for computationally efficient remote sensing applications.

Comment
Accepted by IEEE Transactions on Signal Processing

Closest papers

Nearest neighbours by meaning across the whole index.

Goal-Oriented Wave Computing for Direction-of-Arrival Estimation

eess.SP physics.app-ph ·2026-10-05 ·Mert Kalfa
benchmark similarity 0.59
Abstract · 9 pages, 2 figures, 4 tables

Programmable metasurfaces---arrays of elements whose electromagnetic response can be tuned electronically---can process signals as a wave propagates through or reflects off them, a paradigm known as wave-domain analog computing. The design strategy is typically indirect: the surface is fitted to a prescribed linear operator, such as a discrete Fourier transform, and the result is read from output power measurements. Using direction-of-arrival (DoA) estimation as a canonical benchmark, we study what this indirection costs across analog computing topologies, namely reflective reconfigurable intelligent surfaces (RIS), beyond-diagonal RIS (BD-RIS), and stacked intelligent metasurfaces (SIM). We first derive Cramér--Rao bounds for the complete physical estimation chain, including one that accounts for output detectors measuring only intensity. We then formulate a goal-oriented alternative where the surfaces are trained directly through the deployed readout, with no operator target. We observe that goal-oriented training lets sparsely connected or shallower surfaces reach the task performance of their more complex operator-fitted counterparts---despite nearly identical Fisher information---and that the advantage persists under coarsely quantized (1--3 bit) control. From 16 to 64 elements, the depth saving persists, while the connectivity a beyond-diagonal RIS needs grows with the aperture. Under tuner and per-layer loss, the goal-oriented designs keep their advantage.

0.25

Polarization Aware Deep Learning Framework for SAR Despeckling

eess.IV cs.CV ·2026-11-06 ·Gianpaolo Passarello, Sergio Vitale, Hossein Aghababei, Giampaolo Ferraioli, Vito Pascazio
similarity 0.59
Abstract

Speckle is an inherent characteristic of synthetic aperture radar (SAR) imagery that complicates image interpretation and the extraction of reliable information. Although deep-learning-based despeckling methods have demonstrated promising performance, their applicability across different polarimetric configurations is often limited by the need for specialized architectures or separate training procedures. This paper presents a unified deep-learning framework for despeckling single-, dual-, and full-polarization SAR data using a single trained convolutional neural network. The proposed approach adopts a common nine-channel representation of the polarimetric covariance matrix and a polarization-aware masking strategy to accommodate different configurations without modifying the network architecture. Qualitative and quantitative comparison on three different scenes from different sensors demonstrate competitive performance across the considered experiments and support the feasibility of a unified, polarization-flexible approach to SAR despeckling across different polarimetric configurations.

0.28

Hardware-Aware Deployment of Joint SAR Compression and Despeckling on FPGA

eess.IV cs.LG ·2026-08-11 ·Cédric Léonard, Francescopaolo Sica, Martin Schulz
code/data similarity 0.57
Abstract · Submitted to IEEE Transactions on Geoscience and Remote Sensing (TGRS). 11 pages, 8 figures, 4 tables

Next-generation Synthetic Aperture Radar (SAR) missions will generate data far faster than they can downlink, making onboard data reduction essential for near-real-time Earth observation. Learned Image Compression (LIC) offers better rate-distortion performance than handcrafted codecs used operationally today, and recent work shows that simultaneously despeckling and compressing SAR imagery enables better representation capacity while unlocking higher compression rates. These methods, however, have yet to be confronted with the strict power, compute, and operational constraints of spaceborne systems. In this work, we bridge this gap by deploying a joint SAR Despeckling and Data Compression (DDC) framework on an embedded ZCU102 FPGA-based platform, introducing model adaptations that respect the accelerator's fixed-point arithmetic and limited set of supported operations. We evaluate four model topologies across precision levels and across CPU, GPU, and FPGA platforms, revealing several findings with direct design implications. We find that replacing conventional GDN activation functions with plain ReLU improves quality on SAR, suggesting that design principles established for compression of natural images do not necessarily transfer to SAR imagery. In addition, we demonstrate that residual blocks offer little representational benefit for ten times the compute, and show that the FPGA is the most energy-efficient of the platforms tested. Together, these results set a functioning edge deployment workflow and an evidence-based starting point for onboard SAR compression. The code is available at https://github.com/CedricLeon/SAR_DDC_FPGA.

0.32

Wave-Domain Semantic ISAC: Holographic Surfaces as Analog Semantic Encoders for Integrated TN-NTN

cs.LO ·2026-11-10 ·Shadi Danesh, Pooria Salami, Hesaam Zaravashan, Abdulkadir Köse, Ayhan Akbas +2 more
published similarity 0.56
Abstract · 8 pages, 3 figures, accepted for publication in IEEE Communications Standards Magazine

Semantic communication, near-field operation, and integrated sensing and communication (ISAC) are often considered separately in terrestrial and non-terrestrial networks (TN--NTN). We show how a large electromagnetic aperture can connect them. \textcolor{black}{Nonlocal metasurfaces and holographic apertures act on the spatial spectrum of an incident field and can execute linear projections, which form an early stage of semantic feature extraction, directly in the wave domain before digitisation, thereby reducing the corresponding digital processing burden.} Near-field focusing also provides position-dependent sensing features, allowing the aperture to serve as an analog semantic-ISAC front end on resource-constrained aerial and satellite platforms. We describe the underlying physics, the co-design of constrained analog projections with lightweight digital decoders, and a case study in which a data-adaptive projection outperforms a fully digital baseline in the simulated energy-limited regime while transmitting four times fewer coefficients and using 11.4 times fewer decoder MACs. Finally, we identify relevant 3GPP, ITU-R, and ETSI activities and the remaining standardisation gaps.

0.57

To Stack or Not to Stack? Jacobian Conditioning and the Benefits of Depth in Metasurface-Based Linear Transformation Synthesis

eess.SP ·2026-10-14 ·Andrea Abrardo, Andrea Garulli
similarity 0.56
Abstract · 12 pages, 8 figures, journal paper

This paper investigates when and why stacking programmable metasurfaces into Stacked Intelligent Metasurfaces (SIMs) improves linear transformation synthesis at a fixed phase-control budget. The analysis shows that algebraic Jacobian rank alone is insufficient to characterize practical synthesis, which also depends on the strength and balance of the sensitivity directions generated by the available controls. A layer-resolved analysis of the cascade model explains how inter-layer propagation can generate complementary sensitivity directions. The relevance of this mechanism is then assessed using an S-parameter multiport model that includes electromagnetic coupling and multiple scattering. Numerical results in near- and far-field sensing scenarios show that distributing the same control resources across multiple layers can strengthen weak transformation directions, improve Jacobian conditioning, and substantially enhance synthesis accuracy. These findings explain why increasing depth can offer benefits that are not obtained by simply enlarging a single programmable surface, and identify layer complementarity and Jacobian conditioning as useful criteria for SIM architecture design.

0.19

To Remove or Not to Remove Clouds: A Comparative Analysis and Fusion of Raw SAR and Synthetic NDWI for Overcast Water Segmentation

cs.CV ·2026-08-18 ·Saleh Sakib Ahmed, Sara Nowreen, M. Sohel Rahman
similarity 0.56
Abstract

Persistent clouds blind optical satellites during floods. While Synthetic Aperture Radar (SAR) penetrates clouds, its raw data is noisy and lacks clear contrast. To mitigate this, recent studies utilize deep learning models to translate SAR into cloud-free synthetic optical imagery for downstream tasks like water body segmentation. However, because raw SAR is the original source for both of these operations, a critical methodological dilemma arises: during complete overcast should segmentation models process the raw SAR directly, or rely on a translated synthetic Normalized Difference Water Index (NDWI) proxy? This study resolves the debate by demonstrating that synthetic NDWI yields better results, as the translation process acts as a powerful filter against radar noise. This raises a natural second question: what if we utilize both? Building on our findings, we introduce a Combined Framework that integrates both raw SAR and synthetic NDWI into a unified model. By fusing the sharp physical boundaries of raw SAR with the high contrast of synthetic NDWI, this hybrid approach consistently outperforms all standalone methods.

0.25

SAR-TopoGuard: Training-Free, Speckle-Aware Topological Verification for Structure-Preserving SAR-to-Optical Translation

cs.CV cs.AI ·2026-11-14 ·Satabarto Sarkar, Debojyoti Ghosh, Subhranil Biswas, Kaustav Mandal, D. Sobya
publishedcode/data similarity 0.55
Abstract · 10 pages, 4 figures, 7 tables. Accepted manuscript of the article published in IEEE Geoscience and Remote Sensing Letters (2026). \c{opyrigh…

SAR-to-optical translators often synthesize detail that the radar measurement does not support, and pixel metrics alone cannot reveal it. We propose SAR-TopoGuard, a training-free inference-time layer for frozen generators: a stochastic sampler draws K candidates (Monte Carlo dropout for GANs, seed variance for diffusion), a speckle-aware verifier ranks them by gradient-magnitude correlation with the SAR input and a hallucination-frequency index, and a SAR-guided frequency gate admits high-frequency detail only where SAR edges support it. With all five hyperparameters frozen and three training seeds, we evaluate on 500 scene-disjoint SEN1-2 test patches, 500 patches of a held-out summer scene, and 200 cross-dataset SEN12MS winter pairs. The layer improves Pix2Pix by +0.060, +0.012, and +0.077 dB PSNR and by +0.0034, +0.0057, and +0.0135 SSIM, respectively (Wilcoxon p < 1e-6), and it improves CycleGAN and CUT on all three sets (+0.013 to +0.076 dB). It raises edge precision at the cost of edge recall (edge F1 -1.3% on the test set). On the latent diffusion model COP-GEN, it adds +0.33 dB (base) and +0.16 dB (Beta) on the winter set, the only set with dual-polarization SAR. An ablation shows that the gate produces the gain for MC-dropout GANs, whose candidates are nearly identical, whereas verifier selection contributes up to +0.26 dB for diffusion, whose samples differ. The layer has zero trainable parameters and adds 0.4 ms per patch beyond the K=5 generator passes.

0.42

Improved Automatic Target Recognition in Synthetic Aperture Sonar Imagery Using Large Deep Neural Networks

cs.CV ·2026-09-01 ·C. J. Moore, Alex Hurt, Jordan Malof
similarity 0.54
Abstract

Automatic Target Recognition (ATR) in Synthetic Aperture Sonar (SAS) is often underpinned by deep neural networks (DNNs). Recent research has focused on relatively low-capacity DNNs (i.e., relatively fewer trainable parameters) to avoid overfitting on the small training datasets that are typically available for SAS. However, recent research has found that increasing DNN capacity often improves performance, even when training data is scarce. Motivated by this emerging finding - termed the double descent phenomenon - this work investigates the use of especially high-capacity DNNs for SAS-ATR. We evaluate the performance of several state-of-the-art DNN architectures as we increase their model capacity. We examine performance in a realistic leave-one-geo-location-out cross-validation scheme. We find that increasing model capacity often increases performance substantially, and is never harmful. All of our large models significantly outperform two baseline models from recent publications. Training high-capacity models on small dataset however requires careful regularization, and we also perform systematic experiments showing the impact of several regularization strategies: pretraining on other imaging modalities, data augmentation (including some new to SAS), DropPath, and weight decay. We show that each of these strategies independently improves the performance of the large models.

0.21