CS Paper Radar

Hardware-Aware Deployment of Joint SAR Compression and Despeckling on FPGA

Cédric Léonard, Francescopaolo Sica, Martin Schulz

eess.IV cs.LG ·submitted 2026-08-11 07:29 UTC · v1
code/data

Abstract

Next-generation Synthetic Aperture Radar (SAR) missions will generate data far faster than they can downlink, making onboard data reduction essential for near-real-time Earth observation. Learned Image Compression (LIC) offers better rate-distortion performance than handcrafted codecs used operationally today, and recent work shows that simultaneously despeckling and compressing SAR imagery enables better representation capacity while unlocking higher compression rates. These methods, however, have yet to be confronted with the strict power, compute, and operational constraints of spaceborne systems. In this work, we bridge this gap by deploying a joint SAR Despeckling and Data Compression (DDC) framework on an embedded ZCU102 FPGA-based platform, introducing model adaptations that respect the accelerator's fixed-point arithmetic and limited set of supported operations. We evaluate four model topologies across precision levels and across CPU, GPU, and FPGA platforms, revealing several findings with direct design implications. We find that replacing conventional GDN activation functions with plain ReLU improves quality on SAR, suggesting that design principles established for compression of natural images do not necessarily transfer to SAR imagery. In addition, we demonstrate that residual blocks offer little representational benefit for ten times the compute, and show that the FPGA is the most energy-efficient of the platforms tested. Together, these results set a functioning edge deployment workflow and an evidence-based starting point for onboard SAR compression. The code is available at https://github.com/CedricLeon/SAR_DDC_FPGA.

Comment
Submitted to IEEE Transactions on Geoscience and Remote Sensing (TGRS). 11 pages, 8 figures, 4 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Task-Based Evaluation of Raw Radar Data Compression: A Pre-Registered Study of Where Classical Codecs Fail to Preserve Target Detection, and Why

eess.SP ·2026-08-18 ·Eric Michael Chrabot
code/data similarity 0.70
Abstract · 16 pages, 9 figures, 5 tables. v2: corrects the retention-only counterfactual (Secs. I, III-A, V-C); states the criterion's commit chronolog…

Synthetic aperture radar (SAR) systems collect raw I/Q echo data at rates that exceed downlink capacity; fielded systems compress onboard with block-adaptive quantization (BAQ/FDBAQ). Proposed replacements, including learned compression, are evaluated with image-quality metrics (PSNR, SSIM, SQNR); none measures whether the data still supports its operational use. We introduce a task-based evaluation methodology for raw radar compression, with a published pre-registration trail: codecs are scored after SAR focusing against a two-sided criterion -- a CFAR detection-retention floor and a spurious-detection budget at matched threshold -- using frozen task models trained once on uncompressed data. On Sentinel-1 stripmap Level-0 data the evaluation brackets the fielded FDBAQ operating point at the resolution of the BAQ grid (3-bit BAQ sustains utility at 6.12 bits per complex sample; 2-bit does not), with a reported lattice artifact found to change retention by at most 0.004. Under the final plane-mapping rule no classical configuration sustains utility below 4.86 bits per complex sample on this scene. Energy concentration after focusing delivers the predicted retention gain (0.888 vs 0.691 at 2 bits) but converts it into target-adjacent false alarms for wavelet and block-transform codecs alike: a retention-only rule certifies focused-domain JPEG2000 at 4 bits while it produces 2.5 times the tolerable spurious count. On AFRL Gotcha GMTI data (airborne, never compressed onboard) the frontier is bracketed at 7.4-8.0 bits per complex sample and the same trade reappears; on an Umbra spotlight image JPEG2000 passes the retention floor at 2, 1, and 0.5 bits while producing 10-14 times the spurious budget. We report the full pre-registration trail, including the chronology of the criterion's two clauses, one retracted overclaim, and a bounded negative result for a small learned codec.

0.28

FastSAR: Open-Source SAR Image Formation on CPUs, GPUs, and TPUs, and a Matched Comparison of Algorithms, Precisions, and Processors

cs.PF eess.SP ·2026-10-24 ·Paul Singerman, Tom Braun
code/data similarity 0.67
Abstract · 39 pages, 8 figures. Submitted to IEEE Transactions on Geoscience and Remote Sensing. Code: https://github.com/saulpingerman/FastSAR (pip in…

The number of spaceborne synthetic aperture radar (SAR) collectors is growing exponentially, each returning raw collections that must be formed into images. Exact backprojection needs 1.6 trillion interpolated reads and 90 trillion floating-point operations for a 108-megapixel Umbra image. How long it takes to form an image, and at what price, depends on the algorithm, the arithmetic, and the hardware. Open-source implementations have never been compared on matched hardware against a common reference, and none run on Google tensor processing units (TPUs). This paper presents FastSAR, an open-source SAR image formation library for central processing units (CPUs), NVIDIA graphics processing units (GPUs), and TPUs. With it, we compare three SAR image formation algorithms, four floating-point formats, and six cloud devices in every supported combination, with cost per image at on-demand cloud prices as the fair common measure. FastSAR is 1.06 to 22,000 times faster than the tested open-source implementations at equal or better accuracy, and the full suite of hardware, algorithm, and floating-point combinations lets a user choose the Pareto-optimal configuration for their balance of accuracy, speed, and cost. The L4 GPU forms images the cheapest overall. Larger GPUs are faster but cost more per image because their price rises faster than their speed. The TPUs come close to the GPUs in cost, but only for the factorized algorithm, and the CPU is far less efficient in both speed and cost. Lower precision formats buy less of a speedup than expected, and each step down in precision costs accuracy.

0.37

Model Compression and Hardware-Aware Acceleration for Deep Learning on FPGAs: A Co-Design Taxonomy and Comparative Analysis

cs.AR ·2026-08-21 ·Peter Forcha, H. Kajekusumadhar, Mbua Peter, Muhammed Kawser, Audrey Cyriell Mo +1 more
survey similarity 0.66
Abstract

Deploying deep neural networks on Field-Programmable Gate Arrays (FPGAs) requires joint reasoning about model compression and hardware acceleration, however the most comprehensive existing cross-platform treatment of this space, Deng et al.~\cite{deng2020model}, compared compression techniques against CPU, GPU, FPGA, and ASIC targets at the level of broad, qualitative trade-offs, and not specific FPGA resource consequences. This survey instead restricted the scope to FPGAs alone and organized 25 compression-hardware co-design case studies (2015--2026) into a five-category taxonomy defined by which FPGA resources each strategy primarily reshapes: DSP-eliminating, DSP-repurposing/mixed-precision, sparsity-exploiting, memory-hierarchy-driven, and toolchain/deployment-level. Normalizing these case studies along a common set of dimensions (compression ratio, accuracy change, throughput, energy efficiency, and DSP/LUT/BRAM utilization) surfaces a central, quantitative finding; of the 25 reviewed works, only \emph{one} reported a compression ratio and accuracy change measured against a single common baseline, and only \emph{two} reported energy efficiency normalized against a common GPU baseline, exposing a field-wide characterization gap that no individual toolchain (FINN, HLS4ML, Vitis AI, or DNNWeaver) resolves on its own. Building on this taxonomy and meta-analysis, we formalize six open challenges: toolchain fragmentation, accuracy--efficiency characterization, automated mixed-precision optimization, sparse computation reliability, persistent memory bottlenecks, and FPGA-based training. Each is paired with a concrete next step grounded in extending an existing, cited technique, not a general call for future work.

0.21

Quantized Edge Inference of a Self-Supervised SAR-Optical Encoder on Commodity x86 Hardware

eess.IV cs.CVcs.LG ·2026-10-27 ·Christian Sanchez-Leon, Dongming Chen
similarity 0.62
Abstract · 3 pages, 1 figure, 3 tables

Self-supervised vision transformers are increasingly used as reusable encoders for Earth observation, but their inference cost on the hardware available in the field is rarely characterized. We deploy a pretrained SAR-optical masked-autoencoder encoder on three commodity x86 nodes, from a low-power CPU without AVX2 to an AVX2+VNNI reference, at FP32, FP16 and INT8 on the CPU and, where present, the integrated GPU, and report latency, energy (RAPL and wall plug) and linear-probe accuracy. Quantization is accuracy-neutral: INT8 changes micro-mAP by only +0.0006, within the seed spread, so precision becomes a pure cost decision. INT8 lowers CPU latency on every node, by 1.45x even on the CPU without AVX2, and CPU energy wherever it is measured, and the VNNI reference (1.53x) suggests a further gain beyond AVX2. The Pareto-optimal device shifts from the integrated GPU, which is 4.38x faster than the CPU on the weakest node, to the CPU as the CPU class improves.

0.24

VQ-LIC: Shared Vector-Quantized Learned Image Compression on a Resource-Constrained FPGA

cs.AR eess.IV ·2026-09-24 ·Muhammad Fahd Ibrahim Bhatti, Abdullah Bin Faisal, Ahsan Usman, Naveed Anwar Bhatti, Muhammad Ali Siddiqi
similarity 0.61
Abstract

Learned image compression (LIC) is hard to deploy on severely resource-constrained FPGAs, since how fast it actually runs depends not just on arithmetic count, but also on memory traffic, imbalance between different operations, and how the hardware batches its work. We present VQ-LIC, an asymmetric edge-cloud codec in which a compact INT8 depthwise (DW)-pointwise (PW) analysis transform and multi-codebook vector quantization (VQ) run at the edge on a reusable DW/PW engine pair, while reconstruction is handled by a larger cloud decoder. Since VQ codeword matching is expressible as a dot product, it is mapped directly onto the same PW engine, removing the need for a separate VQ compute array, to our knowledge a first for FPGA LIC. A novel latency model, derived from deterministic RTL cycle counts of an FPGA's read, DW, PW, and write costs, predicts an analysis transform's per-block latency; since VQ shares the same PW datapath, the model applies to VQ as well. Validated directly against silicon, the model predicts deployed analysis and VQ latency within 0.26\% and 0.05\%, and guides the selection of a three-block $16$-$48$-$64$ transform. Post-training codebook reduction then cuts VQ arithmetic and codebook storage by $4\times$ and shrinks the fixed-width latent representation. On a 220-DSP Zynq-7020, VQ-LIC's mid-rate preset reaches 0.1398 bits per pixel at 28.69 dB PSNR and 13.06 dB MS-SSIM on CLIC~2017, outperforming a similarly sized neural encoder and reaching a rate-distortion range comparable to a codec three orders of magnitude larger. The complete 0.1945-kMAC/pixel analysis-VQ pipeline runs at 47.98 frames per second and 42.84 mJ per frame on silicon, using an order of magnitude fewer DSPs than comparable FPGA LIC accelerators while achieving lower bitrate, higher throughput, and lower energy per frame at a modest PSNR tradeoff.

0.27

End-to-End Learned Image Coding: From Rate-Distortion Optimization to Practical Deployment

eess.IV cs.MM ·2026-10-15 ·Ming Lu, Junqi Shi, Zhan Ma
benchmark similarity 0.60
Abstract

End-to-end learned image coding (LIC) has achieved substantial improvements in rate--distortion (R--D) performance, yet practical deployment requires addressing a broader set of system-level constraints. This article provides a deployment-oriented review of LIC, with particular attention to the transition from high-performance neural compression models to practical codecs. We first summarize the basic end-to-end coding framework, including learned transforms, quantization, entropy modeling, and R--D optimization. We then review practical extensions that are increasingly important for deployment, including variable-rate coding and rate control, integer-precision inference and cross-platform consistency, robustness and communication resilience, lightweight and hardware-aware implementation, and standardization and interoperability. To study these issues under a common setting, we further introduce TinyLIC as an open benchmark and reproducible case study for rate--distortion--complexity analysis. Experimental results illustrate the trade-offs among compression efficiency, computational complexity, numerical consistency, and robustness. In particular, TinyLIC with approximately 10 KMACs/pixel decoding complexity substantially outperforms the H.265/HEVC image-profile anchor on Kodak, while the 50 KMACs/pixel configuration achieves performance comparable to the H.266/VVC image-profile anchor on several test sets. The review highlights practical constraints and design trade-offs that remain central to the deployment and interoperability of learned image codecs. Materials are accessible at https://njuvision.github.io/TinyLIC.

0.14

ScaleLUT: A Fully-Parallel Configurable LUT-Based Accelerator for Real-Time Multi-Scale Super-Resolution

cs.AR ·2026-09-15 ·Boyu Li, Chenchen Ding, Zhilin Ai, Wenqing Shi, Baizhou Jiang +5 more
published similarity 0.59
Abstract · 7 pages. Accepted by the 32nd Asia and South Pacific Design Automation Conference (ASP-DAC 2027)

Real-time super-resolution (SR) remains challenging for edge devices because deep-learning-based methods require substantial multiply-accumulate (MAC) operations, resources, and power. Lookup-table (LUT)-based SR reduces computation by replacing convolutional inference with table queries, but existing methods still suffer from limited speed, large storage overhead, and poor scalability across upsampling factors. We present ScaleLUT, a hardware-oriented LUT design framework and fully parallel reconfigurable accelerator for real-time multi-scale SR. ScaleLUT combines a hardware-friendly YUV-domain strategy with power-of-two kernels and rotation ensemble to improve receptive-field coverage while reducing LUT dimensionality; division operations are replaced by shifts. These designs reduce memory by 18.4% over state-of-the-art LUT-based SR methods. ScaleLUT supports arbitrary input resolutions and configurable x2^n upsampling factors using a deeply pipelined, massively parallel architecture. Implemented on a Xilinx ZCU102 FPGA, it achieves real-time 4K SR at 95.3 FPS for x2 upscaling at 300 MHz. Compared with existing SR accelerators, ScaleLUT uses at least 58.6% fewer LUTs, 41.1% fewer flip-flops, zero DSPs, and 42.0% lower power, while delivering 10x and 1.2x speedups over the best CPU-based SR implementation and prior FPGA-based SR accelerators, respectively. These results demonstrate the effectiveness of joint LUT algorithm-hardware co-design for practical and energy-efficient edge SR deployment.

0.31

SimSkip: StrongARM-Comparator Similarity Sensing with SAR-Skipping-Aware Training for Analog Compute-in-Memory

cs.AR ·2026-09-21 ·Yufei Liu, Junjie Wang, Shuang Liu, Yang Wang, Yang Liu
similarity 0.59
Abstract · 5 pages, 6 figures, 3 tables. Submitted to the IEEE International Symposium on Circuits and Systems (ISCAS) 2027

Analog-to-digital conversion dominates the energy and area of analog compute-in-memory (CIM) accelerators. This paper presents SimSkip, a successive-approximation-register (SAR) skipping scheme that combines a lightweight StrongARM-comparator similarity detector with SAR-skipping-aware training. When two held voltages are similar, the upper bits of the preceding code are reused to skip SAR comparisons. Detector-induced disturbance extracted from 55-nm CMOS simulations and bit-exact prefix saturation are embedded in the forward pass, and the network learns to tolerate them through quantization-aware training and knowledge distillation. On an ISAAC-based W4A4 WRN-28-10, SimSkip achieves 77.23% CIFAR-100 top-1 accuracy (mean of three seeds) versus 78.4% for the baseline, while reducing SAR comparisons by 48.2% across three hardware-modeled layers. A first-order model estimates a 27.2% net ADC energy reduction after detector overhead.

0.28