CS Paper Radar

SWIR-cGAN: Synthesizing SWIR Bands Using VNIR Imagery from CBERS and AMAZONIA-1

Alisson Cleiton de Oliveira, Rennan de Freitas Bezerra Marujo, Thales Sehn Körting

cs.CV ·submitted 2026-11-17 15:22 UTC · v1
publishedcode/data

Abstract

Spectral band synthesis is an important research topic in remote sensing. The Brazilian satellites CBERS-4, CBERS-4A, and AMAZONIA-1 provide high temporal resolution (1-3 days) visible and near-infrared (VNIR) imagery through the Wide-Field Imager (WFI), but lack short-wave infrared (SWIR) bands. Recent deep learning methods have shown promising results for spectral synthesis, but challenges remain for cross-satellite generalization and spectrally distant bands. This paper presents a conditional Generative Adversarial Network (cGAN) with an attention-enhanced U-net generator and a multi-loss objective to synthesize Sentinel-2/MSI SWIR bands 11 (SWIR-1) and 12 (SWIR-2) from WFI VNIR inputs. Experiments used 4,125 patches for training and cross-validation and 1,026 unseen patches for testing, with hyperparameters optimized using a subset of the training data. On SWIR-1, the model achieved SSIM of 0.900, PSNR of 31.44 dB, and MAE of 0.019 in TOA reflectance. On SWIR-2, it achieved SSIM of 0.917, PSNR of 33.35 dB, and MAE of 0.015. Benchmarking was performed on the test dataset, with each model optimized separately prior to evaluation. SWIR-cGAN outperformed the baselines, particularly for SWIR-2. The ablation study identified the multi-loss as the main performance contributor, while the attention and residual modules provided additional improvements. Our results demonstrate the feasibility of synthesizing SWIR bands from WFI imagery. The SWIR-cGAN is available at https://github.com/marujore/swir-cgan.

Comment
Available on: https://ieeexplore.ieee.org/document/11793642. Early Access
Journal ref
IEEE Geoscience and Remote Sensing Letters, 2026
DOI
10.1109/LGRS.2026.3753509

Closest papers

Nearest neighbours by meaning across the whole index.

RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains

cs.CV ·2026-09-02 ·Thijs A. Eker, Ella P. Fokkinga, Jan Erik van Woerden, Elfi I. S. Hofmeijer, Sebastiaan P. Snel +2 more
similarity 0.61
Abstract · Submitted to SPIE Sensors + Imaging 2026

Synthetic training data is crucial for developing vision AI when real-world data is scarce, as in thermal infrared (IR) aerial vehicle detection. While abundant UAV RGB imagery motivates RGB-to-IR translation for data augmentation, unobservable thermal traits (e.g., engine heat) make learning transferable mappings challenging. This work investigates whether modern generative translators can overcome this cross-modal gap to improve infrared vehicle detection on unseen UAV target domains. Translators are trained on paired RGB-IR source datasets and applied to RGB training images from held-out target datasets to generate synthetic IR data. Evaluated methods include supervised GANs, ControlNet-based diffusion models, and foundation-model editing via LoRA. The resulting synthetic IR imagery is used to train RF-DETR vehicle detectors, which are evaluated on unseen IR target test splits across five aerial datasets, with Kust4K and VTUAV serving as target domains. Synthetic IR consistently outperforms RGB and grayscale baselines. Stable Diffusion 3.5 with ControlNet yields the best results, improving mAP from 50.8 to 60.1 on Kust4K and from 25.6 to 38.4 on VTUAV compared to models trained only on source-domain IR data. Increasing output diversity via multiple seeds (+1.1 mAP) and prompt variations (+3.3 mAP) provides additional gains on VTUAV. Although a performance gap to real target IR data remains, generative RGB-to-IR translation effectively mitigates IR data scarcity and improves cross-domain aerial vehicle detection.

0.13

Exploring the Potential of Contrastive Language-Image Pre-training for Multi-Source Remote Sensing Data

cs.CV cs.AI ·2026-09-03 ·Xiangyang Miao, Kelu Yao, Yekai Huang, Xiaogang Xu, Junxiao Xue +5 more
similarity 0.60
Abstract · 9 pages, 4 figures, 5 tables

Contrastive language-image learning (CLIP) has become a key paradigm for remote sensing vision-language understanding. However, existing remote sensing contrastive learning methods are mostly built on RGB-oriented CLIP architectures, making it difficult to exploit heterogeneous sensors such as SAR, multi-spectral imaging (MSI), and hyperspectral imaging (HSI). To address this limitation, we propose OmniRSCLIP, an end-to-end contrastive learning framework that supports multi-source sensor inputs for remote sensing vision-language modeling. The key idea is to extend CLIP beyond its fixed RGB input interface without breaking the pretrained visual knowledge. To this end, OmniRSCLIP introduces Spectral-Spatial Basis Decomposition (SSBD), which formulates arbitrary-channel adaptation as a basis recomposition problem: pretrained CLIP patch embeddings provide transferable spatial bases, while wavelength-conditioned coefficients span sensor-specific embedding kernels within a constrained visual prior space. This design avoids forcing heterogeneous sensors into a fixed-channel input space, while aligning them in a unified image-text semantic space. We further introduce a spectral-context-aware mask-based contrastive learning scheme to suppress modality-specific redundant features and enhance fine-grained image-text alignment. Finally, to support multi-modal training, we construct OmniRS5M, the first large-scale remote sensing image-text corpus covering RGB, SAR, MSI, and HSI. Experiments on retrieval, zero-shot classification, and semantic localization show that OmniRSCLIP preserves strong RGB-domain performance while effectively extending CLIP to heterogeneous remote sensing modalities.

0.27

Tropical Cyclone Wind Field Diagnosis with Image-to-Image Models

cs.CV physics.ao-ph ·2026-10-07 ·Sarah J. Ollier, David S. Nolan, Brian D. McNoldy, Eduardo Siman
similarity 0.60
Abstract · Preprint prior to peer review. Submitted to Artificial Intelligence for the Earth Systems on 8th September 2026

This study presents a novel application of image-to-image generative adversarial networks (GANs) to produce a complete tropical cyclone (TC) surface wind field diagnosis from a single frame of satellite infrared brightness temperature (IR). Because TC surface wind fields are infrequently observed, we train on two data sets. The first contains 3,323 image pairs of IR and wind fields from Weather Research and Forecasting Model (WRF) simulations (WRF2WRF). The second contains 11,886 real IR satellite images paired with parametric wind fields built on the extended best-track data set (IBTrACS) of TC intensities and wind radii (GOES2PARA). Both models, conditioned on storm intensity, motion, and latitude, transform single-channel IR into wind fields over 6$^{\circ} \times$ 6$^{\circ}$ (WRF2WRF) and 7$^{\circ} \times$ 7$^{\circ}$ (GOES2PARA) domains, at 256 $\times$ 256 pixel resolution. GOES2PARA captures outer wind field asymmetries, enabling diagnosis of 64, 50, and 34-knot wind radii (R64, R50, R34) in each quadrant. WRF2WRF also produces detailed rainbands and eyewall asymmetries. Pixel-wise RMSE against held out truth demonstrates realistic wind field generation with mean RMSE of 6.4 knots (GOES2PARA) and 7.2 knots (WRF2WRF). Compared against IBTrACS, WRF2WRF achieved mean absolute errors (MAE) of 14.8 nautical miles (NM) for radius of maximum wind (RMW) and 25.9 NM for R34. GOES2PARA achieved 10.0 NM MAE for RMW and 25.9 NM for R34. Against Synthetic Aperture Radar wind fields GOES2PARA yielded a lower mean pixel-wise error (RMSE 12.1 kt, MAE 9.5 kt) than WRF2WRF (RMSE 13.9 kt, MAE 11.3 kt). Unlike many existing operational surface wind speed algorithms, our image-to-image models provide updated wind fields with every new satellite image.

0.22

Spectral Super-Resolution using Spatial-Spectral Residual Operator Networks

cs.CV cs.AI ·2026-09-28 ·Seokhyun Chin
published similarity 0.59
Abstract · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) 2026

Spectral super-resolution of multispectral satellite images can enable high temporal- and spatial-resolution hyperspectral satellite imagery at a modest cost, significantly increasing the applicability of hyperspectral remote sensing. This task is inherently ill-posed, making it well-suited for deep learning-based methods. In this study, the spectral super-resolution task is framed as an operator learning problem, and SSRON is proposed as a Deep Operator Network that effectively learns function-to-function mappings from downsampled spectra to continuous spectra. The model is trained to super-resolve Sentinel-2A-like multispectral imagery to EMIT images. Compared to baseline models, SSRON achieves superior performance across all metrics. The model also demonstrates zero-shot spectral super-resolution capability by predicting bands unseen during training. Furthermore, its continuous-output formulation suggests the potential to estimate spectra at finer wavelength intervals than the native sensor. These results suggest the potential of SSRON and establishes operator learning as a promising direction for spectral super-resolution.

0.32

Omni-RS: Unifying Multi-Task Understanding and Generation in Remote Sensing

cs.CV ·2026-10-13 ·Pan Yin, Shuai Yang, Yuanhao Liu, Datao Tang, Jialin Li +5 more
dataset similarity 0.58
Abstract

Practical remote sensing applications often require both understanding and generation capabilities for the same geographic scene. However, most existing methods address either understanding or generation in isolation, while existing unified remote sensing models' generative ability is limited to text-to-image. To bridge this gap, we propose Omni-RS, a unified framework supporting four remote sensing understanding tasks and five generation tasks. Specifically, we introduce the "Scene-Guided Two-Stage Training" strategy, which first adapts a multimodal large language model to remote sensing understanding and then uses its hidden states to guide a diffusion transformer for image generation. To enable joint learning across diverse generation tasks, we construct UniGen, a unified multi-task generation dataset, by organizing heterogeneous remote sensing data into a unified format. Furthermore, we introduce "Detailed Visual Conditioning", which uses visual conditions encoded by a VAE to guide the generation process, thereby supporting additional generation tasks that require reference images. Extensive experiments demonstrate that Omni-RS performs exceptionally well in understanding tasks and has achieved outstanding results in a variety of generative tasks.

0.14

nnAEU: a Simple and Efficient CNN-Autoencoder for Hyperspectral Unmixing

cs.CV ·2026-11-13 ·Edgard Dabier, Christophe Kervazo, Pietro Gori, Florence Tupin
code/data similarity 0.57
Abstract

Deep learning-based hyperspectral unmixing (HSU) has followed a trajectory of increasing architectural complexity, from simple autoencoders to transformers and, most recently, Mamba-based models, each claiming to advance the state of the art. Contrary to this trend, we propose a lightweight CNN-based autoencoder, coined "Not New Autoencoder Unmixing" (nnAEU). It is derived from the backbone of UNMamba (2025) through a pruning study that removes the Mamba component entirely. nnAEU uses less than 10 times fewer parameters than UNMamba, and far fewer than other transformer- and GAN-based methods, while outperforming them in accuracy. We provide a complete, minimal, reproducible code, available at https://gitlab.telecom-paris.fr/ring/nnAEU.git.

0.38

NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis

cs.CV ·2026-08-30 ·Mausam Gurung, Prabin Neupane, Sajjan Acharya
similarity 0.57
Abstract · 11 pages, 4 figures, 3 tables

This paper introduces NepScript Genesis, a Neural Architecture Search (NAS) framework for automated Generative Adversarial Network (GAN) discovery, applied to conditional Devanagari handwritten digit synthesis. We compare five NAS strategies against a carefully constructed Deep Convolutional GAN (DCGAN) baseline (FID=332.28). Architecture selection utilizes a two-stage pipeline guided by a novel domain-aware evaluation metric (Enhanced Score). Results demonstrate that Adaptive Exploration achieves the optimal quality-efficiency trade-off, attaining an FID of 79.12 -- a 76.19% improvement over the baseline -- and the highest mode coverage among the NAS strategies (Recall=0.531) in under one GPU-hour. Furthermore, we demonstrate that incorporating script-specific structural heuristics into the search phase prevents early-stage mode collapse. In a downstream low-resource evaluation, augmenting 250 real training samples per class with GAN-generated digits from the best NAS model improves CNN classification accuracy from 91.0% to 96.5% (+5.5 percentage points), demonstrating that NAS-optimized synthesis produces digits of sufficient quality to benefit practical recognition pipelines when real data is scarce.

0.23

Scale-based Approach for Active Wildfire Segmentation on Satellite Imagery

cs.CV ·2026-09-01 ·Matheus F. Kovaleski, Cristiano Premebida, João Ruivo Paulo
similarity 0.57
Abstract · 6 page, 2 figures, 3 tables

Active wildfire mapping from satellite imagery is challenging due to the sparse and highly imbalanced nature of fire pixels, especially in early-stage or low-density fire observations. This work investigates the use of multispectral Landsat-8 imagery for active-fire segmentation under multi-scale wildfire size conditions. We propose a data-driven protocol to characterize fire-region size distributions through connected-component analysis and an interquartile range criterion, enabling the evaluation of model robustness across different local fire-region densities. Three segmentation architectures, U-Net, DeepLabV3+, and SegFormer, are evaluated under different SWIR-based spectral configurations. Results show that U-Net achieves the strongest robustness across the evaluated conditions, SegFormer provides competitive performance, and DeepLabV3+ tends to produce conservative predictions with reduced recall. Across architectures, SWIR2 consistently achieves the strongest or near-best results, highlighting its importance for active-fire segmentation in Landsat-8 imagery. These findings suggest that both spectral band selection and architectural design are critical for robust satellite-based active wildfire mapping trained on low active fire-pixel density images.

0.23