CS Paper Radar

Deep Learning Super Resolution for Satellite Cloud Mask Downscaling

Angelos Georgakis, Valentina Kanaki, Giorgos Giannopoulos, Stella Girtsou, Ioannis Kontogiorgakis, Charalampos Kontoes, Kostas Philippopoulos

cs.CV cs.AI ·submitted 2026-08-25 15:34 UTC · v1
publishedhot direction

Abstract

A vast amount of optical satellite data is being transmitted to Earth-based servers every day, and more than half of this data is affected by haze or clouds. Additionally, this data suffers from the fundamental trade-off between spatial and temporal resolution, which remains largely unresolved, making the acquisition of continuous high-resolution satellite observations of clouds an ongoing challenge. This work addresses this challenge by proposing two Deep Learning super-resolution methods for the accurate downscaling of SEVIRI cloud mask products, as well as a novel cross-sensor cloud mask dataset called SEVMOD-CM, created by spatially and temporally matching MODIS and SEVIRI satellite observations. The two proposed models are a CNN-based (SpatialCNN) and a GAN-based (SpatialGAN) Neural Network. Trained on the SEVIRI spectral and cloud mask products, the proposed methods predict the corresponding MODIS Cloud masks, achieving a 4x spatial enhancement across sensor domains. Both approaches are evaluated experimentally, and compared against the standard bicubic interpolation upsampling technique. The experimental results demonstrate the value of the proposed models and dataset for the remote sensing community, highlighting the benefits of applying super-resolution techniques to geostationary-derived cloud mask products for applications such as atmospheric monitoring, weather forecasting, disaster risk reduction, solar energy forecasting, and climate research.

Comment
Accepted for 2026 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Super-resolution as Spatial Downscaling: Coherence, Structure and Task Utility in Earth Observation

cs.CV cs.LG ·2026-10-12 ·Bright Wiredu Nuakoh, Ebenezer Afrifa-Yamoah
similarity 0.64
Abstract · 41 pages, 12 figures. Code: https://doi.org/10.5281/zenodo.23306933

Learned satellite super-resolution is commonly assessed by pixel fidelity and potential downlink savings, but these criteria do not establish whether the reconstructed field preserves spatial structure or supports reliable downstream analysis. We treat single-image super-resolution as a spatial downscaling problem and evaluate four lightweight networks, including our compact 0.36 million-parameter model, against interpolation using pixel metrics, directional variograms, spectral band correlation, codispersion and observation coherence. On 735 satellite tiles from 190 scenes, the networks differ by at most 0.03dB and outperform bicubic interpolation by $1.39-1.42$dB at $\times 2$. They recover about 30% of the spectral power above the observation's Nyquist frequency and, at $\times 4$, produce more isotropic fields than the reference (range anisotropy 0.59 against 0.49). Energy-based metrics can favour invented detail. Enforcing coherence reaches the quantisation limit, yet at least 99.7% of the remaining error lies in the observation operator's null space, which coherence cannot constrain. Under spatially blocked, paired evaluation with two backbones and a sharpening control, learned reconstruction changes land-use accuracy by $-1.0$ to $+3.1$ percentage points (significant in 7 of 24 comparisons) and building-change F1 by $-0.015$ to $+0.024$ (none significant) relative to bicubic interpolation, and amplifies spurious change between two observations of an unchanged scene by $1.3-1.5$ times where interpolation attenuates it. Full-resolution JPEG\,2000 matches or exceeds reduced-resolution transmission with reconstruction at every matched bitrate. Learned reconstruction is most useful when only low-resolution imagery is available, and its evaluation should combine pixel metrics with spatial structure, observation coherence and task-level tests under spatial validation.

0.30

Spectral Super-Resolution using Spatial-Spectral Residual Operator Networks

cs.CV cs.AI ·2026-09-28 ·Seokhyun Chin
published similarity 0.62
Abstract · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) 2026

Spectral super-resolution of multispectral satellite images can enable high temporal- and spatial-resolution hyperspectral satellite imagery at a modest cost, significantly increasing the applicability of hyperspectral remote sensing. This task is inherently ill-posed, making it well-suited for deep learning-based methods. In this study, the spectral super-resolution task is framed as an operator learning problem, and SSRON is proposed as a Deep Operator Network that effectively learns function-to-function mappings from downsampled spectra to continuous spectra. The model is trained to super-resolve Sentinel-2A-like multispectral imagery to EMIT images. Compared to baseline models, SSRON achieves superior performance across all metrics. The model also demonstrates zero-shot spectral super-resolution capability by predicting bands unseen during training. Furthermore, its continuous-output formulation suggests the potential to estimate spectra at finer wavelength intervals than the native sensor. These results suggest the potential of SSRON and establishes operator learning as a promising direction for spectral super-resolution.

0.32

Deep Learning for Forest Plantation Mapping in Godavari Districts of Andhra Pradesh, India

eess.IV cs.LG ·2026-10-14 ·Snehal More, Anuj Karpatne, Valerie A. Thomas, Randolph H. Wynne
published similarity 0.61
Abstract

Small-area forest plantations play a vital role in the socioeconomic well-being of farmers in Southeast Asia. Most plantations are established on former agricultural land, often on land less suitable for agriculture. Plantations that are converted from natural forest have adverse impacts on biodiversity. Mapping small-area plantations is thus important to understand the dynamics of forest cover in Southeast Asia and to study the social, economic, and ecological effects of this important land cover and land use change. While the small size of forest plantations makes it difficult to detect them using moderate resolution satellite sensors, the problem is exacerbated by the high degree of mixing between plantations, surrounding vegetation, and other land covers, which often show variegated responses in satellite signals across space and time. In this paper, we study the problem of mapping small-area forest plantations in East and West Godavari districts of Andhra Pradesh, India using deep learning methods. Remotely sensed cloud-free data from the Harmonized Landsat Sentinel-2 S10 product were classified using a pixel-level neural network and training data labeled using a field-based survey in concert with expert aerial photo interpretation. We compare the performance of deep learning methods with a baseline random forest classifier in our study region of 21543 sq. km over a period of 3 years and analyze the differences in the results across land cover classes and seasons.

0.29

Model-based neural network for global floodplains analysis

cs.CV ·2026-11-16 ·Pierre Audisio, Barbara Belletti, Nelly Pustelnik
similarity 0.60
Abstract

We address the super-resolution of multispectral remote sensing imagery for long-term floodplain monitoring, enhancing Landsat acquisitions towards Sentinel-2 resolution. Exploiting the period during which both missions observed the same areas, we build DLhasa-L2S , to our knowledge the first paired dataset dedicated to multispectral super-resolution for river analysis. It covers the Lhasa River (Tibet), whose strong anthropogenic changes and diverse hydromorphological profiles make it an ideal study area. We developed two model-based neural networks: a forward-backward (FB) plug-and-play scheme and an unfolded FB scheme. We compared them against learned neural networks baselines (SwinIR, RDN) on synthetic data, on real scenes, and through a statistical test over the whole real paired Landsat-Sentinel dataset. The unfolded network achieves the highest PSNR and SSIM on the real RGB components with fast inference, offering the best trade-off between accuracy and computational cost. For NDWI-based water segmentation, its performance shows no statistically significant difference from that of the best methods.

0.21

GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations

cs.CV ·2026-09-26 ·Jeonghyeok Do, Munchurl Kim
code/data similarity 0.60
Abstract · Please visit our project page https://kaist-viclab.github.io/GeoCR_site/

Cloud removal methods are typically specialized to individual datasets and input configurations, limiting reuse across sensors, spectral bands, and observation settings. We introduce GeoCR, a generalist model that unifies RGB-only-based CR and multispectral-based CR from single- or multi-temporal cloudy observations, with optional SAR guidance, within a single network. To accommodate different spectral and sensing domains, compact input and output stems extend a pretrained RGB autoencoder while keeping its encoder and decoder trunks frozen. This shared latent interface enables a single flow transformer to jointly model clean RGB and non-RGB latents, conditioned on separate cloudy-observation streams and optional SAR tokens. Through joint pretraining on the training splits of ten datasets comprising 883,331 cloud-free target images, GeoCR learns a shared cloud removal prior across these heterogeneous configurations. The same pretrained checkpoint supports direct inference without dataset-specific fine-tuning and efficient adaptation through low-rank adaptation (LoRA). We evaluate GeoCR against general image restoration and cloud removal methods on test splits of the contributing datasets under full-band and RGB-only settings. GeoCR achieves the best FID and DISTS on full-band SEN12MS-CR and Sen2_MTC_New and RGB-only CUHK-CR2, outperforming existing models and demonstrating the effectiveness of a reusable generative model across diverse settings.

0.35

Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling

cs.LG physics.ao-ph ·2026-08-12 ·Pedro Sousa, Will Tebbutt, Sadiq Jaffer, Robin Young, Anil Madhavapeddy +1 more
similarity 0.59
Abstract · 46 pages, 13 figures, 9 tables

Global weather reanalyses and forecasts resolve the evolving atmospheric state on coarse grids, but site-specific applications require predictions at arbitrary locations where near-surface conditions also depend on unresolved terrain and land-surface properties. Existing probabilistic downscalers address this gap using hand-crafted topographic and surface descriptors. We ask instead whether Earth observation foundation models can provide transferable subgrid surface representations for probabilistic weather downscaling. We augment a convolutional conditional neural process (ConvCNP) that downscales coarse ERA5 reanalysis fields at ~25 km resolution with a learned local surface descriptor, obtained by compressing a patch of TESSERA embeddings at 10 m resolution. Although these embeddings summarize annual surface conditions, they improve downscaling by encoding persistent surface properties that capture a location's departure from the coarse-grid atmospheric state. Across five climatically diverse regions, the embedding improves point and probabilistic skill at stations held out in both space and time, overall improving CRPS skill by 11.5% for 2 m temperature and 6.2% for 10 m wind speed relative to a topography-only ConvCNP baseline. A hand-crafted descriptor incorporating richer surface information than topography alone captures comparable persistent subgrid signal but yields far smaller predictive gains than the learned embedding representation. These improvements persist when forecasts from the Aurora AI model replace ERA5 reanalysis fields and when predicting at newly deployed weather station networks. To our knowledge, this is the first evidence that long-timescale Earth observation embeddings can support short-timescale weather downscaling where subgrid departures are systematically structured by persistent surface properties.

0.46

DPSF-Net: A Dual-Prior Spatial-Frequency Network for Real-World Remote Sensing Image Dehazing

cs.CV cs.AI ·2026-09-07 ·Mei Lu, Shangliang Shao, Shanliang Yao
benchmark similarity 0.58
Abstract

Real-world remote sensing image dehazing (RSID) remains challenging because atmospheric scattering, spatially non-uniform haze and colour distortion jointly degrade structural and spectral information. Most deep learning methods rely on RGB inputs and spatial-domain feature extraction, which limits their ability to separate global background haze from local surface details. Here, we propose DPSF-Net, a dual-prior spatial-frequency network built on MCAF-Net for real-world RSID. The network uses hazy RGB images and dark channel prior (DCP) maps as joint inputs, allowing physical degradation cues to guide end-to-end feature learning. A spatial-frequency residual interaction block introduces a FourierUnit branch into multi-directional spatial interaction to model large-scale haze components. A prior-guided feature attention module adaptively fuses prior and attention features to reduce colour shift and structural distortion. A selective kernel complementary fusion module screens multi-scale skip features through bidirectional residual complementary gating and selective kernel fusion. Extensive experiments demonstrate that DPSF-Net achieves state-of-the-art performance on the real-world RRSHID remote sensing image dehazing benchmark and remains competitive across multiple synthetic datasets. Moreover, the proposed method strikes a favourable balance among restoration quality, parameter count and computational complexity, supporting the effectiveness of dual-prior spatial-frequency modelling.

0.22

Deep Learning for Atmospheric Turbulence Mitigation: A Comparison Between GANs and Transformers

eess.IV cs.CV ·2026-10-13 ·Juan S. Carrillo, Jérôme Gilles
publishedhot direction similarity 0.58
Abstract · Published in the Journal of Electronic Imaging

Atmospheric turbulence creates complex spatial and temporal distortions that significantly reduce image quality. This work compares two deep learning methods for turbulence reduction: Generative Adversarial Networks (GANs) and Transformer-based models. Both methods are trained and tested on the SOTIS dataset, which includes multi-frame sequences under different turbulence conditions with ground truth references. Our results show an important finding: GAN-based models perform better in severely degraded, low-quality situations, while Transformer-based models achieve better results in moderate to high-quality settings, especially in correcting geometric distortions. We also enhance the Turbulence Mitigation Transformer (TMT) by introducing a refined training strategy, an augmented input design that includes a temporally averaged frame as prior structural information, and a modified loss function that incorporates the Structural Similarity Index (SSIM). These improvements lead to consistent performance gains across various turbulence conditions. Overall, this study provides an in-depth evaluation of deep learning methods for turbulence reduction and offers practical guidance for selecting models in different imaging environments.

0.44