CS Paper Radar

Tropical Cyclone Wind Field Diagnosis with Image-to-Image Models

Sarah J. Ollier, David S. Nolan, Brian D. McNoldy, Eduardo Siman

cs.CV physics.ao-ph ·submitted 2026-10-07 13:51 UTC · v1

Abstract

This study presents a novel application of image-to-image generative adversarial networks (GANs) to produce a complete tropical cyclone (TC) surface wind field diagnosis from a single frame of satellite infrared brightness temperature (IR). Because TC surface wind fields are infrequently observed, we train on two data sets. The first contains 3,323 image pairs of IR and wind fields from Weather Research and Forecasting Model (WRF) simulations (WRF2WRF). The second contains 11,886 real IR satellite images paired with parametric wind fields built on the extended best-track data set (IBTrACS) of TC intensities and wind radii (GOES2PARA). Both models, conditioned on storm intensity, motion, and latitude, transform single-channel IR into wind fields over 6$^{\circ} \times$ 6$^{\circ}$ (WRF2WRF) and 7$^{\circ} \times$ 7$^{\circ}$ (GOES2PARA) domains, at 256 $\times$ 256 pixel resolution. GOES2PARA captures outer wind field asymmetries, enabling diagnosis of 64, 50, and 34-knot wind radii (R64, R50, R34) in each quadrant. WRF2WRF also produces detailed rainbands and eyewall asymmetries. Pixel-wise RMSE against held out truth demonstrates realistic wind field generation with mean RMSE of 6.4 knots (GOES2PARA) and 7.2 knots (WRF2WRF). Compared against IBTrACS, WRF2WRF achieved mean absolute errors (MAE) of 14.8 nautical miles (NM) for radius of maximum wind (RMW) and 25.9 NM for R34. GOES2PARA achieved 10.0 NM MAE for RMW and 25.9 NM for R34. Against Synthetic Aperture Radar wind fields GOES2PARA yielded a lower mean pixel-wise error (RMSE 12.1 kt, MAE 9.5 kt) than WRF2WRF (RMSE 13.9 kt, MAE 11.3 kt). Unlike many existing operational surface wind speed algorithms, our image-to-image models provide updated wind fields with every new satellite image.

Comment
Preprint prior to peer review. Submitted to Artificial Intelligence for the Earth Systems on 8th September 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Nowcasting of Tropical Cyclone Wind Fields and Intensity from Geostationary Imagery

cs.LG ·2026-11-05 ·Simon Donike, Pritthijit Nath, Cristina Radin, Arthur Avenas, Ruben Cartuyvels +3 more
published similarity 0.68
Abstract · Accepted for poster presentation at the NeurIPS 2026 workshop on Tackling Climate Change with Machine Learning. 7 pages, 4 figures

High-resolution tropical cyclone surface wind speeds derived from synthetic aperture radar (SAR) observations can support storm structure and intensity modelling, but remain spatially and temporally sparse and unavailable near-real-time. Geostationary satellites capture cloud tops continuously in space and time, but do not directly resolve surface winds. Here, we present simple neural networks to predict 2D wind fields and storm-scale intensity metrics from geostationary imagery. Through a series of ablation studies, we find that joint prediction of 2D fields and scalar metrics from the model latent space improves the retrieval of the (radius of) maximum wind, especially for rapid intensification events.

0.26

TyphoonWorld: A Residual Token World Model for Probabilistic Forecasting of Typhoon Imagery

cs.CV cs.LG ·2026-11-11 ·Xiaoyu Chen, Tianyi Li, Xuanyi Zhang
similarity 0.65
Abstract · 15 pages, 3 figures, 7 tables

A satellite forecast of a typhoon should give a low-error picture of the next two days, together with an ensemble whose members are coherent fields and whose spread responds to the storm at hand. A small direct regression network already gives the lowest squared error on held-out storms, so a generative model has to earn its cost through the part of the future that the regression smooths away. We present TyphoonWorld, a discrete-token world model that generates only that part. Conditioned on tokens of the regression forecast, the latest frames and the best-track state at forecast time, it samples residual fields lead by lead, and members add these residuals to the regression center. We compare it under one protocol with per-pixel Gaussian networks, a diffusion model of the same residuals, residuals from other storms and an unconditional token world model, on 276 forecast windows from 46 held-out storms of Digital Typhoon. TyphoonWorld matches the squared error of the regression, lowers the CRPS of the area colder than 220 K, a direct measure of deep convection, by 14 to 39% against every other ensemble, and ties its spread to forecast error as closely as the Gaussian network, with a correlation of 0.78 across windows. It uses 56% of the parameters of the unconditional world model.

0.12

TC-Next: Zero-Shot Multimodal Cyclone Forecasting

cs.LG cs.AIcs.CV ·2026-09-02 ·Zhe Wang, Sijie Chen, Yiming Luo, Daehyun Kim, Chien-Yi Chang
published similarity 0.63
Abstract · 4 pages; Accepted to NeurIPS 2026 Tackling Climate Change with Machine Learning Workshop

We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6-24$h leads by leveraging a foundation model's forecast of atmospheric kinematic and thermodynamic fields, along with GridSat infrared satellite imagery. Trained only on GraphCast forecasts over the Western Pacific (WP), yet reliant only on generic atmospheric variables, TC-Next on GraphCast lowers track error by $15-44\%$ and intensity error by a factor of $3-6$ relative to the rule-based tracker TempestExtremes; applied without retraining to Pangu-Weather and IFS HRES forecasts, it stays ahead on both. Applied zero-shot to the generic weather fields of WeatherNext Cyclones on the 2025 WP season, it attains lower average intensity error at every lead time, and lower or comparable average track error, than that model's specialized direct tracker in a deterministic comparison. Ablations show that the satellite branch lowers track error at every lead time and intensity error at longer leads. TC-Next thus gives a common, independently verifiable basis for comparing the AI forecasts that inform cyclone-warning and climate-adaptation decisions as best available science.

0.35

Deep Learning for Atmospheric Turbulence Mitigation: A Comparison Between GANs and Transformers

eess.IV cs.CV ·2026-10-13 ·Juan S. Carrillo, Jérôme Gilles
publishedhot direction similarity 0.63
Abstract · Published in the Journal of Electronic Imaging

Atmospheric turbulence creates complex spatial and temporal distortions that significantly reduce image quality. This work compares two deep learning methods for turbulence reduction: Generative Adversarial Networks (GANs) and Transformer-based models. Both methods are trained and tested on the SOTIS dataset, which includes multi-frame sequences under different turbulence conditions with ground truth references. Our results show an important finding: GAN-based models perform better in severely degraded, low-quality situations, while Transformer-based models achieve better results in moderate to high-quality settings, especially in correcting geometric distortions. We also enhance the Turbulence Mitigation Transformer (TMT) by introducing a refined training strategy, an augmented input design that includes a temporally averaged frame as prior structural information, and a modified loss function that incorporates the Structural Similarity Index (SSIM). These improvements lead to consistent performance gains across various turbulence conditions. Overall, this study provides an in-depth evaluation of deep learning methods for turbulence reduction and offers practical guidance for selecting models in different imaging environments.

0.44

Digital Typhoon Dataset V3: Benchmarking for Multi-spectral Extension and Analyzing Systematic Bias in Intensity Regression

cs.CV ·2026-10-15 ·Asanobu Kitamoto, Victor Le Louarn, Noelia Falczuk, Ngoc Anh Tong, Anja Veleva
benchmarkcode/data similarity 0.63
Abstract · 23 pages, 6 figures, dataset paper

This paper presents the Digital Typhoon Dataset V3, a new version of the longest typhoon satellite image dataset spanning nearly 50 years, designed to benchmark machine learning models on long-term spatio-temporal data. The latest addition to Dataset V3 is multispectral satellite data, enabling multi-channel models. We investigate data-splitting strategies and present benchmarking results for the Northern and Southern Hemispheres. Experimental results show that, under the current dataset construction and experimental setting, multi-channel inputs do not clearly outperform single-channel inputs for pressure regression. Among the evaluated model architectures, image types, and spectral channels, ResNet-18, full-resolution images, and Channel 1 generally provide the best single-channel performance for pressure regression. Performance also differs between the WP and AU datasets by regression target, with lower RMSE on WP for pressure regression and on AU for wind regression. These results highlight the importance of considering dataset-specific and task-specific characteristics when interpreting benchmark performance. Additionally, we analyzed systematic bias in intensity regression, which leads to underestimation of intensity for strong typhoons. We tested imbalance-aware weighting strategies, including inverse-density weighting inspired by BalancedMSE, and showed that these approaches are not sufficient to remove the bias. The dataset is publicly available at http://agora.ex.nii.ac.jp/digital-typhoon/dataset/ and https://github.com/kitamoto-lab/digital-typhoon/.

0.37

Synthetic Data Augmentation for Satellite-Based Analysis of Battle-Damaged Agricultural Fields in Ukraine

cs.CV cs.AI ·2026-08-17 ·Marta Sumyk, Oleksandr Kosovan, Iryna Voitsitska
similarity 0.60
Abstract

Monitoring war-induced damage to agricultural land in Ukraine is important for understanding threats to food security, environmental stability, and post-war recovery. However, the development of computer-vision systems for satellite-based damage analysis is limited by the scarcity of labeled imagery, especially for damaged agricultural fields. This work investigates synthetic data augmentation as a method for improving classification under limited and imbalanced training data. We train class-conditional Generative Adversarial Network (GAN) and Denoising Diffusion Probabilistic Model (DDPM) architectures on real satellite images and use them to generate additional bombed and not-bombed agricultural-field samples. The generated images are used only for training augmentation, while all downstream evaluation is performed on an exclusively real test set. A Vision Transformer classifier is trained under multiple real and synthetic data configurations to measure the practical utility of each generative approach. The best configuration, based on balanced DDPM augmentation, improves accuracy from 84\% to 88\%, balanced accuracy from 67\% to 81\%, macro F1 from 65\% to 78\%, and recall for the underrepresented not-bombed class from 41\% to 69\%. These results demonstrate the potential of synthetic satellite imagery for data-scarce geospatial applications in war-affected regions.

0.19

GenONet: A Generative operator Network for High-Resolution Precipitation Nowcasting

cs.LG physics.ao-ph ·2026-09-01 ·Mohammad Kian Golkar, Luciano Alves de Oliveira, Mohammad Khanjani
similarity 0.60
Abstract · 28 pages, 11 Figures

High-resolution precipitation nowcasting is critical for reducing the impacts of severe weather but remains difficult because of rapid storm evolution. Deep learning models have shown great promise for this task, but their predictive skill often deteriorates over longer forecast horizons. This leads to increasingly blurry forecasts that fail to capture the complex, non-linear evolution of storm systems. In order to address these limitations, we introduce Spatio-Temporal U-DeepONet (GenONet), a novel architecture for long-range precipitation forecasting up to 3 hours, specifically designed to produce sharp and physically consistent results. GenONet's architecture pioneers the use of a Deep Operator Network (DeepONet) as a generator within a Generative Adversarial Network (GAN) framework for this task. The DeepONet learns the continuous-time dynamics of precipitation, ensuring stability over long forecast horizons. Adversial training against a spatio-temporal discriminator compels the model to produce sharp, coherent forecasts, while a physics-informed loss regularizer, derived from the Moisture Conservation Equation, improves physical plausibility in our ablation setting. Quantitative evaluations show that our model achieves consistently higher scores on most of the metrics, especially for highintensity events and at longer lead times. Qualitatively, GenONet produces structurally coherent forecasts that maintain their integrity, whereas baseline models degrade into indistinct patterns. Finally, an ablation study confirms the benefit of this physics-informed loss, highlighting the strength of combining operator learning with adversarial training.

0.29

SWIR-cGAN: Synthesizing SWIR Bands Using VNIR Imagery from CBERS and AMAZONIA-1

cs.CV ·2026-11-17 ·Alisson Cleiton de Oliveira, Rennan de Freitas Bezerra Marujo, Thales Sehn Körting
publishedcode/data similarity 0.60
Abstract · Available on: https://ieeexplore.ieee.org/document/11793642. Early Access

Spectral band synthesis is an important research topic in remote sensing. The Brazilian satellites CBERS-4, CBERS-4A, and AMAZONIA-1 provide high temporal resolution (1-3 days) visible and near-infrared (VNIR) imagery through the Wide-Field Imager (WFI), but lack short-wave infrared (SWIR) bands. Recent deep learning methods have shown promising results for spectral synthesis, but challenges remain for cross-satellite generalization and spectrally distant bands. This paper presents a conditional Generative Adversarial Network (cGAN) with an attention-enhanced U-net generator and a multi-loss objective to synthesize Sentinel-2/MSI SWIR bands 11 (SWIR-1) and 12 (SWIR-2) from WFI VNIR inputs. Experiments used 4,125 patches for training and cross-validation and 1,026 unseen patches for testing, with hyperparameters optimized using a subset of the training data. On SWIR-1, the model achieved SSIM of 0.900, PSNR of 31.44 dB, and MAE of 0.019 in TOA reflectance. On SWIR-2, it achieved SSIM of 0.917, PSNR of 33.35 dB, and MAE of 0.015. Benchmarking was performed on the test dataset, with each model optimized separately prior to evaluation. SWIR-cGAN outperformed the baselines, particularly for SWIR-2. The ablation study identified the multi-loss as the main performance contributor, while the attention and residual modules provided additional improvements. Our results demonstrate the feasibility of synthesizing SWIR bands from WFI imagery. The SWIR-cGAN is available at https://github.com/marujore/swir-cgan.

0.61