CS Paper Radar

Digital Typhoon Dataset V3: Benchmarking for Multi-spectral Extension and Analyzing Systematic Bias in Intensity Regression

Asanobu Kitamoto, Victor Le Louarn, Noelia Falczuk, Ngoc Anh Tong, Anja Veleva

cs.CV ·submitted 2026-10-15 10:33 UTC · v1
benchmarkcode/data

Abstract

This paper presents the Digital Typhoon Dataset V3, a new version of the longest typhoon satellite image dataset spanning nearly 50 years, designed to benchmark machine learning models on long-term spatio-temporal data. The latest addition to Dataset V3 is multispectral satellite data, enabling multi-channel models. We investigate data-splitting strategies and present benchmarking results for the Northern and Southern Hemispheres. Experimental results show that, under the current dataset construction and experimental setting, multi-channel inputs do not clearly outperform single-channel inputs for pressure regression. Among the evaluated model architectures, image types, and spectral channels, ResNet-18, full-resolution images, and Channel 1 generally provide the best single-channel performance for pressure regression. Performance also differs between the WP and AU datasets by regression target, with lower RMSE on WP for pressure regression and on AU for wind regression. These results highlight the importance of considering dataset-specific and task-specific characteristics when interpreting benchmark performance. Additionally, we analyzed systematic bias in intensity regression, which leads to underestimation of intensity for strong typhoons. We tested imbalance-aware weighting strategies, including inverse-density weighting inspired by BalancedMSE, and showed that these approaches are not sufficient to remove the bias. The dataset is publicly available at http://agora.ex.nii.ac.jp/digital-typhoon/dataset/ and https://github.com/kitamoto-lab/digital-typhoon/.

Comment
23 pages, 6 figures, dataset paper

Closest papers

Nearest neighbours by meaning across the whole index.

TyphoonWorld: A Residual Token World Model for Probabilistic Forecasting of Typhoon Imagery

cs.CV cs.LG ·2026-11-11 ·Xiaoyu Chen, Tianyi Li, Xuanyi Zhang
similarity 0.66
Abstract · 15 pages, 3 figures, 7 tables

A satellite forecast of a typhoon should give a low-error picture of the next two days, together with an ensemble whose members are coherent fields and whose spread responds to the storm at hand. A small direct regression network already gives the lowest squared error on held-out storms, so a generative model has to earn its cost through the part of the future that the regression smooths away. We present TyphoonWorld, a discrete-token world model that generates only that part. Conditioned on tokens of the regression forecast, the latest frames and the best-track state at forecast time, it samples residual fields lead by lead, and members add these residuals to the regression center. We compare it under one protocol with per-pixel Gaussian networks, a diffusion model of the same residuals, residuals from other storms and an unconditional token world model, on 276 forecast windows from 46 held-out storms of Digital Typhoon. TyphoonWorld matches the squared error of the regression, lowers the CRPS of the area colder than 220 K, a direct measure of deep convection, by 14 to 39% against every other ensemble, and ties its spread to forecast error as closely as the Gaussian network, with a correlation of 0.78 across windows. It uses 56% of the parameters of the unconditional world model.

0.12

TC-Next: Zero-Shot Multimodal Cyclone Forecasting

cs.LG cs.AIcs.CV ·2026-09-02 ·Zhe Wang, Sijie Chen, Yiming Luo, Daehyun Kim, Chien-Yi Chang
published similarity 0.63
Abstract · 4 pages; Accepted to NeurIPS 2026 Tackling Climate Change with Machine Learning Workshop

We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6-24$h leads by leveraging a foundation model's forecast of atmospheric kinematic and thermodynamic fields, along with GridSat infrared satellite imagery. Trained only on GraphCast forecasts over the Western Pacific (WP), yet reliant only on generic atmospheric variables, TC-Next on GraphCast lowers track error by $15-44\%$ and intensity error by a factor of $3-6$ relative to the rule-based tracker TempestExtremes; applied without retraining to Pangu-Weather and IFS HRES forecasts, it stays ahead on both. Applied zero-shot to the generic weather fields of WeatherNext Cyclones on the 2025 WP season, it attains lower average intensity error at every lead time, and lower or comparable average track error, than that model's specialized direct tracker in a deterministic comparison. Ablations show that the satellite branch lowers track error at every lead time and intensity error at longer leads. TC-Next thus gives a common, independently verifiable basis for comparing the AI forecasts that inform cyclone-warning and climate-adaptation decisions as best available science.

0.35

Tropical Cyclone Wind Field Diagnosis with Image-to-Image Models

cs.CV physics.ao-ph ·2026-10-07 ·Sarah J. Ollier, David S. Nolan, Brian D. McNoldy, Eduardo Siman
similarity 0.63
Abstract · Preprint prior to peer review. Submitted to Artificial Intelligence for the Earth Systems on 8th September 2026

This study presents a novel application of image-to-image generative adversarial networks (GANs) to produce a complete tropical cyclone (TC) surface wind field diagnosis from a single frame of satellite infrared brightness temperature (IR). Because TC surface wind fields are infrequently observed, we train on two data sets. The first contains 3,323 image pairs of IR and wind fields from Weather Research and Forecasting Model (WRF) simulations (WRF2WRF). The second contains 11,886 real IR satellite images paired with parametric wind fields built on the extended best-track data set (IBTrACS) of TC intensities and wind radii (GOES2PARA). Both models, conditioned on storm intensity, motion, and latitude, transform single-channel IR into wind fields over 6$^{\circ} \times$ 6$^{\circ}$ (WRF2WRF) and 7$^{\circ} \times$ 7$^{\circ}$ (GOES2PARA) domains, at 256 $\times$ 256 pixel resolution. GOES2PARA captures outer wind field asymmetries, enabling diagnosis of 64, 50, and 34-knot wind radii (R64, R50, R34) in each quadrant. WRF2WRF also produces detailed rainbands and eyewall asymmetries. Pixel-wise RMSE against held out truth demonstrates realistic wind field generation with mean RMSE of 6.4 knots (GOES2PARA) and 7.2 knots (WRF2WRF). Compared against IBTrACS, WRF2WRF achieved mean absolute errors (MAE) of 14.8 nautical miles (NM) for radius of maximum wind (RMW) and 25.9 NM for R34. GOES2PARA achieved 10.0 NM MAE for RMW and 25.9 NM for R34. Against Synthetic Aperture Radar wind fields GOES2PARA yielded a lower mean pixel-wise error (RMSE 12.1 kt, MAE 9.5 kt) than WRF2WRF (RMSE 13.9 kt, MAE 11.3 kt). Unlike many existing operational surface wind speed algorithms, our image-to-image models provide updated wind fields with every new satellite image.

0.22

Frequency-aware forecasting for short-term typhoon gust prediction

cs.LG ·2026-08-26 ·Xuefei Wang, Tingyi Liu, Heng Zhang, Lei Xu, Shengjun Zhang
similarity 0.62
Abstract

Accurate gust forecasting under typhoon conditions remains challenging due to the highly non-stationary and multi-scale characteristics of extreme wind fluctuations. Existing deep learning models often struggle to simultaneously capture long-term trends and rapid local variations, resulting in degraded performance during extreme events. We propose WDANet, a frequency-aware forecasting framework that integrates stationary wavelet decomposition, a Feature-wise Linear Modulation (FiLM) strategy, and a dual-branch encoder-decoder architecture, enabling separate modeling of trend and fluctuation components. Taking the offshore regions of the Western Pacific in China as an example, we conduct fine-grid wind gust prediction research. The results demonstrate that WDANet shows advantages for short lead times under the experimental setting across a 24-h forecasting horizon and achieves higher prediction accuracy than ECMWF-HRES within the first 6 h. During extreme wind events, WDANet more accurately captures gust peaks and attains the best RMSE and MAE performance. These results highlight its potential for offshore wind power operation, disaster warning, and risk mitigation.

0.21

Nowcasting of Tropical Cyclone Wind Fields and Intensity from Geostationary Imagery

cs.LG ·2026-11-05 ·Simon Donike, Pritthijit Nath, Cristina Radin, Arthur Avenas, Ruben Cartuyvels +3 more
published similarity 0.60
Abstract · Accepted for poster presentation at the NeurIPS 2026 workshop on Tackling Climate Change with Machine Learning. 7 pages, 4 figures

High-resolution tropical cyclone surface wind speeds derived from synthetic aperture radar (SAR) observations can support storm structure and intensity modelling, but remain spatially and temporally sparse and unavailable near-real-time. Geostationary satellites capture cloud tops continuously in space and time, but do not directly resolve surface winds. Here, we present simple neural networks to predict 2D wind fields and storm-scale intensity metrics from geostationary imagery. Through a series of ablation studies, we find that joint prediction of 2D fields and scalar metrics from the model latent space improves the retrieval of the (radius of) maximum wind, especially for rapid intensification events.

0.26

PBLH Estimation from Satellite Radiances via a Dual-Encoder Transformer

cs.CV cs.LG ·2026-09-23 ·Lorenzo Innocenti, Luca Catalano, Edoardo Arnaudo, Claudio Rossi, Salvatore Larosa +2 more
benchmarkcode/data similarity 0.58
Abstract · 13 pages, 3 figures, 2 tables. Extended version of the paper accepted at the MACLEAN workshop, ECML PKDD 2026. Code: https://github.com/link…

Estimating the Planetary Boundary Layer Height (PBLH) from satellite observations is a challenging regression problem due to the indirect relationship between top-of-atmosphere radiances and near-surface atmospheric structure. Progress has been limited both by the lack of architectures capable of handling the multimodal, spatially incomplete nature of satellite overpasses, and by the scarcity of suitable datasets. In this paper, we build upon the large-scale dataset pairing MetOp radiances with ERA5 PBLH labels that we introduced in our previous work, making three contributions. First, we establish a benchmark across eight approaches spanning pixel-wise regression, swath-wise sequence models, and convolutional and Transformer models operating on the full orbital passage. Second, we quantify what the resulting model actually relies on, using grouped Shapley decomposition over the input blocks. Third, we present the best-performing architecture found: a dual-encoder Transformer whose masked-input handling lets it operate in all weather conditions. The proposed model achieves MAE = 155.8 m on the held-out global test set, outperforming all baselines on every evaluation subset. On 30 out-of-distribution granules acquired on two days overlapping the TEAMx observational campaign, it achieves MAE = 165.3 m, outperforming a pixel-wise baseline trained on the same data (MAE = 197 m).

0.44

Tropospheric temperature and humidity profile retrieval from Meteosat Flexible Combined Imager based on deep learning

cs.LG physics.ao-ph ·2026-08-26 ·Alejandro Salgueiro, Johannes Rausch, Julie Thérèse Villinger, Angela Meyer
similarity 0.58
Abstract · 27 pages, 11 figures. Supporting information has 12 pages and 17 figures. Submitted for publication in Journal of Geophysical Research: Atmo…

The Meteosat Third Generation (MTG) Flexible Combined Imager (FCI) offers new opportunities for tropospheric temperature and humidity profiling, at higher spatio-temporal resolutions and expanded spectral coverage relative to its predecessor. Vertically resolved retrievals from broadband imagers are inherently challenging, and operational retrieval algorithms typically rely on numerical weather prediction (NWP) background fields to compensate for limited infrared spectral resolution, reducing the retrievals' independence. We develop a spatially aware deep learning framework to retrieve all-sky tropospheric temperature and humidity profiles from FCI, without forecast profiles as input. A Residual U-Net that exploits spatial context across all 16 FCI channels was trained on 14 months of collocated FCI observations and CERRA reanalysis targets over Europe. Validated against independent radiosondes, retrieved temperatures show biases below 0.4 K and standard deviations of 1.5-1.9 K. Retrieved relative humidity standard deviations range from 12-20 %, compared to 9-19 % for CERRA. Performance degrades modestly under clouds, with standard deviation increases below 0.4 K and 3 % RH beneath cloud tops despite limited direct radiative information. Ablation experiments show that spatial context improves retrievals, with the largest gains below cloud tops. Feature sensitivity analysis indicates broad consistency with FCI bands' established radiative transfer characteristics. Visible and near-infrared channels contribute despite not being commonly used in physics-based profile inversions. These results demonstrate that spatially aware deep learning models can extract statistically reliable tropospheric profiles from geostationary imager observations, independent of NWP forecast fields, enabling more rapid autonomous monitoring of the atmosphere.

0.18

Causal-prior-constrained deep learning for rapid-intensification warning of western North Pacific tropical cyclones

cs.LG physics.ao-ph ·2026-10-29 ·Xinrui Li, Yijun Jin, Yifan Dong, Shoujuan Shu
similarity 0.58
Abstract · 33 pages, including 15 pages of supplementary information; 5 main figures and 6 supplementary figures

Rapid intensification (RI) is one of the most dangerous and unpredictable phases of tropical cyclones, and its environmental and structural drivers are difficult to identify and separate in observations. Here we introduce CausalVisionRI, a causal-prior-constrained deep-learning system for 24-h RI warning in the western North Pacific. It integrates infrared remote sensing imagery, atmospheric and oceanic fields, and an observationally discovered causal graph into a unified model. The graph and eight sign-verified effects on 24-h intensity change provide an auditable causal prior for training. Discovered from 522 cyclones in 2000-2017, it identifies causal pathways linking atmospheric and oceanic conditions, the cyclone's dynamical and structural state, and its 24-h intensity change. On a forward holdout covering 2020-2024 and 3,004 records, the five-member ensemble achieves a Brier skill score (BSS) of 0.259 relative to a fixed development climatology, significantly exceeding four reference systems; the three LDA baselines reach at most 0.105. It also attains higher detection rates than a published knowledge-block scheme and a reconstructed contrastive-learning scheme at matched false-detection rates under our USA 30-kt standard and the published RITCF standard. Ablations show that the graph pathway adds 0.032 BSS across the holdout and 0.063 over 2020-2021, with a significant contribution in one ensemble member. A deep-learning model constrained by observationally discovered causal structure thus offers a new route to physically informed RI warning.

0.26