CS Paper Radar

Efficient probabilistic weather forecasting at quarter-degree resolution with two-sided transport attention

Junu Choi, Youngjoon Hong

cs.LG ·submitted 2026-10-26 14:53 UTC · v1

Abstract

High-resolution probabilistic weather forecasting remains computationally demanding. Here we present Astra, a 0.25$^\circ$ ensemble model trained on eight H200 GPUs. It combines Kantorovich Attention, a two-sided transport attention in which each region chooses where it reads from and writes to, so every region sends and receives at token resolution, with a self-featurised continuous ranked probability score (CRPS) that also scores forecasts in the model's multiscale features. In WeatherBench 2, Astra matches GenCast's CRPS averaged over five upper-air targets and days 1-10 with 9.8% of its hardware-normalised training compute. Verified against ERA5, its CRPS and ensemble-mean root-mean-square error are lower than the ECMWF ensemble's on all 600 variable, level and lead-time combinations, and its CRPS is lower than GenCast's on 73.5% of them. A 15-day member needs 39 times fewer floating-point operations than GenCast's GPU implementation, and 50 members take under 40 min on one consumer GPU, within 21 GB.

Comment
32 pages, 6 figures, 7 Extended Data figures, 1 Extended Data table

Closest papers

Nearest neighbours by meaning across the whole index.

Sonny-ENS: demystifying machine-learning ensemble weather forecasting

cs.LG physics.ao-ph ·2026-11-01 ·Minjong Cheon
similarity 0.75
Abstract · 25 pages, 6 figures, 7 Extended Data figures and 3 Extended Data tables; Supplementary Information (4 figures, 2 tables) included

Every weather forecast is uncertain, and decisions from flood warnings to energy trading depend on how well that uncertainty is quantified. Machine-learning (ML) ensembles now quantify it better than the best physics-based ensemble, yet two things about them remain opaque: whether their skill requires hundreds to thousands of accelerator-days of training, and how a network with a simple source of randomness produces a spread that follows the flow. Here we introduce Sonny-ENS, an ensemble of three 68.9-million-parameter networks with Monte Carlo dropout, trained on the continuous ranked probability score (CRPS) in 2.7 A40 GPU-days. On 2022, it has a lower CRPS than the European Centre for Medium-Range Weather Forecasts ensemble (ENS) on 96% of 570 targets and an 8.3% lower mean CRPS at lead times of 1-10 days. It outperforms the operational GenCast on 69% of the targets, and a 51-member, 15-day forecast takes 69 s on one GPU. Ablations identify the ingredients of this skill, and a Kolmogorov-Arnold sparse autoencoder shows that dropout injects uncertainty mainly in the tropics, whereas the spread grows where the atmosphere is baroclinically unstable (spatial correlation 0.91 with the Eady growth rate). Skillful probabilistic weather forecasts are therefore within reach of a single GPU server.

0.35

Methodological Changes to the Attention ResUNet Hourly Precipitation Postprocessor

cs.LG physics.ao-ph ·2026-09-29 ·Thomas M. Hamill
similarity 0.68
Abstract

This note is a technical companion to a previously published preprint describing an Attention Residual U-Net that postprocesses deterministic forecasts from The Weather Company's Global and Regional Atmospheric Forecast (GRAF) model into probabilistic hourly precipitation forecasts. It documents what has changed in that method since publication. Feature-wise Linear Modulation conditioning on calendar season and forecast lead time is used to produce a single trained model for each season, replacing 192 separately trained per-month, per-lead checkpoints. Lead time is extended from 48 to 72 h. Two new input channels are used, per-pixel local solar hour and a static, monthly-varying precipitation climatology. During verification, the climatological reference against which the Brier Skill Score is computed now has an added diurnal dimension, on top of the monthly resolution it already had. Brier Skill Score and reliability are compared between the new vs. the previous training. Forecasts generated with the new training show a modest, consistent improvement of the current training over the original.

0.38

Half-precision inference of AI weather prediction models: negligible loss of skill at a fraction of the cost

cs.LG physics.ao-phcs.PF ·2026-11-06 ·Stefan Siegert
code/data similarity 0.67
Abstract · 40 pages, 15 figures, 9 tables. Code: https://github.com/sieste/ai-nwp-fp16

AI weather prediction models are released with 32-bit (fp32) weights and run in fp32 by default, although current GPUs compute much faster in 16-bit formats. We run five publicly available models -- Aurora, Pangu-Weather, FourCastNet, SFNO and FastNet -- on a single 16 GB GPU from 52 initial dates in 2024, in fp32 and with their networks in half precision (fp16), and verify the forecasts against ERA5. The physical state must stay in fp32: converting the whole model rounds it in physical units, which in fp16 overflows and in bf16 discards meaningful information. With the state, its normalisation and denormalisation in fp32, running the network in fp16 changes the global RMSE by at most 1.4%, and by about 0.5% or less for four of the five models, equivalent to less than one hour of lead time up to day 8 and at most two hours at day 10. The differences show no systematic pattern by region, scale or for tropical and extratropical storms, apart from a small tropical penalty in FourCastNet, and fp16 leaves the CRPS, spread and calibration of Aurora's ensemble almost unchanged. No value overflowed fp16's numeric range (+/-65,504); the largest stay 38 to 544 times below it. A 10-day forecast in fp16 is 1.3-3.5 times faster than in fp32 and uses 1.4-3.7 times less energy. Sensitivity experiments show that rules of thumb from other applications of reduced precision carry over only partly: the first and last layers dominate for some models but not for others, and no type of layer is sensitive on its own. For running AI weather models on a single GPU, fp16 with the state in fp32 is practically lossless at a fraction of the cost. bf16, often preferred for its wider range, is as fast but less accurate than fp16 for every model, and simple 8-bit quantisation costs far more skill.

0.28

WeatherDreamer: Learning a World Model from Multimodal Earth Observations

cs.LG physics.ao-ph ·2026-11-13 ·Kate Duffy, Elise Penn, Tristan Ballard, August Posch, Thomas J. Vandal
similarity 0.66
Abstract

Machine learning weather models now rival operational global forecasts but still start from analyses produced by separate, expensive data assimilation (DA) systems, which for global models are typically updated every six hours. Observation-to-observation models avoid this dependence, but most omit the recursive filtering cycle that lets DA systems carry a background state through sparse, irregular observations. We introduce WeatherDreamer, a world model that learns this cycle end-to-end from 18 global observing systems, without reanalysis. It infers a latent state from observations, carries it forward hour by hour with learned dynamics, corrects it each hour with new observations, and can predict what any of its observing systems would measure at any location. At held-out stations, its ensembles beat NOAA's Global Ensemble Forecast System (GEFS) for temperature, dew point and wind out to 12 h and are better calibrated than GEFS and the ECMWF ensemble. Precipitation, cloud-top height and solar irradiance, never inputs at inference, are inferred with skill matching or exceeding operational products at short leads. Against the first guess of NOAA's Gridpoint Statistical Interpolation (GSI) DA system, WeatherDreamer's short-range departures are within 10% of GSI's at surface stations and within 25% for moisture-sensitive microwave channels, but up to five times larger for temperature-sounding channels. Never given observation errors, its learned update assumes errors close to known instrument and retrieval errors of microwave sounders and scatterometer winds. WeatherDreamer also separates viewing geometry from atmospheric state, recovering 83-96% of observed limb darkening and producing seamless nadir-view imagery. Producing an hourly global analysis in about 1.5 minutes on one GPU, WeatherDreamer shows that assimilation and forecasting can be learned together directly from observations.

0.09

Uncertainty-Aware End-to-End AI Weather Forecasting: Disentangling Observation and Model Contributions

cs.LG physics.ao-ph ·2026-08-31 ·Rodrigo Almeida, Noelia Otero, Jost Arndt, Simon Baur, Wojciech Samek +1 more
similarity 0.65
Abstract · 25 pages, 16 figures

End-to-end weather forecasting systems produce skillful global gridded and station forecasts directly from raw Earth observations, replacing the numerical weather prediction pipeline, including data assimilation, at a fraction of its cost. These systems are deterministic and issue no uncertainty. Here we render the Aardvark Weather model probabilistic by attaching one stochastic mechanism to each component: learned, input-dependent noise at the observation encoder, aimed at the uncertainty inherited from the observing system, and Monte Carlo dropout in the processor, aimed at the uncertainty of the learned dynamics. The resulting nested ensemble attributes forecast spread to the two sources through a law-of-total-variance decomposition, cross-checked by withholding observation streams. Probabilistic finetuning significantly improves the mean forecast, by 11% on average across variables and lead times. The ensemble is close to calibrated against ERA5 through the medium range, is at least as accurate as the deterministic model at weather stations while beating it in relative economic value at every lead time, and remains considerably behind the operational ECMWF IFS ensemble. The encoder branch behaves as observation-driven uncertainty. Component-attributed uncertainty makes end-to-end forecasts more transparent, a step toward observation-driven digital twins of the atmosphere.

0.22

TaiJi: State-Conditional Adaptive Combination of Machine-Learning and Physics-Based Global Weather Forecasts

cs.CE ·2026-09-25 ·Jiale Wang, Yining Li, Guihua Wang
similarity 0.64
Abstract · 45 pages, 11 figures, 2 tables. Revised: global precipitation verification; new TaiJi-TC section on tropical-cyclone track and landfall fore…

Machine-learning weather models now rival or surpass operational numerical weather prediction (NWP), yet no single model dominates across variables, pressure levels, lead times, or regions, and the returns from ever-larger individual models are diminishing. We present TaiJi (after the yin-yang concept of complementary opposites), a spatiotemporal adaptive ensemble framework that recasts optimal model-weight combination as a learned prediction problem: a lightweight convolutional neural network, conditioned on the recent atmospheric state, predicts at every grid point and lead time affine combination weights and an additive residual for the constituent forecasts. The combiner is trained end-to-end over Pangu-Weather, GraphCast, FuXi, IFS-HRES, and the IFS-ENS ensemble mean, a hybrid set of ML and NWP constituents, at less than a tenth of the cost of training any of its ML constituents. Under the WeatherBench 2 protocol (2020 test year), TaiJi outperforms the strongest baseline in nearly every combination of the eight core variables, lead times up to 10 days and two skill metrics (RMSE and ACC), and this advantage extends to heavy-precipitation extremes. The same state-conditional principle transfers to tropical-cyclone track forecasting: by fusing constituent tracks rather than gridded fields, TaiJi-TC reduces track error relative to the equally weighted multi-model consensus at lead times up to 96 h, by about 10% at 36 h, halves the slow along-track bias shared by all constituents up to 60 h, and lowers landfall position error by 13-15% at 60-84 h. The learned weights vary coherently with latitude, season and lead time rather than following a fixed rule. TaiJi thus offers an inexpensive route to better global forecasts that builds on, rather than replaces, existing forecast models.

0.23

WeatherNext 3: Increasing resolution and performance of global weather models with raw observations

cs.LG ·2026-09-03 ·Stephan Rasp, Boris Babenko, Dominic Masters, Andrew El-Kadi, Samier Merchant +20 more
similarity 0.64
Abstract

State-of-the-art AI weather models have shown impressive medium-range forecast skill and computational efficiency, but suffer two key shortcomings: their forecasts have lower spatial and temporal resolution than the best physics-based models and they are exclusively initialized with and trained on analysis data. As a result, they cannot directly make use of observations, and any biases in the analysis are inherited by the forecast. WeatherNext 3 addresses these shortcomings and establishes a new state-of-the-art for probabilistic medium-range forecasting skill. First, WeatherNext 3 generates new forecasts every hour (rather than every 6 hours like traditional global models) by ingesting low-latency geostationary satellite data. Second, WeatherNext 3's temporal and spatial resolution are on par with physics-based global models, with hourly time steps and 0.1 degree resolution for single-level variables, including solar radiation and cloud cover. Third, WeatherNext 3 moves beyond traditional analysis variables by learning to predict satellite-derived precipitation estimates, as well as tropical cyclone and station observations. Modelling sparse station data allows WeatherNext 3 to make 2m temperature and dewpoint predictions at any location and time, conditioned on local geographical features, with substantially lower error than competing global models, even when evaluated against unseen stations. Together, WeatherNext 3's capabilities move operational AI-based weather forecasting beyond emulating the traditionally distinct stages of data assimilation, forecasting and post-processing, which helps to further push the frontier of performance and granularity for global weather prediction.

0.36

TC-Next: Zero-Shot Multimodal Cyclone Forecasting

cs.LG cs.AIcs.CV ·2026-09-02 ·Zhe Wang, Sijie Chen, Yiming Luo, Daehyun Kim, Chien-Yi Chang
published similarity 0.64
Abstract · 4 pages; Accepted to NeurIPS 2026 Tackling Climate Change with Machine Learning Workshop

We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6-24$h leads by leveraging a foundation model's forecast of atmospheric kinematic and thermodynamic fields, along with GridSat infrared satellite imagery. Trained only on GraphCast forecasts over the Western Pacific (WP), yet reliant only on generic atmospheric variables, TC-Next on GraphCast lowers track error by $15-44\%$ and intensity error by a factor of $3-6$ relative to the rule-based tracker TempestExtremes; applied without retraining to Pangu-Weather and IFS HRES forecasts, it stays ahead on both. Applied zero-shot to the generic weather fields of WeatherNext Cyclones on the 2025 WP season, it attains lower average intensity error at every lead time, and lower or comparable average track error, than that model's specialized direct tracker in a deterministic comparison. Ablations show that the satellite branch lowers track error at every lead time and intensity error at longer leads. TC-Next thus gives a common, independently verifiable basis for comparing the AI forecasts that inform cyclone-warning and climate-adaptation decisions as best available science.

0.35