CS Paper Radar

A joint error metric for scoring CFD against wind tunnel data, scaled by the robust spread of the participants (AutoCFD5 Case 2)

Hendrik Hetmann, Charles Mockett

cs.CE ·submitted 2026-10-08 08:54 UTC · v1

Abstract

AutoCFD5 Case 2 compares the participants' CFD results with wind tunnel measurements of surface pressure, velocity profiles and force coefficients. To place each run on a diagram of error against computational cost, these quantities must be combined into one number. This note defines that number, the joint error. Following the practice of interlaboratory proficiency testing (ISO 13528), every deviation from the experiment is expressed in units of the spread of the participants' results at that point, estimated robustly with the standard's Algorithm A. The point-wise spreads are pooled into one scale per component, so that every measurement point carries equal weight within its component. The joint error is a fixed weighted sum of five component errors. The scales are computed once from all AutoCFD5 submissions received by 5 October 2026 and then frozen, so that scores are reproducible and comparable across workshops.

Closest papers

Nearest neighbours by meaning across the whole index.

A Data Fusion Framework for Grounding Aerospace Surrogate Model via Experimental Wind-Tunnel Observations

cs.LG ·2026-09-02 ·Nitin Nagesh Kulkarni, Dheeraj Vemula, Yin Yu, Peter Lyu, Juan J. Alonso
hot direction similarity 0.50
Abstract

Aerodynamic surrogate models trained on high-fidelity CFD data reproduce numerical predictions of both scalar outputs and entire fields accurately, yet their predictive fidelity is limited by systematic discrepancies between CFD and experimental observations. We present an experimentally grounded correction framework that adapts a CFD-trained deep learning surrogate using wind-tunnel PSP measurements. A Geotransolver surrogate trained on 2,300 high-fidelity CFD simulations of the NASA CRM wing-body configuration, spanning geometric variation, Mach 0.70-0.85, and angles of attack 0 to 4 degrees, reproduces the CFD integrated aerodynamic forces and pitching moment to R2 > 0.99 but does not match the experimental data. To incorporate experimental information without retraining the surrogate, a correction network is trained on spatially registered PSP measurements at two freestream Mach numbers (0.70 and 0.85) across the same angle-of-attack range, learning the discrepancy between the surrogate-predicted and experimentally measured surface-pressure distributions. At Mach 0.85 the correction substantially improves agreement with PSP, particularly at the wing suction peak, shock location, and subsequent pressure recovery, reducing both the magnitude of the prediction error and the fraction of wetted surface on which it exceeds 0.05 in Cp, and it does so from a limited experimental dataset without modifying the pretrained surrogate parameters. On held-out angles of attack the grounded surrogate agrees with measurement to within 2.3-2.7% of the measured Cp range, and outperforms direct interpolation between the measured conditions at every state tested. Experimental measurements can therefore ground a large-scale simulation-trained surrogate by learning systematic CFD-to-experiment discrepancies while preserving its generalization capability and computational efficiency.

0.29

CFD Correction of Open Tip Clearance Flow in a Compressor Cascade Using VAE Latent Space Adaptation

cs.LG ·2026-09-23 ·Xiang Zuo, Hefang Deng, Caiyan Chen, Honglin He, Mingmin Zhu +2 more
unusual similarity 0.50
Abstract

CFD predictions of open tip clearance flow in compressor cascades are subject to discrepancies relative to experiments, while experimental observations are sparse and high-resolution experimental ground truth is unavailable. This study proposes a non-intrusive correction method based on a variational autoencoder (VAE) and latent-space adaptation. A VAE is first trained using a dataset of 166 parametrically sampled CFD total pressure loss fields to learn a low-dimensional statistical representation of these fields. The VAE is then frozen, and a low-rank latent-space adapter is trained using only 12 paired CFD--experiment operating conditions. An observation operator maps the corrected high-resolution fields to the experimental observation space, allowing supervision to be applied only at the available measurement locations and within the measured pitchwise windows. In the current 12-fold cross-validation, the mean absolute error decreases from 0.1335 to 0.0473, the root mean square error from 0.1717 to 0.0621, and the relative $L_2$ error from 0.5108 to 0.1871. These results indicate that the method improves agreement between CFD predictions and sparse experimental observations of open tip clearance flow without modifying the RANS solver or constructing artificial high-resolution experimental labels.

0.26

Does a completed simulation run mean a usable urban wind result for AI agents?

cs.AI ·2026-11-14 ·Zhongke Qu, Yunwei Zhang, Junwei Su, Yabin Zhang, Chengwei Li +3 more
similarity 0.50
Abstract

AI agents based on large language models (LLMs) can now configure and run computational fluid dynamics (CFD) solvers, but a completed run does not ensure that delivered metrics can be recomputed from raw outputs. This gap was examined for urban wind simulation, where multi-case comparisons must hold non-target conditions fixed and reported values must be traceable to raw samples. UrbanWind-AgentBench, comprising 200 tasks and 367 cases in 10 engineering task families, was constructed. Public task contracts specify variable factors, fixed conditions, numerical thresholds and deliverable requirements, and two-layer scoring separates a structural score for deliverables, run provenance and raw evidence from a numerical score obtained by independent recomputation against references. WindPilot was then proposed as an execution framework that incorporates contract parsing, execution provenance, deterministic verification and bounded acceptance review into the LLM execution loop. On 30 OpenFOAM tasks with independent references, at least the structural maximum of 60 points was reached by a base agent on 28 tasks, but numerical credit was obtained on only 6. With the same model name and budget, WindPilot increased the number of tasks with numerical credit to 17, full-score tasks from 0 to 3 and the mean task score from 62.5 to 72.5. Mean action steps fell from 130.4 to 104.9, and mean token consumption decreased by 12.9%. The mean gain for atmospheric boundary layer (ABL) tasks was 18.5 points. A completed simulation run is therefore not sufficient for a usable urban wind result; usability depends on checks that tie reported metrics to raw evidence during execution.

0.33

EnergyBench: a live, gate-aligned benchmark of day-ahead forecasts for European power markets

cs.LG eess.SY ·2026-11-05 ·Evgenii Genov, Ander Martinez Alonso, Christoph Bergmeir
benchmark similarity 0.44
Abstract · 21 pages, 10 figures, 7 tables. Live benchmark at https://energybench.foretec.co

Energy forecasting models are usually compared on backtests and fixed public datasets. Backtests can use data that did not yet exist when the forecast would have been made, and a fixed test set, reused across studies and possibly contained in the pretraining data of foundation models, invites overfitting to the benchmark. EnergyBench evaluates every entry live instead. Each day at 11:30 CET/CEST, thirty minutes before the day-ahead (SDAC) gate closes, every model forecasts the next day's price, wind and solar generation and load on the 15-minute grid for six bidding zones (BE, NL, FR, DE-LU, DK1, DK2). Unlike existing live benchmarks, EnergyBench runs the models itself, on one information set that it freezes at the cut-off and publishes, including three numerical weather prediction models, so that foundation models can be compared with and without the same weather covariates under the actual market deadline. Errors are pooled per series against a seasonal-naive baseline, and models are ranked by a Bradley-Terry rating on the Elo scale with a day-bootstrap interval. The field spans baselines, linear and gradient-boosted models on the frozen weather, eighteen time-series foundation models from eleven families, ensembles, and the grid operators' own forecasts. Over the first thirty-two live days, the covariates reduced the error of each of the ten foundation models run with and without them by 37-51% on matched races (64-73% on wind, 48-61% on solar). Used zero-shot, these models match or outperform a LightGBM model trained on the same covariates. Model size, from 3M to 331M parameters, has a much smaller effect, and median ensembles of the covariate models rank highest. The grid operators' pre-gate forecasts remain ahead on wind and solar, where the best single foundation models have 16-22% more error; on load the gap is 4-6%, within the intervals.

0.32

AeroZoo: A Benchmark of Well-Posed Flow Problems for Foundation Models of Aerodynamics

cs.LG cs.CEphysics.flu-dyn ·2026-11-12 ·Peter Sharpe, Carmelo Gonzales, Corey Adams, Mehdi Ataei, Sanjay Choudhry
benchmarkcode/data similarity 0.44
Abstract · 35 pages, 13 figures, 23 tables. Lead authors: Peter Sharpe and Carmelo Gonzales. Companion paper to "ISLA: A Coordinate-Free, Measure-Weigh…

Neural surrogates for computational fluid dynamics (CFD) are trained and ranked on datasets that each vary one design family in one flow domain. Such datasets cannot test the least that an aerodynamic foundation model must do: predict CFD-quality incompressible flow in seconds for new shapes in new enclosures. On DrivAerML, larger models and longer training barely lower Transolver's error; doubling the training cases cuts it by about 12% up to 400 cases, exhausting the dataset. We introduce AeroZoo, a benchmark and training corpus of 3,815 time-mean solutions to the unsteady Reynolds-averaged Navier--Stokes (RANS) equations with a transition model, across seven geometry families, eight enclosure configurations and Reynolds numbers from $10^3$ to $10^8$. Each sample poses a well-posed PDE problem in the form a solver receives it: the boundary meshes grouped by condition type, the prescribed values and the fluid properties. The 2,816 samples with a stable time mean form the canonical benchmark: two tasks, engineering metrics and 22 frozen splits, disjoint in geometry, that hold out geometry families, enclosures, boundary-condition layouts and Reynolds ranges. On the random split, boundary-condition tokens cut GeoTransolver's median velocity error from 76.9% to 8.4% of the inlet speed in single-seed runs (uniform inlet flow: 11.0%). ISLA, a transformer for boundary-driven PDEs, reaches 5.3% over four seeds, about 4 times the change from a finer mesh. On the same test samples, a held-out geometry family barely changes ISLA's error relative to uniform flow, and a held-out enclosure or boundary-condition layout raises it 2.4 to 9.2 times. The data and the scoring code will be released.

0.29

The Cost of Coverage: Conformalising Native Forecast Uncertainty for GB Wind Power

cs.LG stat.AP ·2026-11-06 ·Carl Somers
similarity 0.44
Abstract

Uncertainty bands on wind forecasts help inform reserve sizing and commitments, but often fail to deliver their stated coverage. We apply conformal prediction to native bands to see what it adds and what it costs, comparing six forecasters, from ARIMA to a tabular foundation model, at two wind farms in Great Britain (GB) under operational conditions. We show that calibration repairs empirical marginal coverage with little or no Winkler Score penalty, but this apparent success conceals under-coverage in high winds. Calibrating by forecast wind regime turns marginal coverage into regime-level coverage, cutting day-ahead out-of-band volume in high winds by over 40% relative to pooled calibration while narrowing bands overall.

0.29

Local Consistency Does Not Guarantee Global Conservation: Auditing Zero-Shot Composition of Airway Flow Operators

eess.SY ·2026-10-01 ·Nichula Sathmith Wasalathilaka, Navodya Heshan Samarasinghe Dhanujaya Suraweera, Kevin Dawson, Chinthaka Jacob Mervyn Parakrama Bandara Ekanayake, Roshan Godaliyadda
similarity 0.44
Abstract

Neural operators approximate PDE solutions within a geometry family, but independently learned local operators need not form a consistent global simulator. We study frozen, single-pass composition for steady incompressible flow in idealized two-dimensional airway trees. Separate Tube, bifurcation, and trifurcation DeepONets are trained on 4,872 primitive CFD cases using field supervision and auxiliary divergence, port-flux, component-balance, and port-pressure penalties. The validation-selected deployment is frozen before whole-tree CFD fields are inspected and assembled without tree training, iterative coupling, flux correction, or CFD-informed adjustment. It retains major flow patterns and controlled pathology responses with 0.204-0.215 s CPU inference, but has a 22.68% prescribed-inlet-normalized external residual. A post-hoc sensitivity protocol, frozen before new training and evaluation, repeats Data, Div, and Full models across three seeds with Tube fixed. Relative to Data, Full reduces primitive composite scores by 26.7% for Y2 and 26.4% for Y3 and reduces assembled component-residual and interface-mismatch RMS by 7.2% and 16.6%, respectively. Nevertheless, mean tree velocity error increases by 7.5%, while external residual increases from 17.49 +/- 4.38% to 26.77 +/- 3.65%. Local regularization can therefore improve primitive and assembled local diagnostics without ensuring accurate global fields or conservation.

0.21

Residual-Guided Multi-Step Conditional Generation for Fast Airfoil Flow Field Prediction

cs.CE ·2026-11-17 ·Weishao Tang, Mingcheng Lei, Yufei Zhang
similarity 0.43
Abstract

Deep-learning surrogate models for aerodynamic flow prediction are efficient within the training distribution, but their accuracy often degrades sharply in out-of-distribution (OOD) scenarios. To improve OOD robustness for airfoil flow-field inference, this study proposes a residual-guided sequential inference framework to correct the unreliable local flow field. The framework consists of three Transformer-based components: a Flow Initializer for direct flow prediction, a Residual-based Corrector for high-residual regions, and a Shock-based Corrector for shock regions. The framework is evaluated on an engineering-oriented OOD test set built from CFD-based aerodynamic optimization trajectory. The proposed framework reduces the L1 error, CL error, and CD error by 30%, 59%, and 41%, respectively, relative to the usual single step Geo-to-Flow prediction. The additional iterative inference cost is only 0.25s per sample. These results demonstrate that the proposed framework provides an effective route for improving OOD robustness in airfoil surrogate modeling.

0.18