CS Paper Radar

Learnable composition for neural operators

Zituo Chen, Baiming Zhang, Sili Deng

cs.LG ·submitted 2026-09-02 18:40 UTC · v1

Abstract

Neural operators are fast, differentiable surrogates for physical simulation, but their accuracy often degrades when domain geometry, size, or operating conditions differ from training. Supervised adaptation can recover accuracy, but even a small target set requires costly high-fidelity simulations. We therefore ask how pretraining and transfer can be designed together to reduce this deployment cost. LatentDDM first pretrains a neural operator to predict fields on small subdomains. For a new setting, it freezes this operator and trains only a lightweight module that composes the local predictions. We evaluate our method on two complementary problems: steady Darcy flow, where long-range pressure coupling must extend across increasingly large porous domains, and unsteady incompressible flow around a pitching airfoil, where rollout errors compound as target pitching frequencies exceed the training range. Compared with the capacity-matched models that process the full domain at once, LatentDDM's error is 36-56% lower on larger Darcy domains after adaptation with 16 target simulations. It also improves 20-step field rollouts in fast-pitching airfoil flow, both zero-shot and after few-shot calibration. These results identify the co-designed local pretraining and composition-level transfer as a promising design principle for physical foundation models.

Closest papers

Nearest neighbours by meaning across the whole index.

Cross-Domain Pretraining for Steady-State Neural CFD Surrogates

cs.LG ·2026-10-07 ·Anthony Zhou, Amir Barati Farimani, Shirley Ho, Rudy Morel
dataset similarity 0.71
Abstract · 43 pages, 25 figures

Neural surrogates for computational fluid dynamics (CFD) have the potential to greatly enhance engineering innovation through accelerating simulation. However, the primary limitation for neural surrogates is the lack of generalization to geometries and applications beyond the training set, which is significant given the diversity of engineering scenarios. Currently, this is addressed by generating a new dataset for a specific application; however, this requires running costly numerical solvers. In this work, we take a step toward addressing this by studying neural surrogates trained across different geometries, boundary conditions, and fidelities. We find that cross-domain pretraining improves zero- and few-shot performance on held-out datasets relative to both training from scratch and transferring from domain-specific experts. In particular, finetuning a pretrained, cross-domain model can achieve 2-3x lower errors at the same sample size and use 8x fewer samples to achieve the same error, compared to training from scratch. This benefit is architecture agnostic and improves with model size and pretraining dataset diversity. Furthermore, we study how and why cross-domain pretraining works in CFD surrogates, and find that simply pooling steady-state datasets is both sufficient and effective. Given the high cost of generating CFD data, leveraging existing datasets through cross-domain pretraining will likely be a valuable strategy as future surrogates expand to tackle new problems and use cases.

0.42

SimpFlow: Transferable Pretraining for Fluid Dynamics via Simplified Physics

cs.CE ·2026-11-09 ·Ruijie Li, Tianbai Xiao
benchmark similarity 0.66
Abstract · 29 pages, 20 figures, 19 tables

Neural surrogates enable rapid fluid simulation, but learning across diverse three-dimensional (3D) geometries requires costly computational fluid dynamics (CFD) labels. We introduce SimpFlow, a pretraining approach that generates supervision from simplified physics on unlabeled geometry libraries. A source-panel potential-flow solver generates velocity and pressure fields for approximately 9,000 3D geometries, capturing geometry-induced acceleration, stagnation, and suction while omitting viscosity and separated wakes. The solver imports only a surface mesh and reuses precomputed velocity fields across inflow directions, enabling inexpensive label generation. In our benchmark, amortized labeling takes 0.111 s per example using four CPU threads. We pretrain a neural surrogate on these labels and fine-tune it on independent CFD datasets. Across five flow tasks, SimpFlow improves over training from scratch in all 24 task-budget settings. With fine-tuning fixed at 200 epochs, interpolation indicates that SimpFlow requires 35-68% fewer CFD training cases to match the error of scratch models trained at each task's largest data budget. These results demonstrate that simplified physical solutions can provide transferable supervision, offering a practical way to reduce the high-fidelity data requirements of fluid surrogates.

0.23

AeroZoo: A Benchmark of Well-Posed Flow Problems for Foundation Models of Aerodynamics

cs.LG cs.CEphysics.flu-dyn ·2026-11-12 ·Peter Sharpe, Carmelo Gonzales, Corey Adams, Mehdi Ataei, Sanjay Choudhry
benchmarkcode/data similarity 0.65
Abstract · 35 pages, 13 figures, 23 tables. Lead authors: Peter Sharpe and Carmelo Gonzales. Companion paper to "ISLA: A Coordinate-Free, Measure-Weigh…

Neural surrogates for computational fluid dynamics (CFD) are trained and ranked on datasets that each vary one design family in one flow domain. Such datasets cannot test the least that an aerodynamic foundation model must do: predict CFD-quality incompressible flow in seconds for new shapes in new enclosures. On DrivAerML, larger models and longer training barely lower Transolver's error; doubling the training cases cuts it by about 12% up to 400 cases, exhausting the dataset. We introduce AeroZoo, a benchmark and training corpus of 3,815 time-mean solutions to the unsteady Reynolds-averaged Navier--Stokes (RANS) equations with a transition model, across seven geometry families, eight enclosure configurations and Reynolds numbers from $10^3$ to $10^8$. Each sample poses a well-posed PDE problem in the form a solver receives it: the boundary meshes grouped by condition type, the prescribed values and the fluid properties. The 2,816 samples with a stable time mean form the canonical benchmark: two tasks, engineering metrics and 22 frozen splits, disjoint in geometry, that hold out geometry families, enclosures, boundary-condition layouts and Reynolds ranges. On the random split, boundary-condition tokens cut GeoTransolver's median velocity error from 76.9% to 8.4% of the inlet speed in single-seed runs (uniform inlet flow: 11.0%). ISLA, a transformer for boundary-driven PDEs, reaches 5.3% over four seeds, about 4 times the change from a finer mesh. On the same test samples, a held-out geometry family barely changes ISLA's error relative to uniform flow, and a held-out enclosure or boundary-condition layout raises it 2.4 to 9.2 times. The data and the scoring code will be released.

0.29

Local Consistency Does Not Guarantee Global Conservation: Auditing Zero-Shot Composition of Airway Flow Operators

eess.SY ·2026-10-01 ·Nichula Sathmith Wasalathilaka, Navodya Heshan Samarasinghe Dhanujaya Suraweera, Kevin Dawson, Chinthaka Jacob Mervyn Parakrama Bandara Ekanayake, Roshan Godaliyadda
similarity 0.63
Abstract

Neural operators approximate PDE solutions within a geometry family, but independently learned local operators need not form a consistent global simulator. We study frozen, single-pass composition for steady incompressible flow in idealized two-dimensional airway trees. Separate Tube, bifurcation, and trifurcation DeepONets are trained on 4,872 primitive CFD cases using field supervision and auxiliary divergence, port-flux, component-balance, and port-pressure penalties. The validation-selected deployment is frozen before whole-tree CFD fields are inspected and assembled without tree training, iterative coupling, flux correction, or CFD-informed adjustment. It retains major flow patterns and controlled pathology responses with 0.204-0.215 s CPU inference, but has a 22.68% prescribed-inlet-normalized external residual. A post-hoc sensitivity protocol, frozen before new training and evaluation, repeats Data, Div, and Full models across three seeds with Tube fixed. Relative to Data, Full reduces primitive composite scores by 26.7% for Y2 and 26.4% for Y3 and reduces assembled component-residual and interface-mismatch RMS by 7.2% and 16.6%, respectively. Nevertheless, mean tree velocity error increases by 7.5%, while external residual increases from 17.49 +/- 4.38% to 26.77 +/- 3.65%. Local regularization can therefore improve primitive and assembled local diagnostics without ensuring accurate global fields or conservation.

0.21

Complementary, Not Cumulative: Interaction Effects in Physics-Informed Neural Networks for Navier-Stokes Vortex Shedding

cs.LG physics.flu-dyn ·2026-08-20 ·Devesh Shah
benchmark similarity 0.63
Abstract

Physics-informed neural networks (PINNs) embed governing partial differential equations directly into the training loss, offering a promising alternative to costly CFD solvers for unsteady flows. Yet the growing list of techniques proposed to improve PINN training is typically validated one at a time, leaving open whether these techniques actually compose. We study this question in depth on the DFG/Schafer-Turek unsteady cylinder wake benchmark. In isolation, nearly every technique performs no better than an untreated baseline. However, combining periodic (SIREN) activations with causal weighting unlocks a previously inaccessible regime, reconstructing velocity and pressure fields to within 4.1% average relative L2 error against an OpenFOAM reference solution. Adding further techniques instead causes catastrophic performance degradation, demonstrating that individually effective PINN interventions can interact nonlinearly and that more elaborate training recipes are not necessarily better.

0.15

Learned Warm Starts for Steady Transonic RANS Simulations of Wing and Aircraft Configurations

cs.CE physics.flu-dyn ·2026-10-31 ·Muhammad Irfan Zafar, Saleh Abuhanieh, Şahin Yiğit
similarity 0.63
Abstract

Neural surrogates can accelerate many-query aerodynamic analyses, but their standalone predictions may be insufficiently accurate or robust to support reliable design evaluations. We develop a learned warm-start formulation that predicts mean-flow and turbulence fields directly on native CFD meshes for subsequent correction by the RANS solver. A common architecture and objective structure are used across subcritical and transonic flows, including challenging conditions with shock-induced separation. A condition-modulated Transolver combines Fourier and wall features with target-gated regularization, a Sobolev-type loss, adaptive loss weighting and sampled training. Prediction requires no preliminary flow solution, and training requires no solver-residual evaluation. Extensive 3D CFD evaluations on SuperWing, the NASA Common Research Model (CRM) and DLR-F6 assess geometric and operating-condition generalization, including interpolation, extrapolation and cross-mesh deployment, using Spalart-Allmaras and $k$-$ω$ SST closures on million-cell meshes. Unseen nominal cases achieve geometric-mean iteration speed-ups of approximately $2$-$4\times$ under a common convergence criterion based on cold-run aerodynamic coefficients. On CRM, learned initialization provides greater aggregate acceleration than nearest-condition restarts using the same solution library. Resolution invariance enables direct deployment of coarse-mesh models on finer meshes without retraining, solution interpolation or target-condition coarse solves. Including data generation and training, estimated campaign speed-ups reach $2.1$-$2.3\times$. No warm run diverges; fewer than $2\%$ fail to satisfy the cold-reference convergence criterion. These results support learned initialization for repeated aerodynamic analyses, while highlighting initialization sensitivity near separation as a remaining limitation.

0.06

A Variational Optimal Transport Operator on Incompressible Flow

cs.LG cs.GR ·2026-09-12 ·Jinjin He, Shenyifan Lu, Sinan Wang, Zhiqi Li, Duowen Chen +1 more
similarity 0.62
Abstract

We present the Variational Incompressible Optimal Transport (VIOT) operator, a generative neural operator for amortized incompressible density transport. Given a new source-target density pair, VIOT predicts a divergence-free velocity field and generates the full transport trajectory by feed-forward inference, replacing the hour-scale per-pair optimization used by adjoint fluid solvers and differentiable simulation baselines. The system consists of three components: a stream-function or vector-potential representation that enforces incompressibility by construction, a regularized incompressible transport objective that balances endpoint accuracy and flow smoothness, and a Fourier Neural Operator backbone that amortizes the solve across new pairs and grid resolutions. Together, these components make incompressible transport a reusable neural operator that facilitates various transport processes. Further, the generative capability extends beyond the training distribution, with VIOT producing incompressible transports for user-drawn source-target pairs in a real-time interactive system. We demonstrate VIOT on 2D and 3D density-transport benchmarks. Both 2D and 3D rollouts complete in seconds per pair, while per-instance baselines in our 2D comparisons optimize each new pair from scratch and require on the order of an hour, a roughly $10^4\times$ online speedup.

0.22

Efficient Projection-Based Reduced-Order Modeling for Computational Fluid Dynamics via Multifidelity Basis Construction

cs.CE ·2026-11-04 ·Ashok Viswanathan, Charbel Farhat
similarity 0.61
Abstract · 18 pages conference

Projection-based reduced-order models (PROMs) accelerate computational fluid dynamics simulations, but generating high-fidelity (HF) training snapshots remains expensive. We present a multifidelity methodology that reduces offline basis-construction costs by combining a small HF database with low-fidelity (LF) solutions. The method accommodates discrepancies in physical models and spatial discretizations. Parameter-matched HF and aligned LF snapshots define a correction basis. At new parameters, LF predictions are corrected by minimizing the HF residual over an affine trial space, with selective Reynolds-averaged Navier-Stokes (RANS) smoothing. Accepted snapshots enrich the training database and update the correction basis. The resulting basis is compatible with conventional projection methods, including least-squares Petrov-Galerkin projection. For steady flow over a NACA0012 airfoil, using fine-grid RANS and coarse-grid Euler models, four HF snapshots and 36 LF-derived snapshots reduce snapshot-generation cost by a factor of 7.8. At basis dimension 40, mean lift, drag, and lift-to-drag ratio errors are 1.1%, 3.6%, and 3.9%, and the mean relative skin-friction error is approximately 5%, compared with 0.18%, 2.9%, 2.8%, and 4% for an HF-only PROM. Errors are evaluated against fully converged HF solutions on a test set emphasizing shock-containing flows. Increasing the initial HF snapshot count raises cost without monotonically improving accuracy. Among the tested multifidelity configurations, ten initial HF snapshots give the lowest aerodynamic errors at dimension 40; increasing the count to twelve worsens all three. The results demonstrate reduced snapshot-generation costs while retaining compatibility with established PROM formulations.

0.32