CS Paper Radar

SUMNO: Spatially Unrolled Multigrid Neural Operator for Fluid Flow Surrogates

Yingqi Hu, Nan Deng, Changxiao Shao, Xiaozhou He

cs.AI physics.flu-dyn ·submitted 2026-11-12 06:02 UTC · v1
hot direction

Abstract

Data-driven surrogate modeling has emerged as a powerful paradigm for accelerating computational fluid dynamics, and hierarchical U-shaped networks, which resemble the structure of classical Geometric Multigrid (GMG) methods, have become prevalent designs. Modern surrogates built on these designs achieve competitive accuracy at a fraction of the cost of numerical solvers; however, accurate prediction of complex flows remains challenging, and no existing architecture leads across them. In such networks, the multigrid analogy mainly concerns the multi-resolution topology, while their components largely follow common vision practice. To address this, this study introduces SUMNO, a multigrid neural operator for fluid flow fields on regular grids that spatially unrolls a V-cycle into a feed-forward U-shaped network. Parameter-free down- and upsampling stand in for restriction and prolongation, and additive skip connections for coarse-grid correction, with normalization-free transfer and skip pathways. Within this macro-architecture, convolutions are used at the fine and intermediate resolutions and shifted-window attention at the coarsest, whose window partitioning is generalized to handle periodicity independently per axis. Evaluated on unseen test configurations across four unsteady and steady flow benchmarks against five representative baselines, SUMNO is best in 5 of 7 settings and ranks second in the remaining two. It reduces the 10-step rollout MSE by about 30% relative to the strongest baseline, and outperforms three baselines with over 130 million parameters using 9.4 million parameters.

Comment
37 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

CLNO: Conservative Local Neural Operator for Compressible Flow Prediction

cs.LG math.NA ·2026-10-12 ·Buxuan Wang, Rongzu Li, Qingsong Zou
similarity 0.64
Abstract · 23pages, 15 figures

We propose a conservative local neural operator (CLNO) for accurate and generalizable autoregressive prediction of compressible flows. Building upon the locality and translation invariance of the local neural operator (LNO), CLNO introduces a conservative evolution framework based on local subdomains of fixed physical size, separating local mean-state evolution from fine-scale reconstruction. The flow is encoded into subdomain-integrated conservative states and fine-scale features, while a shared local network predicts interface fluxes for finite-volume updates that enforce discrete conservation. A convolutional reconstruction network recovers fine-scale structures using zero-mean basis functions, preserving the updated local means and providing information for subsequent evolution. To accommodate different physical parameters, Reynolds--Mach number conditioning modulates the encoding, flux-prediction, and reconstruction networks, enabling a single model to learn parameter-dependent dynamics and generalize to unseen parameter combinations without retraining. CLNO supports prediction across spatial resolutions, computational domain sizes, and boundary conditions. Numerical experiments demonstrate improved generalization and competitive or higher accuracy compared with LNO, including order-of-magnitude error reductions in representative cases, at approximately three to five times the inference cost on periodic benchmarks. These results demonstrate accurate, generalizable, and physically consistent flow prediction through conservative local evolution and fine-scale reconstruction.

0.15

A Variational Optimal Transport Operator on Incompressible Flow

cs.LG cs.GR ·2026-09-12 ·Jinjin He, Shenyifan Lu, Sinan Wang, Zhiqi Li, Duowen Chen +1 more
similarity 0.61
Abstract

We present the Variational Incompressible Optimal Transport (VIOT) operator, a generative neural operator for amortized incompressible density transport. Given a new source-target density pair, VIOT predicts a divergence-free velocity field and generates the full transport trajectory by feed-forward inference, replacing the hour-scale per-pair optimization used by adjoint fluid solvers and differentiable simulation baselines. The system consists of three components: a stream-function or vector-potential representation that enforces incompressibility by construction, a regularized incompressible transport objective that balances endpoint accuracy and flow smoothness, and a Fourier Neural Operator backbone that amortizes the solve across new pairs and grid resolutions. Together, these components make incompressible transport a reusable neural operator that facilitates various transport processes. Further, the generative capability extends beyond the training distribution, with VIOT producing incompressible transports for user-drawn source-target pairs in a real-time interactive system. We demonstrate VIOT on 2D and 3D density-transport benchmarks. Both 2D and 3D rollouts complete in seconds per pair, while per-instance baselines in our 2D comparisons optimize each new pair from scratch and require on the order of an hour, a roughly $10^4\times$ online speedup.

0.22

Neural Operator Splitting for Fluid Dynamics in Complex Geometry

cs.LG physics.flu-dyn ·2026-10-20 ·Jianxiang Li, Xi Deng, Hong Chul Nam, Anima Anandkumar
similarity 0.61
Abstract

Solving dynamical systems in complex and diverse geometries remains challenging for both numerical solvers and learning-based surrogate models. We propose Neural Operator Splitting, a framework for learning fluid dynamics while preserving the physical structure of fractional-step numerical schemes. Instead of learning the full-step evolution monolithically, we decompose each time step into physically interpretable steps, and learn each operator separately using intermediate states from the underlying numerical solver. Guided by the linearity properties of the fractional steps, we introduce a conditional-linear Fourier neural operator (CL-FNO) whose linear state mappings are modulated by nonlinear conditioning on inputs such as boundary geometry. We further introduce two complementary strategies, symmetry sampling and corrective cycling, to mitigate error accumulation during autoregressive rollout. Experiments on 2D and 3D fluid flows with varying geometries and initial conditions show that our full model reduces mean relative $L^2$ rollout error by 68\% in 2D and 40\% in 3D compared with a single full-step neural operator. At comparable error levels, neural-operator inference is approximately $10^3$ times faster per step than the Monte Carlo solver.

0.24

TurtLES: A Large-Scale Benchmark for Turbulent 3D Neural PDE Surrogates

cs.LG physics.flu-dyn ·2026-11-06 ·Jarno Platenburg, Armand Kassaï Koupaï, Paola Cinnella, Patrick Gallinari
benchmarkdataset similarity 0.60
Abstract

Machine-learning surrogates are increasingly used to accelerate computational fluid dynamics, yet progress is limited by the lack of benchmarks capturing realistic, time-dependent turbulent flows. We introduce TurtLES, a 14 TB dataset of 3D turbulent cylinder wakes in the shear-layer transition regime, computed via high-fidelity implicit large-eddy simulations. The dataset contains 400 trajectories of 400 time steps each, with 3-11 million points per frame, spanning variations in geometry, Reynolds number, and angle of attack. Unlike existing datasets, TurtLES combines (i) physically realistic turbulence with an active energy cascade driven by vortex stretching, (ii) dense irregular meshes, and (iii) long-horizon temporal dynamics. We benchmark state-of-the-art neural operators on autoregressive rollouts and identify key failure modes, including temporal instability, loss of small-scale energy, and challenges in learning on large irregular domains. TurtLES provides a new benchmark for evaluating surrogate models on 3D turbulent wakes at industrially relevant mesh resolution.

0.31

Solving the Discretised Shallow Water Equations on Distorted Structured Grids with Neural Physics

cs.CE physics.comp-phphysics.flu-dyn ·2026-11-15 ·Boyang Chen, Claire E. Heaney, Christopher C. Pain
similarity 0.60
Abstract · 43 pages, 12 figures, 2 tables

This paper presents a method for solving the shallow water equations on highly distorted structured grids using convolution-based operators following the Neural Physics approach. By mapping distorted physical grids to a uniform computational domain with Jacobian transformations, the governing advection and diffusion operators are reformulated in a structured convolutional form. This enables the use of efficient stencil-based operations and, following the Neural Physics concept, we do this through convolutional layers whose weights are determined by the chosen numerical methods rather than by training. The method introduces consistent mass-lumped formulations, conservative and non-conservative advection forms, and a diffusion operator, all expressed as convolutions. A nonlinear Petrov-Galerkin stabilisation is incorporated to control numerical oscillations on distorted meshes. Two approximations for the Laplacian operator are also proposed to accelerate pressure and diffusion solves. The framework is validated using the Carlisle 2005 flood event, demonstrating accurate predictions of water depth and velocity on distorted meshes for both linear and quadratic discretisations. The results show that distorted structured grids can retain conservation, stability and accuracy, whilst adapting the mesh statically. The convolutional formulation makes the method well suited to Neural Physics implementations and GPU acceleration, offering a scalable approach for flood modelling and large-scale geophysical simulations.

0.37

Shaping the Wind: Nested Potentials for Kinematically Admissible Urban Wind Prediction

cs.LG ·2026-10-04 ·Yidi Wang, Yunhe Zhang, Jiawei Gu, Ziyue Qiao, Pengyang Wang
dataset similarity 0.60
Abstract

Predicting transient urban winds is fundamental to understanding urban microclimates and designing climate-resilient cities. Building-resolving large-eddy simulation produces detailed incompressible urban wind fields at substantial computational cost for each layout. Neural surrogates offer a faster alternative by learning to predict the evolution of velocity fields. However, minimizing velocity prediction error does not guarantee local mass conservation and wall impermeability, which together define kinematic admissibility. This limitation stems from an unconstrained output representation: geometry conditioning guides predictions but does not restrict them to admissible velocity fields. Correcting boundary violations in these outputs changes the flux balance in adjacent fluid cells and may consequently compromise local mass conservation. To address the challenge, we propose Sculpt, a nested potential framework that builds the coupled, geometry-dependent constraints directly into its parameterization. This nested parameterization generates divergence-free velocity updates through the discrete curl of a volume vector potential on the native three-dimensional staggered grid. A shared scalar potential constrains the vector potential's boundary values so that the same operator also enforces impermeability, without a per-step pressure projection. Because backpropagation through this curl attenuates large-scale gradient signals, we parameterize the volume potential at multiple resolutions to better capture large-scale flow structures. We introduce UrbanWindFlow, an LES dataset spanning urban morphologies and inflow conditions, to evaluate accuracy and kinematic admissibility together.

0.15

Predicting Sparse Observables in Parameterized Unsteady Flows Using Coarse-Mesh Graph Neural Networks

cs.LG physics.flu-dyn ·2026-10-27 ·Brener Ramos, William R. Wolf, Tarcísio C. D. Oliveira, Scott T. M. Dawson
similarity 0.60
Abstract

Full-order surrogates for high-dimensional nonlinear flows are often unnecessary when applications require only selected degrees of freedom. We propose reduced-order models that bypass full-state reconstruction by deploying graph neural networks (GNNs) directly on coarse meshes. Applied to parameterized 2D/3D confined cylinder flows and an unevenly heated cavity over Reynolds/Rayleigh-number ranges, the models generalize to unseen conditions and accurately predict sparse probe locations and integrated quantities. Coarse-mesh GNNs match or outperform finer-mesh surrogates while reducing training time and memory, even for 3D chaotic dynamics. A dynamics-informed adaptive sampling strategy guided by frequency-spectrum variations reduces maximum errors by an order of magnitude versus uniform sampling at negligible cost. Coarse-mesh training also makes noise-augmented multi-step unrolling practical, improving long-horizon autoregressive predictions. The approach outperforms parametric DMD, sparse MLPs, U-Nets, and Fourier neural operators at lower cost, and enables system identification and state estimation from sparse observations. These results show that coarse-mesh representations, adaptive sampling, and noise-augmented unrolled training form an efficient framework for reduced-order modeling of parameterized unsteady flows without solver-resolution reconstruction.

0.13

Cross-Domain Pretraining for Steady-State Neural CFD Surrogates

cs.LG ·2026-10-07 ·Anthony Zhou, Amir Barati Farimani, Shirley Ho, Rudy Morel
dataset similarity 0.59
Abstract · 43 pages, 25 figures

Neural surrogates for computational fluid dynamics (CFD) have the potential to greatly enhance engineering innovation through accelerating simulation. However, the primary limitation for neural surrogates is the lack of generalization to geometries and applications beyond the training set, which is significant given the diversity of engineering scenarios. Currently, this is addressed by generating a new dataset for a specific application; however, this requires running costly numerical solvers. In this work, we take a step toward addressing this by studying neural surrogates trained across different geometries, boundary conditions, and fidelities. We find that cross-domain pretraining improves zero- and few-shot performance on held-out datasets relative to both training from scratch and transferring from domain-specific experts. In particular, finetuning a pretrained, cross-domain model can achieve 2-3x lower errors at the same sample size and use 8x fewer samples to achieve the same error, compared to training from scratch. This benefit is architecture agnostic and improves with model size and pretraining dataset diversity. Furthermore, we study how and why cross-domain pretraining works in CFD surrogates, and find that simply pooling steady-state datasets is both sufficient and effective. Given the high cost of generating CFD data, leveraging existing datasets through cross-domain pretraining will likely be a valuable strategy as future surrogates expand to tackle new problems and use cases.

0.43