CS Paper Radar

Mixed-precision GPU algorithms for efficient turbulent flow simulations with Raviart-Thomas finite elements

Ivan Prusak, Enes Mustafa Soydan, Ivan Pribec, Martin Kronbichler

cs.MS physics.flu-dynmath.NA ·submitted 2026-09-17 07:33 UTC · v1

Abstract

We propose GPU algorithms for high-fidelity simulation of incompressible turbulent flows. Discretization in space is performed with H(div)-conforming high-order Raviart-Thomas finite elements for the velocity and an $L^2$-conforming discontinuous Galerkin approximation for the pressure. In time, a consistent splitting scheme based on higher-order BDF time stepping is used, with convection treated explicitly. In this scheme, a pressure Poisson equation and a symmetric reaction-diffusion-type equation for the velocity need to be solved in each time step. We develop a solution framework with fast matrix-free operator evaluation for all ingredients, combined with multigrid solvers for the Poisson problem, and propose a robust mixed-precision algorithmic framework. A key to mixed-precision efficiency is a least-squares projection to generate accurate initial guesses for the iterative linear solvers, enabling us to work with relative residual tolerances of $10^{-3}$. In this regime, running the solvers entirely in single precision leads to almost no change in overall iteration counts and maintains the crucial turbulence statistics, while showing up to $1.7\times$ speedup over pure double-precision simulations.

Comment
19 pages, 9 figures, 5 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Mixed-Precision SEM-Based CFD Simulations on GPUs: A Taylor-Green Vortex case

cs.DC cs.SE ·2026-08-25 ·Yanxiang Chen, Manuel Münsch, Roman Iakymchuk
similarity 0.67
Abstract

Mixed precision is a promising approach for reducing the computational cost and energy consumption of Computation Fluid Dynamics (CFD) simulations, but its effectiveness depends strongly on where precision is reduced within the full simulation pipeline. In this work, we study Taylor-Green vortex case using Neko, a matrix-free CFD solver based on the spectral element method (SEM). Profiling shows that the fluid time step is not dominated by Krylov convergence alone: the velocity and pressure solvers require only a small number of iterations per step, while a substantial fraction of runtime is spent in other SEM operators and solver components. Motivated by this structure, we propose a three-level hierarchical mixed-precision control model. Two groups of configurations are evaluated in environments bounded by 64-bit floating-point (fp64) and 32-bit floating-point (fp32) precision, respectively. The fp64-bounded group identifies accuracy sensitive components and shows that SEM-focused fp32 computation is a promising direction for future optimization. The fp32-bounded group provides the main practical benefit. For the high Reynolds number case studied, selected configurations reduce both time- and energy-to-solution by about 34% relative to the fp64 baseline, while improving robustness compared with global fp32. Targeted fp16 kernel overrides are also explored, showing potential for selected operations but increased sensitivity in gradient-based quantities such as enstrophy. Overall, these results indicate that mixed-precision for matrix-free SEM-based CFD should be treated as a simulation-level control problem rather than solely as a Krylov-solver optimization.

0.26

A Mixed-Precision Model for Matrix-Splitting Methods

cs.CE math.NA ·2026-10-05 ·Neil Lindquist, David Appelhans, Chales W. Jackson, Joseph M. Derlaga
similarity 0.65
Abstract

The performance of stationary iterative methods is memory-bound, due to the low arithmetic intensity. So, we propose a mixed-precision technique to reduce the amount of data movement in matrix-splitting iterative methods. We demonstrate both theoretically and experimentally that this technique will generally converge at a similar rate as an exact-precision iteration, depending on the precision used and the conditioning of the $M$ matrix. Furthermore, we demonstrate that iterative refinement can be used to refine the solution to full double-precision accuracy. Using this approach, we mixed half and double precision to achieve an average speedup over uniform double precision of $1.60\times$ for scalar and block Jacobi and $1.25\times$ for scalar and block Gauss-Seidel. Furthermore, we reduced the precision in the SSOR iteration used by OVERFLOW, a NASA code for compressible fluid dynamics simulations, and achieved a $1.14\times$ speedup to the overall application.

0.10

Efficient Projection-Based Reduced-Order Modeling for Computational Fluid Dynamics via Multifidelity Basis Construction

cs.CE ·2026-11-04 ·Ashok Viswanathan, Charbel Farhat
similarity 0.60
Abstract · 18 pages conference

Projection-based reduced-order models (PROMs) accelerate computational fluid dynamics simulations, but generating high-fidelity (HF) training snapshots remains expensive. We present a multifidelity methodology that reduces offline basis-construction costs by combining a small HF database with low-fidelity (LF) solutions. The method accommodates discrepancies in physical models and spatial discretizations. Parameter-matched HF and aligned LF snapshots define a correction basis. At new parameters, LF predictions are corrected by minimizing the HF residual over an affine trial space, with selective Reynolds-averaged Navier-Stokes (RANS) smoothing. Accepted snapshots enrich the training database and update the correction basis. The resulting basis is compatible with conventional projection methods, including least-squares Petrov-Galerkin projection. For steady flow over a NACA0012 airfoil, using fine-grid RANS and coarse-grid Euler models, four HF snapshots and 36 LF-derived snapshots reduce snapshot-generation cost by a factor of 7.8. At basis dimension 40, mean lift, drag, and lift-to-drag ratio errors are 1.1%, 3.6%, and 3.9%, and the mean relative skin-friction error is approximately 5%, compared with 0.18%, 2.9%, 2.8%, and 4% for an HF-only PROM. Errors are evaluated against fully converged HF solutions on a test set emphasizing shock-containing flows. Increasing the initial HF snapshot count raises cost without monotonically improving accuracy. Among the tested multifidelity configurations, ten initial HF snapshots give the lowest aerodynamic errors at dimension 40; increasing the count to twelve worsens all three. The results demonstrate reduced snapshot-generation costs while retaining compatibility with established PROM formulations.

0.32

Space-Time Parallel Direct Numerical Simulation of Rayleigh-Bénard Convection

cs.DC math.NAphysics.flu-dyn ·2026-10-13 ·Thomas Saupe, Thibaut Lunet, Mathis Bode, Robert Speck, Sebastian Götschel +1 more
similarity 0.60
Abstract

Rayleigh-Bénard convection (RBC) is a model for turbulent flow and challenging to simulate by direct numerical simulation (DNS). Adequate resolution of all relevant length scales requires very fine grids in space and stability restrictions can dictate small step sizes. In this paper, we investigate the use of parallel spectral deferred correction (SDC) as a high-order time-stepping method to reduce wall-clock times of direct numerical simulation of RBC. Performance results on JUSUF (CPUs) and JUPITER (GPUs) with two different codes show parallel SDC can offer some concurrency along the temporal axis plus larger maximum stable time steps. Taken together, this allows for a reduction of wall-clock time required for simulations over one free-fall time by having to compute fewer steps and being able to mitigate the higher cost per time step through temporal parallelization.

0.24

diff-soup: GPU-native Differentiable Simulation and Inference for Large-scale Stiff Dynamical Systems

cs.MS physics.comp-ph ·2026-10-27 ·Samuel Degnan-Morgenstern, Martin Z. Bazant
code/data similarity 0.58
Abstract

Learning physical models from spatiotemporal data requires simulating systems of partial differential equations (PDEs) and differentiating through their solution. Upon spatial discretization, these models give rise to stiff dynamical systems that require repeatedly solving large, sparse linear systems. Traditional scientific computing frameworks are largely CPU-based and require problem-specific tuning to accelerate, scale, and differentiate. In this work, we introduce diff-soup, a differentiable, sparse-oriented, unified PDE suite for GPU-native simulation and inference of large, stiff dynamical systems. Built in JAX, diff-soup provides 1) a fully differentiable design for problems with sparse structure, 2) scaling to large problems through the NVIDIA cuDSS sparse direct solver with model and data multi-GPU parallelism, and 3) end-to-end PDE-constrained optimization, from classical statistical inference to embedded deep learning. On stiff PDE benchmarks, diff-soup outperforms established CPU- and GPU-based frameworks by one to two orders of magnitude in both forward solves and gradients. We demonstrate both a classical Bayesian inference workflow, identifying constitutive relationships, and a modern deep learning workflow, training a neural field for the catalyst activity of a three-dimensional packed bed reactor. We provide diff-soup as an open-source repository to facilitate research in computational science and engineering.

0.31

TokaGLINT: A Scalable GPU-Tailored Implicit Solver for Full 3D Tokamak Electromagnetic Simulations

cs.DC ·2026-09-18 ·Zifan Yang, Haoyuan Zhang, Jialin Li, Wu Yuan, Xiazhen Liu +3 more
published similarity 0.58
Abstract · Accepted at SC26

We introduce TokaGLINT, a GPU-accelerated implicit solver for electromagnetic field computations in full 3D tokamak simulations, aimed at efficient large-scale parallel GPU computing. Its central innovation lies in the co-design of hierarchical domain decomposition and a fast exact local solver, where hierarchical partitioning is tailored to match fine-grained intra-card subdomains and exploit the tensor-based solver dedicated to curvilinear-coordinate symplectic CN-FDTD-discretized 3D Maxwell equations. Backed by automated operator fusion and batching customized for the intra-card multi-subdomain structure, the solver decouples unknowns through discrete transformations and leverages tensor-structured computations to achieve high hardware utilization, while preserving the long-time stability characteristic of symplectic discretizations. TokaGLINT scales the electromagnetic field solve beyond 10,000 GPUs, achieving 90.1% weak and 53.9% strong scaling efficiency, while delivering a 2.67X single-node speedup over an unpreconditioned BiCGStab baseline (HIP-enabled HYPRE). It is validated in EAST tokamak simulations within the SymPIC plasma simulation code, enabling high-fidelity long-duration modeling.

0.51

Machine-learned spectral PDE solvers for fluids and plasmas

cs.LG physics.comp-phphysics.plasm-ph ·2026-10-19 ·Mellow Baixuan Chen, Alan A. Kaptanoglu
benchmark similarity 0.58
Abstract

Sparse regression methods for discovering governing partial differential equations (PDEs) from data are sensitive to observation noise and are not constrained to reproduce the data under forward integration. We address both limitations by performing weak-form discovery in the spatial discretization in which the PDE is solved, learned by differentiating through multistep rollouts anchored at the observed states. The new method, Weak-form Anchored Rollout for PDEs (WARP), produces a machine-learned PDE solver. In this work, we focus on systems amenable to a spectral Galerkin solver. Across eight benchmark fluid and plasma systems, including high-dimensional turbulent simulations, WARP produces numerically stable rollouts from new random initial conditions and substantially improves coefficient recovery, rollout accuracy, and statistical measures compared with a single-step weak-form SINDy baseline.

0.13

GPU-Accelerated Bregman Douglas-Rachford Splitting for Discrete Optimal Transport

cs.LG math.OC ·2026-10-03 ·Yifan Xu, Shiqian Ma
benchmark similarity 0.58
Abstract · 44 pages, 7 figures, 3 tables. Submitted to Mathematical Programming Computation

We present GPU-accelerated Bregman Douglas--Rachford splitting algorithm (BDRS) for discrete optimal transport problem in three input formats: an explicit cost matrix, a point cloud with a ground cost between them, and a separable cost on a regular grid. For each input format, we propose hardware-aware designs of mathematically equivalent representations for the BDRS iterations to enhance numerical stability and empirical runtime. We benchmark the three proposed implementations against eight GPU baseline solvers from the literature on the same device. We demonstrate that our implementations of BDRS achieve state-of-the-art performance on their respective input formats. To the best of our knowledge, this is the first cross-solver study of GPU DOT solvers with a unified measure of optimality.

0.25