CS Paper Radar

Multi-GPU Acceleration of Interface Problems in FEniCS, with Application to Cardiac Modeling

Edoardo Centofanti, Benjamin Pachev, Joshua Steyer, James D. Trotter, Pietro Benedusi

cs.DC math.NAcs.MS ·submitted 2026-11-02 14:17 UTC · v1
code/data

Abstract

GPU acceleration of finite element assembly is well established for standard formulations, but mixed-dimensional problems, in which volumetric subdomains are coupled via lower-dimensional interfaces, remain unsupported in automated frameworks such as FEniCS. We extend cuDOLFINx, a GPU-enabled extension of the DOLFINx finite element framework, to assemble such interface problems on GPUs while preserving the high-level FEniCS programming model. Combined with GPU-resident Krylov solvers and algebraic multigrid preconditioning, this enables end-to-end GPU execution of the EMI (Extracellular--Membrane--Intracellular) model, an elliptic interface problem from cardiac modeling in which many intracellular subdomains are coupled through membranes. We compare the GPU implementation against a CPU-based one through strong and weak scaling experiments on regular and realistic 3D cardiac geometries with up to 8000 cells and 22 million degrees of freedom. In terms of assembly, a single GH200 node is roughly equivalent to two 144-core CPU nodes in strong scaling, and to two to three nodes in weak scaling, depending on geometry. For the linear solver, performance depends on geometry, preconditioning, and problem scale. On the regular geometry, GPU advantages emerge mainly at larger problem sizes and node counts. On the realistic geometry, with the same algebraic multigrid preconditioner for both architectures, the GPU is faster at all tested scales. The implementation is available as open-source software and applies to other problems with interface coupling.

Comment
21 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

diff-soup: GPU-native Differentiable Simulation and Inference for Large-scale Stiff Dynamical Systems

cs.MS physics.comp-ph ·2026-10-27 ·Samuel Degnan-Morgenstern, Martin Z. Bazant
code/data similarity 0.62
Abstract

Learning physical models from spatiotemporal data requires simulating systems of partial differential equations (PDEs) and differentiating through their solution. Upon spatial discretization, these models give rise to stiff dynamical systems that require repeatedly solving large, sparse linear systems. Traditional scientific computing frameworks are largely CPU-based and require problem-specific tuning to accelerate, scale, and differentiate. In this work, we introduce diff-soup, a differentiable, sparse-oriented, unified PDE suite for GPU-native simulation and inference of large, stiff dynamical systems. Built in JAX, diff-soup provides 1) a fully differentiable design for problems with sparse structure, 2) scaling to large problems through the NVIDIA cuDSS sparse direct solver with model and data multi-GPU parallelism, and 3) end-to-end PDE-constrained optimization, from classical statistical inference to embedded deep learning. On stiff PDE benchmarks, diff-soup outperforms established CPU- and GPU-based frameworks by one to two orders of magnitude in both forward solves and gradients. We demonstrate both a classical Bayesian inference workflow, identifying constitutive relationships, and a modern deep learning workflow, training a neural field for the catalyst activity of a three-dimensional packed bed reactor. We provide diff-soup as an open-source repository to facilitate research in computational science and engineering.

0.31

Scalable Multi-GPU Simulation of 3D Multicellular Growth with RNN-Based Workload Balancing

cs.DC cs.CEcs.LGmath.OC ·2026-08-26 ·Matvey Moisseyev, Huijing Du, Dandan Zheng, Chi Zhang, Hongfeng Yu
similarity 0.62
Abstract · 10 pages, 9 figures. Currently under review for IEEE BigData 2026

Detailed multicellular growth simulations based on subcellular element models (SEMs) can capture complex tissue development, but their element-level interactions impose substantial computational cost. This work presents a scalable multi-GPU framework for 3D multicellular growth simulation that combines GPU acceleration, spatial binning, domain decomposition, and workload-aware partitioning. Cell movement, growth, and division continuously reshape the spatial workload distribution, causing initially balanced partitions to become inefficient over time. To address this, we introduce an RNN-based load-balancing controller that observes recent per-rank execution times and partition states and learns residual corrections to a reactive boundary-adjustment rule. The controller is trained offline in a differentiable surrogate of the load-balancing loop with randomized workload dynamics, requiring no measured execution traces for training. We evaluate the framework in terms of single-GPU acceleration, multi-GPU computation scaling, controller-level load-balancing behavior, and end-to-end simulation performance, with comparisons against static partitioning, reactive load balancing, and conventional time-series prediction baselines. A representative embryonic epidermal development use case further demonstrates the type of spatially and temporally evolving workload targeted by the framework. In our evaluation, GPU acceleration with spatial binning accelerates the interaction computation by roughly three orders of magnitude over a serial CPU baseline. RNN-guided load balancing reduces the mean global imbalance from 11.3% under static partitioning to 3.5%, lowers end-to-end runtime by 9.0% relative to static partitioning, and reduces slice migration by 7.7x compared with the reactive baseline, showing that history-aware control can improve workload balance while avoiding unnecessary repartitioning.

0.31

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

cs.DC ·2026-09-14 ·Tristan Chenaille, Francesca Cuteri, Rapha{ë}l Prat, Guillaume Latu, Thomas Helfer
code/data similarity 0.61
Abstract

Many applications require solving large numbers of independent linear systems on GPUs. While this need is well addressed for small to large systems, tiny ones, understood here as systems of dimension below 32, remain challenging. This is especially relevant in constitutive law evaluation, where millions of integration points are handled independently, and where each constitutive update generally relies on a Newton iterative method. Each iteration then requires the double-precision solution of a tiny general square linear system using LU factorization with partial pivoting (LUpp). The present study was conducted within a closed-source prototype, which serves as a demonstrator for porting to NVIDIA GPUs constitutive law evaluations currently provided on CPUs by TFEL/MFront, an open-source code generation tool for material knowledge. We compare several double-precision LUpp solvers, including implementations from GPU linear algebra libraries as well as custom-designed CUDA kernels. The comparison is performed first on large batches of standalone linear systems, and then within the full constitutive-law evaluation workflow, where each integration point requires a sequence of distinct linear systems, one per iteration of its own Newton loop. The study shows that the best LUpp solving strategy strongly depends on several factors including system size and application context. We discuss several key aspects, including register pressure, occupancy, the ability to invoke the LUpp solver directly from device code, and whether assigning several threads to each system is the most efficient strategy. Experiments on an NVIDIA H100 GPU show that the specialized LUpp solvers proposed in this work can outperform existing state-of-the-art approaches for this class of workloads, with speedups of up to 6.5x over cuSolverDx, and up to 17.7x over MAGMA.

0.19

Axion: A differentiable, GPU-native finite element framework,demonstrated on phase-field fracture

cs.CE ·2026-11-18 ·Wei Wang, Meenu Krishnan U., Somdatta Goswami
benchmarkcode/data similarity 0.61
Abstract · 35 pages, 9 figures

We introduce Axion (Autodifferentiable, XLA-compiled, Implicit, On-device Numerics), a differentiable, GPU-native finite element framework written in JAX. The element kernels, Newton and Krylov iterations, bound-constrained updates, staggered coupling of fields, and the loop over load increments are expressed as a single program that is just-in-time compiled and executed on the GPU without host intervention. Consistent tangent operators are obtained by forward-mode automatic differentiation of the element residual, and derivatives of the discrete solution with respect to model parameters are obtained by differentiating the same program. Global operators are applied element by element without assembling a sparse matrix, octree mesh refinement is performed within fixed-size arrays, and a cell-based domain decomposition runs the same program on several GPUs. Phase-field fracture is implemented as the first module because it combines fine mesh resolution, bound-constrained damage, and repeated nonlinear solves over a loading history, which together make it computationally expensive. On two- and three-dimensional single-edge-notched tension benchmarks, a uniformly refined Axion computation completes faster than the corresponding adaptive FEniCSx computation. At identical discretization, the two-dimensional benchmark runs 37.9 times faster on one GPU than a FEniCSx implementation on one CPU. Strong and weak scaling efficiencies on four GPUs are 92% and 96%, respectively. Large-scale demonstrations include hydraulic fracture in a poroelastic medium (0.38M degrees of freedom), fracture of a multi-material premolar under contact loading (0.69M degrees of freedom), and a concrete gravity dam (96M degrees of freedom) on a single GPU. The implementation is available as open-source software.

0.48

TokaGLINT: A Scalable GPU-Tailored Implicit Solver for Full 3D Tokamak Electromagnetic Simulations

cs.DC ·2026-09-18 ·Zifan Yang, Haoyuan Zhang, Jialin Li, Wu Yuan, Xiazhen Liu +3 more
published similarity 0.61
Abstract · Accepted at SC26

We introduce TokaGLINT, a GPU-accelerated implicit solver for electromagnetic field computations in full 3D tokamak simulations, aimed at efficient large-scale parallel GPU computing. Its central innovation lies in the co-design of hierarchical domain decomposition and a fast exact local solver, where hierarchical partitioning is tailored to match fine-grained intra-card subdomains and exploit the tensor-based solver dedicated to curvilinear-coordinate symplectic CN-FDTD-discretized 3D Maxwell equations. Backed by automated operator fusion and batching customized for the intra-card multi-subdomain structure, the solver decouples unknowns through discrete transformations and leverages tensor-structured computations to achieve high hardware utilization, while preserving the long-time stability characteristic of symplectic discretizations. TokaGLINT scales the electromagnetic field solve beyond 10,000 GPUs, achieving 90.1% weak and 53.9% strong scaling efficiency, while delivering a 2.67X single-node speedup over an unpreconditioned BiCGStab baseline (HIP-enabled HYPRE). It is validated in EAST tokamak simulations within the SymPIC plasma simulation code, enabling high-fidelity long-duration modeling.

0.51

PhysicsNeMo-Mesh: GPU-Native Meshes and Simulation Cases for Physics AI

cs.CG physics.comp-phcs.LG ·2026-10-29 ·Peter D. Sharpe, Corey Adams, Negin Sobhani, Sanjay Choudhry
code/data similarity 0.60
Abstract

PhysicsNeMo-Mesh is the mesh module of the open-source PhysicsNeMo library. It provides mesh processing similar to PyVista, but on the GPU, in batches, and inside PyTorch's automatic differentiation. Like xarray for unstructured meshes, it attaches semantics to data: fields on points, cells, and whole meshes have names and shapes, and a simulation case keeps the complete PDE problem specification, including boundary conditions and their prescribed values. It addresses three problems that plague machine learning for physical simulation. First, GPU utilization is bottlenecked by I/O, because samples are very large relative to the compute per forward pass. Second, because traditional preprocessing is expensive, it is necessarily done once, during curation, rather than differently for each model and workflow at the point of use. Finally, advanced equivariant and mesh-native architectures require information that curation ordinarily discards. Fast GPU mesh processing makes it practical to preprocess at the point of use: on one GB200 GPU, mesh operations run $6.2\text{--}1{,}068\times$ faster than VTK with 72 threads, and loading a whole case is $8.0\text{--}88\times$ faster than reading its VTK files ($8.0\times$ when both read the same fields). Overlapped with training, this preprocessing costs $2.1\%$ of throughput for a $127\,\text{ms}$ Transolver step. So one dataset serves many models and workflows: in PhysicsNeMo's public recipe, one stored DrivAerML dataset feeds Transolver, GeoTransolver, and GLOBE. PhysicsNeMo-Mesh combines the speed of an intermediate array store with the flexibility of an archival format such as VTK. When shapes and wall conditions both vary, per-boundary conditions cut a heat-conduction error from $87\%$ to $6\text{--}9\%$. And by keeping field ranks and named boundaries, it retains the semantic structure that next-generation architectures will need.

0.34

GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulation

cs.DC cs.AI ·2026-09-28 ·Yuchen Sun, Jinjin He, Sinan Wang, Bo Zhu
benchmark similarity 0.59
Abstract · 41 pages

Writing fast GPU code for physical simulation is difficult: implementations must preserve numerical accuracy while handling irregular data access, synchronization, and iterative solvers. We introduce GPUPhysBench, a benchmark of 50 tasks testing whether coding agents can meet these demands. Tasks cover fluids, deformable solids, and granular materials, from individual simulation operators to complete simulators. Agents write, compile, test, and optimize GPU code with access to a NVIDIA GPU under fixed time budgets. We report pass rates and runtime performance relative to expert-optimized reference implementations. In a single-attempt evaluation of six frontier model-harness pairs, the two strongest pass all 50 tasks, but even the fastest reaches at least 0.9 the reference speed on only 22% of them, and no submission is more than 5% faster than the reference. The largest gaps arise in collision detection, constraint solving, and iterative solvers. GPUPhysBench brings physical simulation workloads to coding-agent evaluation, testing both the ability to implement numerical methods correctly and the ability to make them run efficiently.

0.23

An open source Python code for three-dimensional topology optimization in single precision on a consumer GPU

cs.CE cs.MS ·2026-11-09 ·Leonilson Toffoli Pedrini, Rodolfo G. M. Andrade, Rafael M. Ferro
code/data similarity 0.59
Abstract · 18 pages, 8 figures. Online Resource 1 is available as an ancillary file. Code and data: https://doi.org/10.5281/zenodo.24050327. Submitted …

Three-dimensional topology optimization solves linear systems with millions of unknowns at every design iteration. Consumer graphics cards run far faster in single than in double precision, and open codes for them mostly address minimum compliance. This educational article presents TOF3D, an open source Python code for density-based topology optimization in single precision on one consumer GPU. It solves four classes of problems: stress constrained minimum compliance, robust minimum compliance against manufacturing errors, compliant mechanisms and bone-like porous infill. The stiffness operator is applied without assembly, and the conjugate gradient method is preconditioned by geometric multigrid. Rounding the element matrix to single precision gave rigid body motions a spurious energy and changed compliances by up to 5.4%. Forming the element products from differences of nodal displacements reduced this error to $1.3\times 10^{-5}$ at no cost in time. Adjoint sensitivities agreed with finite differences to within $1.7\times 10^{-6}$, and the solutions agreed with Ansys Mechanical APDL to within $4.1\times 10^{-10}$ with the same element. On an RTX 3060 with 12 GB, one design iteration of a cantilever took 0.46 s with 0.5 million elements and 15 s with 33.5 million. On the same card and problem, an open GPU code that applies its operator in double precision took 3.7 and 21 s with 0.5 and 4.2 million elements and ran out of memory on larger meshes. Eight cases fixed in a protocol before the runs took 9 to 35 minutes each with 4.2 to 5.2 million elements.

0.49