CS Paper Radar

Online adaptive non-intrusive model reduction via manifold interpolation and subspace updates: application to FSI convergence acceleration

Azzeddine Tiba, Florian de Vuyst, Iraj Mortazavi

cs.CE math.NA ·submitted 2026-09-15 09:06 UTC · v1

Abstract

We introduce a novel online adaptive non-intrusive reduced-order modeling strategy for parameterized dynamical systems involving parameter and time-dependent reduced bases. The proposed framework is based on a unified Grassmann manifold formulation combining three key components: interpolation of local reduced subspaces for unseen parameters, geodesic online subspace updates driven by incoming high-fidelity snapshots, and a latent-space regression strategy relying on Grassmann-distance weighting and Procrustes alignment to consistently aggregate predictions from multiple local models. The adaptive reduced-order model is embedded in a partitioned fluid-structure interaction framework, where it predicts fluid interface forces to provide accurate initial guesses for the nonlinear coupling iterations, thus achieving computational speedups with no loss of accuracy. The reduced basis and the regression operators are adapted independently during the simulation and without requiring the storage of high-dimensional streaming data, preserving computational efficiency while substantially improving predictive capabilities. Numerical results on reference FSI test cases demonstrate superior accuracy with respect to static and global reduced-order models, leading to a significant reduction in the number of fixed-point iterations required for convergence. The proposed framework offers a flexible and fully non-intrusive approach for the efficient simulation of nonlinear parameter-dependent multiphysics problems.

Closest papers

Nearest neighbours by meaning across the whole index.

A Product-Grassmann Tucker Surrogate for Parametric Field Prediction

cs.CE ·2026-10-25 ·Melika Baghi, Xiao Liu, Kamran Paynabar
similarity 0.68
Abstract · 50 pages (34 main text and 16 supplementary material), 11 figures, 13 tables. Submitted to the Journal of Computational Physics

Many-query applications such as design optimization, uncertainty quantification and digital twins call for repeated full-field predictions from expensive partial differential equation (PDE) simulations. Grassmannian reduced-order models interpolate parameter-dependent subspaces but commonly vectorize the spatial field, and the ambient dimension then grows with the product of the grid sizes. Tensor-based models preserve the multiway structure but often use shared mode-wise bases or a fixed core across parameters. We propose a Tucker-based surrogate that keeps the spatial directions and time as separate modes. The factor subspaces are interpolated on a product Grassmann manifold, Procrustes alignment places the Tucker cores in one coordinate system, and a truncated singular value decomposition models their variation. Across five PDE benchmarks in two and three spatial dimensions, including public computational fluid dynamics data, the interpolation size is reduced by factors of 13 to 482 and the stored model by factors of 13 to 464 relative to a single-subspace Grassmannian surrogate with the same local interpolation. Cached queries run 3.3 to 8.5 times faster, the mean errors over ten resampled splits differ by at most 0.22 percentage points (0.36 when every model choice is re-selected inside each split), and the prediction-error terms of the two methods differ by less than 0.1 percentage points. The remaining accuracy differences are consistent with the larger representation error of the Tucker format. In a three-dimensional grid study the interpolation-size ratio rises to 2,260 and the query speedup to 11.9 at 64^3.

0.18

The Snapping Phenomenon and Boundary Enforcement in Model Reduction: Mechanisms and Mitigation

cs.CE ·2026-10-15 ·Charbel Farhat, Yihong Zhu, Faisal As'ad, Tommaso Taddei
similarity 0.64
Abstract · 29 pages, 13 figures

Projection-based model order reduction mitigates the computational cost of high-fidelity parametric simulations but can suffer from the "snapping phenomenon", whereby a projection-based reduced-order model (PROM) rigidly latches onto a training snapshot, impairing parametric interpolation. Standard methods also struggle to enforce parameter-dependent boundary conditions without costly constraints or penalty schemes. This work proposes a tripartite taxonomy of snapping, distinguishing intrinsic, extrinsic, and numerical mechanisms. Focusing on intrinsic and numerical snapping, we introduce a unified framework based on a parameter-dependent shift vector. By embedding spatial transport into the state ansatz, the method enforces boundary conditions exactly, restores continuous parametric sensitivity, and eliminates snapshot latching in affine and regression-augmented PROMs without increasing online complexity. We establish the framework's mathematical foundations in the linear regime, showing how it overcomes test-space orthogonality blind spots. In nonlinear computational fluid dynamics, we identify the roles of boundary conditions, mesh grading, and discrete equation scaling in numerical snapping. We also show that formulation-toggling is an unreliable heuristic that can compromise near-field accuracy. Finally, we develop a field-theoretic realization using a spatially varying shift vector governed by a scaled Laplace equation. The approach is validated on structural and aerodynamic benchmarks, including viscous flow around a NACA airfoil and a three-dimensional NASA Common Research Model.

0.22

Efficient Projection-Based Reduced-Order Modeling for Computational Fluid Dynamics via Multifidelity Basis Construction

cs.CE ·2026-11-04 ·Ashok Viswanathan, Charbel Farhat
similarity 0.60
Abstract · 18 pages conference

Projection-based reduced-order models (PROMs) accelerate computational fluid dynamics simulations, but generating high-fidelity (HF) training snapshots remains expensive. We present a multifidelity methodology that reduces offline basis-construction costs by combining a small HF database with low-fidelity (LF) solutions. The method accommodates discrepancies in physical models and spatial discretizations. Parameter-matched HF and aligned LF snapshots define a correction basis. At new parameters, LF predictions are corrected by minimizing the HF residual over an affine trial space, with selective Reynolds-averaged Navier-Stokes (RANS) smoothing. Accepted snapshots enrich the training database and update the correction basis. The resulting basis is compatible with conventional projection methods, including least-squares Petrov-Galerkin projection. For steady flow over a NACA0012 airfoil, using fine-grid RANS and coarse-grid Euler models, four HF snapshots and 36 LF-derived snapshots reduce snapshot-generation cost by a factor of 7.8. At basis dimension 40, mean lift, drag, and lift-to-drag ratio errors are 1.1%, 3.6%, and 3.9%, and the mean relative skin-friction error is approximately 5%, compared with 0.18%, 2.9%, 2.8%, and 4% for an HF-only PROM. Errors are evaluated against fully converged HF solutions on a test set emphasizing shock-containing flows. Increasing the initial HF snapshot count raises cost without monotonically improving accuracy. Among the tested multifidelity configurations, ten initial HF snapshots give the lowest aerodynamic errors at dimension 40; increasing the count to twelve worsens all three. The results demonstrate reduced snapshot-generation costs while retaining compatibility with established PROM formulations.

0.32

Surrogate Modeling and Reduced-Order Methods in Gravitational-Wave Physics and Numerical Relativity: From Spectral Representations to Adaptive Compression

cs.LG gr-qcastro-ph.HEphysics.comp-ph ·2026-11-18 ·Manuel Tiglio
similarity 0.59
Abstract

The rapid expansion of gravitational-wave astronomy and high-precision numerical relativity has created an acute computational bottleneck: direct numerical integration of the Einstein field equations and high-dimensional Bayesian parameter estimation require millions of waveform evaluations that cannot be sustained by traditional solvers alone. Reduced-order modeling (ROM) and surrogate techniques have emerged as foundational tools to bridge this gap, compressing high-fidelity solution manifolds into compact, rapidly evaluable representations without sacrificing physical accuracy. This perspective reviews the mathematical pillars of projection-based reduced-order modeling---including Proper Orthogonal Decomposition, greedy basis selection, and the Empirical Interpolation Method---and traces their operational impact in gravitational-wave data analysis through surrogate waveform families and Reduced-Order Quadratures. We then examine the fundamental approximation barriers posed by slow Kolmogorov n-width decay in non-stationary, transient, and strongly nonlinear regimes, showing how adaptive hp-greedy domain partitioning and multi-scale spectral compression overcome these limits. Finally, we discuss how combining certified reduced-order structures with modern scientific machine learning and sensitivity-aware quantization provides a rigorous blueprint for next-generation detectors such as LISA, Einstein Telescope, and Cosmic Explorer.

0.26

Adaptive Hybrid Subspace Levenberg Marquardt Algorithm with Adequacy Monitor for Large Scale Least Squares Problems

cs.LG math.NAmath.OC ·2026-08-26 ·M. Duc Hoang, Timothy J. Lewis
similarity 0.57
Abstract · 28 pages, 5 figures

The Levenberg-Marquardt (LM) algorithm is the most widely used method for solving nonlinear least-squares problems, as it combines the robustness of steepest descent with the fast local convergence of the Gauss-Newton method. However, its computational cost can become prohibitive for large-scale problems because each iteration requires solving a large damped linear system, and conventional step acceptance strategies may require repeated solves as the damping parameter is adjusted. Despite this computational challenge, many large-scale least-squares problems exhibit effective low-dimensional structure, with only a small number of parameter-space directions strongly informed by the data. We propose an adaptive hybrid subspace Levenberg-Marquardt (HSLM) algorithm that constructs a low-dimensional subspace from complementary sources of gradient, memory, Krylov-subspace, and randomized curvature information and computes a spectrally damped LM step within this subspace. A distinguishing feature of the method is a deterministic adequacy monitor that quantifies how much descent information is captured by the reduced space and adaptively enriches the subspace when necessary. Step acceptance is decoupled from damping adjustment: Armijo backtracking determines the accepted step length, while the ratio of actual to predicted reduction is used solely to update the damping parameter, thereby avoiding repeated damped-system solves during step acceptance. For the HSLM algorithm, we establish global convergence to stationarity and prove local linear and superlinear convergence. Numerical experiments on neural-network training problems show that HSLM achieves convergence behavior comparable to classical and Krylov subspace LM (KSLM) while substantially reducing per-iteration computational cost, with increasing advantages observed as the parameter dimension grows.

0.45

Parallel Broyden Methods for Efficiently Evaluating Nonlinear State Space Models

cs.LG math.NA ·2026-11-10 ·Ian Christopher Tanoh, Scott W. Linderman
top venuetheory similarity 0.56
Abstract · Accepted at NeurIPS 2026

Nonlinear state space models are typically evaluated sequentially, limiting their ability to exploit modern parallel hardware. Recent work has shown that state space models can be evaluated in parallel by reformulating evaluation as a root-finding problem, which can be solved with a parallel form of Newton's method. However, exact Newton methods require expensive multiplication of dense Jacobian matrices, and quasi-Newton methods based on diagonal approximations, while more scalable, are often slow to converge because they neglect interactions across state dimensions. We introduce a novel quasi-Newton approach based on Broyden's method, which captures coupling terms with diagonal-plus-low-rank approximations to blocks of the Jacobian. We construct the approximations from trajectory secants, avoiding automatic differentiation while retaining the favorable scaling of diagonal approximations and remaining compatible with parallel scan through rank compression. We prove finite-step recovery of the exact trajectory under the compressed scan, and show that convergence is tracked by the compression error and by the block approximation error along the current trajectory error, rather than in spectral norm. Empirically, we show that our method is advantageous when interactions are approximately low rank or when Jacobian evaluation is expensive: on low-rank RNNs, parallel MCMC algorithms, and denoising diffusion models, it converges in fewer iterations than other quasi-Newton methods and is the fastest parallel method when Jacobian evaluation is expensive or state dimensions are large.

0.36

diff-soup: GPU-native Differentiable Simulation and Inference for Large-scale Stiff Dynamical Systems

cs.MS physics.comp-ph ·2026-10-27 ·Samuel Degnan-Morgenstern, Martin Z. Bazant
code/data similarity 0.56
Abstract

Learning physical models from spatiotemporal data requires simulating systems of partial differential equations (PDEs) and differentiating through their solution. Upon spatial discretization, these models give rise to stiff dynamical systems that require repeatedly solving large, sparse linear systems. Traditional scientific computing frameworks are largely CPU-based and require problem-specific tuning to accelerate, scale, and differentiate. In this work, we introduce diff-soup, a differentiable, sparse-oriented, unified PDE suite for GPU-native simulation and inference of large, stiff dynamical systems. Built in JAX, diff-soup provides 1) a fully differentiable design for problems with sparse structure, 2) scaling to large problems through the NVIDIA cuDSS sparse direct solver with model and data multi-GPU parallelism, and 3) end-to-end PDE-constrained optimization, from classical statistical inference to embedded deep learning. On stiff PDE benchmarks, diff-soup outperforms established CPU- and GPU-based frameworks by one to two orders of magnitude in both forward solves and gradients. We demonstrate both a classical Bayesian inference workflow, identifying constitutive relationships, and a modern deep learning workflow, training a neural field for the catalyst activity of a three-dimensional packed bed reactor. We provide diff-soup as an open-source repository to facilitate research in computational science and engineering.

0.31

Predicting Sparse Observables in Parameterized Unsteady Flows Using Coarse-Mesh Graph Neural Networks

cs.LG physics.flu-dyn ·2026-10-27 ·Brener Ramos, William R. Wolf, Tarcísio C. D. Oliveira, Scott T. M. Dawson
similarity 0.55
Abstract

Full-order surrogates for high-dimensional nonlinear flows are often unnecessary when applications require only selected degrees of freedom. We propose reduced-order models that bypass full-state reconstruction by deploying graph neural networks (GNNs) directly on coarse meshes. Applied to parameterized 2D/3D confined cylinder flows and an unevenly heated cavity over Reynolds/Rayleigh-number ranges, the models generalize to unseen conditions and accurately predict sparse probe locations and integrated quantities. Coarse-mesh GNNs match or outperform finer-mesh surrogates while reducing training time and memory, even for 3D chaotic dynamics. A dynamics-informed adaptive sampling strategy guided by frequency-spectrum variations reduces maximum errors by an order of magnitude versus uniform sampling at negligible cost. Coarse-mesh training also makes noise-augmented multi-step unrolling practical, improving long-horizon autoregressive predictions. The approach outperforms parametric DMD, sparse MLPs, U-Nets, and Fourier neural operators at lower cost, and enables system identification and state estimation from sparse observations. These results show that coarse-mesh representations, adaptive sampling, and noise-augmented unrolled training form an efficient framework for reduced-order modeling of parameterized unsteady flows without solver-resolution reconstruction.

0.13