CS Paper Radar

A priori Assessment of Tensor-Network Encoding for Isotropic Turbulent Flows

Massen Esmaeili, Hirad Alipanah, Robert Pinkston, Peyman Givi, Daniel Livescu, Andrew J. Daley, Dieter Jaksch, Juan José Mendoza-Arenas

cs.CE physics.flu-dynquant-ph ·submitted 2026-08-28 21:10 UTC · v1

Abstract

Tensor networks (TNs), originally developed for simulating many-body quantum systems, provide a systematic framework for approximating high-dimensional fields. This is achieved by factorizing the field into interconnected tensors with small bond dimensions, thereby restricting the correlations captured across field bipartitions. Belonging to the family of TNs, the matrix product state (MPS) ansatz is utilized here as a reduced-order modeling framework to construct truncated representations of isotropic turbulent flow data. Two direct numerical simulation (DNS) datasets are considered: the hydrodynamic field of an incompressible three-dimensional flow, and a conserved Fickian scalar in a similar flow. Each field is encoded as an MPS through a sequence of singular value decompositions (SVDs) in which small singular values are discarded. The truncated representation is contracted back to the full grid, and the resulting reconstructed field is compared against DNS. An interleaved ordering of the spatial tensor indices of the transport variables is applied prior to decomposition in order to localize the dominant inter-tensor correlations. Velocity reconstructions achieve $99.8\%$ fidelity using only $5\%$ of the original DNS memory, while the scalar field reaches the same fidelity at $15\%$ memory usage. A wide range of lower- and higher-order statistics, including velocity gradients, dissipation, and structure functions, are systematically examined. At these compression levels, the total kinetic energy and the scalar energy are both recovered within $0.2\%$ relative error, while the mean dissipation and mean scalar dissipation remain within approximately $10\%$ of the DNS generated values. These findings support the suitability of MPS for scalable reduced-order analysis of complex turbulent datasets and motivate further exploration of TN-based methods in computational turbulence.

Comment
23 pages, 17 figures, 5 tables

Closest papers

Nearest neighbours by meaning across the whole index.

High-fidelity Three-Dimensional Flow Field Reconstruction Driven by Turbulent Fluid Dynamics

cs.AI physics.flu-dyncs.LG ·2026-10-13 ·Hanlin Kong, Jianan Wei, Yuntian Chen, Yujia Wang, Wenguan Wang
similarity 0.62
Abstract · 66 pages, 9 main-text figures and 1 main-text table; includes Supplementary Information with 14 figures and 22 tables

High-fidelity three-dimensional turbulent flow fields are essential for scientific and engineering analyses, yet obtaining them through direct numerical simulation or high-resolution measurements remains expensive. Super-resolution reconstruction from coarse-grained data therefore offers a promising alternative, but remains fundamentally challenging because fine-scale structures are intrinsically three-dimensional and dynamically coupled across scales. Existing data-driven approaches still struggle to recover multiscale volumetric structures and their coherent temporal evolution. To address these limitations, we propose a turbulence-aware framework for time-resolved three-dimensional flow reconstruction. The framework couples a multiscale neural operator, designed to recover volumetric structures, with a state space model to promote temporal consistency in the reconstructed dynamics. In addition, Navier-Stokes residuals are incorporated as soft constraints to regularize the reconstruction toward physically plausible dynamics. A mixture-of-experts mechanism is also introduced to support unsupervised adaptation to unknown coarse-graining. Across evaluations on canonical turbulent systems and atmospheric reanalysis data, the proposed framework reduces reconstruction errors relative to learning-based and classical baselines, while better preserving multiscale spatial structure and coherent temporal evolution. These results validate the effectiveness of the proposed framework in reconstructing high-fidelity three-dimensional flow fields from coarse-grained data.

0.26

Asymptotic-Preserving Tensor Neural Networks for 3D High-Field Kinetic Equations with Applications to Uncertainty Quantification

cs.LG math.NA ·2026-11-05 ·Shi Jin, Tian-ai Zhang
similarity 0.57
Abstract

Kinetic equations in the high-field regime describe particle transport dominated by electric-field acceleration and collisional relaxation. These equations are widely used in simulations of plasmas and semiconductor devices. Typical models include the Vlasov--Poisson--Fokker--Planck (VPFP) and Boltzmann--Poisson systems. Their high dimensionality and multiscale nature pose two of the major challenges to accurate and efficient numerical solution. To address these challenges, we propose an asymptotic-preserving tensor neural network (APTNN) method. Specifically, to reduce high-dimensional computational costs and memory requirements, we adopt the canonical polyadic (CP) decomposition structure of TNNs to approximate their solutions. We show that the equation residuals retain this decomposition form, allowing high-dimensional loss integrals to be evaluated through combinations of one-dimensional integrals. The resulting computational and storage costs are reduced from exponential to polynomial growth with dimension. To improve the prediction accuracy in the high-field limit, we enhance the baseline AP loss by incorporating the first moment equation. The added loss term directly constrains the limiting flux closure to reduce its approximation error in the high-field regime. The enhanced AP loss can still be evaluated dimension-wise. Numerical results show that APTNN improves prediction accuracy in the high-field regime with significantly reduced computational costs and memory usage. For a 3D3V VPFP problem with multiple random inputs, training takes less than 30 minutes on a single GPU.

0.26

A Product-Grassmann Tucker Surrogate for Parametric Field Prediction

cs.CE ·2026-10-25 ·Melika Baghi, Xiao Liu, Kamran Paynabar
similarity 0.56
Abstract · 50 pages (34 main text and 16 supplementary material), 11 figures, 13 tables. Submitted to the Journal of Computational Physics

Many-query applications such as design optimization, uncertainty quantification and digital twins call for repeated full-field predictions from expensive partial differential equation (PDE) simulations. Grassmannian reduced-order models interpolate parameter-dependent subspaces but commonly vectorize the spatial field, and the ambient dimension then grows with the product of the grid sizes. Tensor-based models preserve the multiway structure but often use shared mode-wise bases or a fixed core across parameters. We propose a Tucker-based surrogate that keeps the spatial directions and time as separate modes. The factor subspaces are interpolated on a product Grassmann manifold, Procrustes alignment places the Tucker cores in one coordinate system, and a truncated singular value decomposition models their variation. Across five PDE benchmarks in two and three spatial dimensions, including public computational fluid dynamics data, the interpolation size is reduced by factors of 13 to 482 and the stored model by factors of 13 to 464 relative to a single-subspace Grassmannian surrogate with the same local interpolation. Cached queries run 3.3 to 8.5 times faster, the mean errors over ten resampled splits differ by at most 0.22 percentage points (0.36 when every model choice is re-selected inside each split), and the prediction-error terms of the two methods differ by less than 0.1 percentage points. The remaining accuracy differences are consistent with the larger representation error of the Tucker format. In a three-dimensional grid study the interpolation-size ratio rises to 2,260 and the query speedup to 11.9 at 64^3.

0.18

Let's Do Turbulence Right: In Space and Time!

cs.LG physics.flu-dyn ·2026-10-23 ·Maximilian Plattner, Fabian Paischer, Johannes Brandstetter
similarity 0.56
Abstract

The three-dimensional Navier-Stokes equations govern fluid turbulence, a chaotic and non-linear physical phenomenon characterized by complex eddies interacting across vast spatial and temporal scales. A numerically accurate modeling of this multi-scale energy cascade requires fully resolving both the fine spatial structures and the continuous temporal evolution of the flow field. In this paper, we leverage massive, time-resolved direct numerical simulations, which exceed 28 TB per run, to assess how numerical choices govern the resolved (3+1)-dimensional physics of turbulent flows. Building on this analysis, we study how neural networks represent the recorded turbulent motion. Our results highlight that spatial and temporal assessments can disagree for both numerical records and learned representations. We therefore call on the machine learning community to treat (3+1)-dimensional turbulence as a four-dimensional phenomenon.

0.15

Learning Incompressible 3D Flows from Sparse Samples: A Set Transformer Approach to Divergence-Free Kernel Fitting

cs.LG cs.AIcs.CE ·2026-10-12 ·Ramzi Idoughi, Radouan Boukharfane, Peter Wonka
similarity 0.55
Abstract · 33 pages with supplement materials, 9 figures

Recovering divergence-free velocity fields from sparse and corrupted observations requires reconciling physical consistency, expressive representations, and robustness to missing data. We introduce DFK-Former, a set-to-field transformer that reconstructs divergence-free velocity fields from sparse, noisy, and irregularly sampled 3D observations. The model is inherently invariant to the number and ordering of input samples and predicts the parameters of a divergence-free kernel representation, producing continuous, mesh-free velocity fields that satisfy incompressibility exactly by construction rather than approximately through soft constraints or projection operators. Unlike existing divergence-free kernel approaches, which estimate kernel coefficients via a separate optimization for each field, DFK-Former predicts these coefficients directly in a single forward pass. This eliminates costly iterative fitting while providing a learned prior that enables accurate reconstruction even when observations are insufficient to uniquely determine the field. To enhance representational power, we introduce adaptive and anisotropic divergence-free kernels that preserve exact incompressibility guarantees while capturing more complex flow structures. Extensive experiments across varying levels of sparsity, noise, and occlusion, including transfer to real Direct Numerical Simulation (DNS) turbulence data, demonstrate substantial gains in both accuracy and efficiency. DFK-Former reduces endpoint error by up to 4.6x compared to per-field divergence-free-kernel optimization, while reconstructing each field in 7.5 ms instead of 9.8 s, yielding a speedup of more than three orders of magnitude. These results establish direct, feed-forward prediction of divergence-free kernel parameters as a practical and effective paradigm for physically consistent velocity-field reconstruction from sparse observations.

0.22

Iterative tensor network transformations for element-wise evaluation of elementary and filtering functions

cs.LG cond-mat.stat-mechcs.AIphysics.comp-ph+1 ·2026-08-17 ·Xiao Wang, Tomohiro Hashizume, Pia Siegl, Dieter Jaksch
similarity 0.55
Abstract · 23 pages, 10 figures

Tensor networks are powerful formats for compressing large-scale data. However, their application to general data processing has been limited by the difficulty of performing nonlinear operations. Here, we introduce iterative tensor network transformations (ITNTs), a general algorithmic framework for the element-wise evaluation of elementary and nonlinear filtering functions on data encoded as tensor trains (TTs), a class of tensor networks. Our approach operates entirely in the compressed domain, enabling efficient computation on exponentially large datasets while maintaining a controlled computational cost. We demonstrate its power in two key areas: (I) evaluating highly nonlinear elementary and filtering functions on a 3D reactive flow field, enabling high-fidelity reaction rate computation and region filtering, and (II) finding extrema in complex optimization problems, such as solving Max-SAT instances on spaces up to $2^{70}$ configurations. These results establish ITNT as a foundational tool that provides tensor network methods with the capability for general-purpose data science and large-scale optimization.

0.49

Scalable quantum simulation of continuous-time generative models via tensor networks

cs.AI quant-phcs.LG ·2026-08-22 ·Nathan X. Kodama, L. Andrew Wray, Sam Cochran, Chad Rigetti, Shravan Veerapaneni +1 more
similarity 0.54
Abstract

Continuous-time flow and diffusion models are widely used across many application domains, from large-scale deployment in computer vision and protein folding to emerging adoption for modeling language, time series, and quantum states. After training, inferring statistical properties from continuous-time models is costly. Wavefunction flows target this cost by recasting learned transport as unitary evolution, whose final Born distribution approximates the target distribution. This prepares a coherent amplitude encoding (a qsample) that can be post-processed by quantum algorithms offering a quadratic advantage over Monte Carlo sampling. We present the first numerical study of these flows, in which we represent time-dependent potentials and states as tensor networks. At spatial dimension $d=8$, storage falls by $\sim 10^7\times$ relative to the dense grid of $N^d$ points, and evolution wall-clock time falls by $\gtrsim 10^3\times$ against a baseline extrapolated from the measured $d\le 5$ scaling. We validate our pipeline by reproducing the $O(1/\sqrt{p_{\rm rare}})$ scaling of rare-event sampling.

0.26

FlowReconBench: Accuracy, calibration and cost of learned and classical flow reconstruction from sparse sensors

cs.LG physics.flu-dyn ·2026-11-04 ·Nicolas Tricard, Linzheng Wang, Jason Chen, Sili Deng
similarity 0.54
Abstract · 18 pages, 7 figures, 8 tables. Supplementary material (16 pages, 2 figures, 5 tables) is included as an ancillary file

Reconstructing full flow fields from sparse sensors requires prior assumptions about unmeasured regions and physical variables. Yet it remains unclear when learned models outperform classical estimators and which aspects of their predictions can be trusted. FlowReconBench evaluates ten learned and five classical methods on three regimes: a laminar cylinder wake across Reynolds numbers, two-dimensional Kolmogorov turbulence and a large-scale three-dimensional (3D) isotropic turbulence. Methods share leakage-controlled splits and sensor draws and are scored on per-channel error, ensemble spread, calibration, spectra and cost. The leading method changes for each regime. Classical methods perform strongly in low-order and dense-sensing regimes. On the cylinder wake, linear stochastic estimation and gappy proper orthogonal decomposition lead, including for unobserved pressure. In 3D, inverse-distance weighting matches the best learned methods on observed channels. Data-driven methods become superior at decreasing sensor density or poor sensor observability. On Kolmogorov flow, continuous ranked probability score and error yield different method rankings: generative models offer broader but underdispersed ensembles, while deterministic models prioritize pointwise error. Generative models balance this tradeoff through their sampler budget, with a larger budget improving ensemble quality at higher computational cost. In 3D, scaling tests demonstrate that queryable methods are flat in memory, while full-grid construction methods run out of memory. Observing only 2 of 4 fields leaves the problem kinematically underconstrained, yet a latent model can reproduce structural similarities to the ground truth.

0.29