CS Paper Radar

Feature tracking in physics-informed neural networks via joint optimization of nonlinear deformation manifolds: application to shocks

Akshay Thakur, Matthew Zahr

cs.CE physics.comp-phphysics.flu-dynstat.ML ·submitted 2026-09-24 20:02 UTC · v1
hot direction

Abstract

Physics-informed neural networks (PINNs) often converge to inaccurate solutions for conservation laws with shocks, because uniformly distributed collocation points undersample localized features and let the residual be dominated by regions that are already well resolved. We propose a feature-tracking PINN (FT-PINN) in which the solution network is defined on a fixed reference domain and composed with a diffeomorphic deformation map from a parameterized nonlinear manifold. The deformation and solution-network parameters are trained jointly by minimizing the pulled-back conservation-law residual. This lets collocation points concentrate along features of essentially arbitrary geometry, including curved, oblique, and merging shocks, without prior knowledge of their locations. The framework is agnostic to the choice of parameterization. Boundary preservation is enforced exactly through a tangential projection of the displacement, and folding is discouraged by a one-sided penalty on the Jacobian determinant. On four test problems (space-time viscous Burgers with merging shocks, a decelerating Burgers shock, the space-time Euler shock tube, and steady 2D Euler regular shock reflection), FT-PINN resolves shocks at their correct locations with a limited collocation budget. A vanilla PINN with the same architecture, budget, and training either misplaces the shocks or fails to form them.

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Physics from an Imperfect Ancestor

cs.LG ·2026-09-21 ·S. Mohammad Mousavi, Teeratorn Kadeethum, Nikolaos Bouklas, Somdatta Goswami
similarity 0.62
Abstract

Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed neural networks avoid dependence on labeled data, yet their optimization can be basin-fragile: when the governing residual admits multiple solutions, a PINN trained from scratch may converge to a physically incorrect state despite achieving a small residual. We show that these failure modes can be addressed jointly: an imperfect NO provides the structural prior needed to place a PINN in the correct solution basin, while the PDE residual refines the solution beyond the operator's accuracy. We introduce a three-stage framework that freezes the spatial basis of a physics-informed NO, extrapolates its solution branch to an out-of-distribution parameter using a polynomial continuation prior, and distills the resulting field into a fresh PINN. The NO need not be accurate at the target; it transfers solution-branch information, while PDE residual minimization in the PINN governs convergence. We evaluate the framework on three nonlinear PDEs: 1D viscous Burgers, 2D steady Allen-Cahn near a pitchfork bifurcation, and 2D steady lid-driven cavity flow. For Allen-Cahn, where the trivial solution satisfies the PDE residual exactly, a standard PINN collapses to the trivial zero branch, whereas distillation from the crude extrapolated operator recovers the non-trivial branch that matches the finite-difference reference. For the lid-driven cavity, extrapolating to a Reynolds number of Re = 3200 accelerates convergence to the correct physical state, achieving competitive accuracy using fewer parameters and optimization steps than recent literature baselines. These results establish a simple principle: an NO need not accurately predict the solution to be useful; it only needs to identify the correct basin from which PINN optimization can recover it.

0.12

Equidistribution of Solution Gradients in Physics-Informed Neural Networks via Coordinate Transformations

cs.AI math.NAcs.LG ·2026-11-06 ·Tianchi Yu, Ivan Oseledets
similarity 0.61
Abstract

Physics-Informed Neural Networks (PINNs) often struggle to approximate solutions with sharp gradients due to optimization difficulties and spectral bias. Motivated by the principle of gradient equidistribution from the stretching approach in grid generation, which redistributes solution gradients to reduce functional complexity, we propose Coordinate Transformation PINNs (CTPINNs), which incorporate learnable coordinate transformations to map the physical domain into a computational domain where the physical solutions become approximately affine, making them easier for neural networks to learn. We propose two constructions of the transformation: an explicit construction based on Majorants and an implicit construction based on invertable neural networks. Experimentally, the explicit construction can improve accuracy for PDEs with available explicit coordinate transformations, and the implicit construction can be combined with other advanced PINN models as an efficient plug-in module to improve performance across a range of challenging PDE benchmarks.

0.21

Tensor-Train Compressed Separable PINNs: A Curvature-Aware Optimization Framework for Parametric PDEs in High Dimensions

cs.LG math.OCmath.NA ·2026-09-28 ·Denis Korolev, Martin Eigel
similarity 0.60
Abstract

In this work, we develop a second-order optimization framework for physics-informed neural networks (PINNs) applied to high-dimensional parametric partial differential equations (PDEs). The framework is built on the Gauss--Newton pullback metric, which provides an operator-informed notion of curvature in parameter space and connects the method to the broader family of natural gradient schemes. We show that, for coordinate-separable neural architectures and linear differential operators (or linearized operators in the nonlinear case) admitting a finite separable representation, the residual Jacobian inherits a structured separable factorization. This yields an exact compressed formulation of the Gauss--Newton step in a reduced space, without assembling the full residual Jacobian on the exponentially large tensor-product collocation grid. The dimension of the reduced space (the effective compressed dimension) is determined by the local collocation grid sizes, the separable operator structure, and the contraction pattern of the architecture, thereby avoiding dependence on the full tensor-product grid size and replacing dense linear algebra in parameter space by a substantially smaller structured problem. Within our framework, we investigate canonical polyadic and tensor-train parametrizations and derive their full algebraic characterization relevant to the Gauss--Newton method, including the structure of the residual Jacobian, the resulting compressed system, and its effective compressed dimension. Numerical experiments on high-dimensional PDEs, including parametric problems, demonstrate the high efficiency of the proposed compressed Gauss--Newton method, which achieves substantially lower errors than tensor-compressed first-order baselines with orders of magnitude fewer iterations and only a fraction of the computing time.

0.25

Physics-Informed Learning of Feedback-Linearizing Representations

eess.SY ·2026-09-26 ·Pavlos Kallinikidis, Fengjun Yang, David Snyder, Jacob H. Seidman, Nikolai Matni +2 more
theory similarity 0.60
Abstract

Feedback linearization is a powerful tool in nonlinear control, but finding the linearizing coordinate transform remains challenging. Feedback linearizing transforms are governed by well-established partial differential equations (PDEs) whose well-posedness is based on the Lie-algebraic Frobenius theorem, but solving the PDEs becomes computationally intractable for large system dimensions. To address this challenge, we propose a cascaded physics-informed neural network (PINN) framework to approximately solve these PDEs. By separately parameterizing terms of different Lie derivative orders, we mitigate the compounding errors inherent in fitting high-order Lie derivatives of neural networks. Furthermore, we use the learned transform to design a tracking controller and establish theoretical bounds on its error with respect to inaccuracies in the learned feedback-linearizing representation. We validate our method on a broad class of feedback linearizable systems, including a multi-input, multi-output planar quadrotor and synthetic examples for which analytical approaches are impractical, and demonstrate that our approach can computationally discover effective feedback-linearizing representations of nonlinear systems for control tasks.

0.22

A Systematic Analysis of Automatic Differentiation versus Discretization-based Constraints for Physics-Informed PDE Solvers

cs.LG math.NAphysics.flu-dyn ·2026-09-07 ·Xing Guo, Hongwei Tang, Zewei Meng, Yidong Zhang, Shaoqiu Xiao +1 more
code/data similarity 0.60
Abstract

Physics-informed neural networks (PINNs) represent a growing frontier in using artificial intelligence to solve partial differential equations (PDEs). Automatic differentiation (AD) plays a central role in this paradigm, which is mesh-free and replaces traditional iterative solvers with gradient-based optimization in continuous space. However, the inherent limitations of AD, particularly in handling higher-order derivatives and discontinuous solutions, pose significant challenges for complex problems. This has motivated a growing number of researchers to explore discretization-based constraints as an alternative path. Yet, the respective applicability of these two paradigms remains largely unexplored. In this work, we conduct systematic experiments across a wide spectrum of problems, from simple linear Poisson to high-Mach hypersonic flows with strong discontinuities. Through a rigorous decomposition of approximation, optimization, and truncation errors, we systematically elucidate the fundamental trade-offs and error-governing mechanisms of both paradigms, as well as two representative network architectures: multi-layer perceptron (MLP) and graph neural network (GNN). Our results reveal a consistent trend: as nonlinearity strengthens, the accuracy advantage of discretization-based constraints becomes increasingly pronounced, with smaller optimization errors compensating for the truncation errors. Moreover, the more complex the nonlinearity and boundary conditions, the greater the advantage of GNN over MLP. These insights offer a robust practical guideline for configuring neural PDE solvers in demanding engineering applications. Our source data and code are available at https://github.com/guoxing0809/neuropde_analysis.

0.29

Hard Constraint Projection in a Physics Informed Neural Network (Burgers)

cs.LG physics.flu-dyn ·2026-10-30 ·Miranda J S Horne, Peter K Jimack, Amirul Khan, He Wang
publishedhighly cited similarity 0.60
Abstract · 6 pages, 3 figures, In proceedings of 1st international Symposium on AI and Fluid Mechanics 2025 (Paper No. S11P2)

Physics informed machine learning provides a framework to study and simulate fluid dynamics, potentially at a fraction of the computational cost of traditional numerical methods, with the goal of improving the explainability, accuracy and robustness of purely data driven machine learning methods. In this work, we extend the hard constraint projection (HCP) method developed by Chen et al. [Journal of Computational Physics, 445, 110624, 2021] from a linear partial differential equation (PDE) to a nonlinear PDE: the 1D Burgers' equation. To strictly impose a discrete approximation of the governing equation, the Burgers' equation is first locally discretised (using a finite difference stencil) then decomposed into a constraint matrix and a prediction matrix. Using tools from linear algebra, the constraint matrix is used to construct a projection matrix. A physics informed neural network (PINN) [Raissi et al. Journal of Computational Physics, 378, 686, 2019] is used to predict the velocity, and a final unlearnable layer projects the velocity prediction to the hyperplane of exact solutions to a discretised form of the Burgers' equation. Our initial results indicate that the HCP-PINN initially trains similarly to an equivalent PINN, and as the PINN loss plateaus, the HCP-PINN loss continues to decline. When tested on a previously unseen uniform grid of points covering the domain, the HCP-PINN exhibits higher accuracy, converging to a data error approximately an order of magnitude lower than the comparable PINN. We also observe that the inclusion of the HCP layer results in better observance of the governing PDE. Our findings suggest that the HCP-PINN can be more robust to the selection of physics collocation points, and less dependent on collocation point quantity.

0.39

Equation informed time reparametrization for physics informed neural networks

cs.CE ·2026-10-30 ·Orestis Belokas, Christoforos Rekatsinas
similarity 0.59
Abstract · 25 figures, 4 tables

Physics Informed Neural Networks offer a mesh-free approach to solving differential equations, but their application to time-dependent problems remains challenging, particularly when the governing dynamics involve widely different time scales. With collocation points spread uniformly in time, short intervals of rapid change are under resolved. This work introduces an equation informed time reparameterization framework that modifies the temporal coordinate used during PINN training based on the local dynamics of the governing equation. The proposed method follows a two stage procedure. First, a pilot PINN training provides an approximate solution, which is used to linearize the governing differential operator and estimate its local response to small perturbations. These responses are combined into a time-dependent rate function, large where the dynamics are fast, that defines a strictly increasing transformation from physical time to a new computational time coordinate. A second PINN is then trained on the transformed governing equation, with uniformly sampled collocation points in the new coordinate producing a nonuniform distribution in physical time. Different combination rules and spatial reduction strategies are considered. With the cost of the pilot training included, the method reduces the error by a factor of 4 to 29 relative to the best alternative method on the Kachanov Rabotnov creep-damage model near rupture, and by a factor of 5 to 16 relative to every alternative method on the Frank-Kamenetskii equation near blow up.

0.08

Geometry Meets Physics: Data-Efficient Pre-Training for Unstructured Neural PDE Solvers

cs.AI ·2026-10-02 ·Luis Medrano-Navarro, Giacomo Baldan, Qiang Liu, Benjamin Holzschuh, Jan Hagnberger +2 more
top venuecode/data similarity 0.59
Abstract · Accepted to NeurIPS 2026. Code and models are available at https://github.com/tum-pbs/GMP

Neural surrogate models for Partial Differential Equations (PDEs) on unstructured 3D geometries are often limited by poor generalization and the high cost of generating large-scale training datasets. Consequently, pre-training on massive datasets of related PDE dynamics has emerged as a critical alternative to enhance the robustness and scalability of these models. However, this strategy is neither compute- nor data-efficient, as it relies on massive pre-computed data that is very costly to generate. In this work, we introduce a disk-data-free pre-training framework tailored to both steady-state and transient regimes. For steady-state problems, we propose a geometry-driven strategy that leverages intrinsic shape descriptors to learn representations of complex 3D domains. For transient problems, we introduce a physics-driven approach based on online generation of synthetic PDE data, enabling scalable pre-training without reliance on expensive datasets. Across multiple experiments, our approach achieves faster convergence, greater data efficiency, and higher accuracy during fine-tuning, particularly under realistic low-data regimes. This methodology provides a practical pathway toward data-efficient neural emulators for large-scale simulations. Code and models are available at https://github.com/tum-pbs/GMP.

0.43