CS Paper Radar

Learning Morse Lyapunov functions through invertible neural networks

Wouter Jongeneel

eess.SY math.OC ·submitted 2026-11-16 12:49 UTC · v1

Abstract

Towards data-driven stability certificates of dynamical systems, we are witnessing renewed interest in studying and exploiting the structure of Lyapunov functions. Especially Lyapunov functions that are locally quadratic (i.e., Morse) gained popularity ever since it was understood that they can be written as the norm squared of a diffeomorphism. This topological representation alludes to parametrizations using invertible neural networks. In this note we discuss when and how such functions can be learned. In particular, using neural ODEs (NODEs), we characterize Sobolev approximation of these diffeomorphisms on compact sets and show how this naturally relates to stability. We also connect our results to PLNets and supply numerical experiments for illustration.

Comment
13 pages, 3 figures, comments are very welcome! Currently under review

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Lyapunov Operators for Nonlinear Systems

cs.LG math.APmath.OC ·2026-09-16 ·Amartya Mukherjee, Maxwell Fitzsimmons, David C. Del Rey Fernández, Jun Liu
published similarity 0.61
Abstract

Constructing Lyapunov functions for nonlinear dynamical systems is a central problem in stability analysis, yet remains challenging. Lyapunov functions are commonly characterized as solutions to first-order partial differential equations (PDEs), but these solutions are typically obtained for single systems, limiting their reuse across systems. In this paper, we study the Lyapunov solution operator that maps a vector field to the corresponding Lyapunov function defined by a dissipation-based Lyapunov PDE. We establish that, on compact subsets of the domain of attraction and under exponential stability assumptions, this operator is well-defined, unique, and continuous with respect to perturbations of both the vector field and the dissipation function. These results provide a theoretical foundation for approximating Lyapunov functions uniformly over families of nonlinear systems. Building on these theoretical foundations, we employ Fourier Neural Operators (FNOs) as a data-driven approximation of the Lyapunov solution operator. Numerical experiments demonstrate that a single trained operator can accurately approximate the numerical Lyapunov functions across parameterized families of dynamics. This illustrates the potential of neural operators for approximating Lyapunov functions.

0.43

Port-Hamiltonian Neural Networks for Systems with Multiple Asymptotically Stable Equilibria

cs.LG eess.SY ·2026-10-01 ·Simon Heilig, Jens Püttschneider, Mohammad Itani, Asja Fischer, Timm Faulwasser
publishedtheory similarity 0.58
Abstract · Accepted at NeurIPS 2026 Workshop: AXIOM - Foundations of Efficient Deep Learning

Stable port-Hamiltonian neural networks certify asymptotic stability by construction. Yet, their Hamiltonian is a global Lyapunov function with a single global minimum, so they can represent only dynamic systems with one attractor. We demonstrate that this excludes even simple systems with energy landscapes forming a double well, and we overcome the restriction by parametrising the Hamiltonian as a product of Bregman divergences generated by one input-convex network. We prove that the resulting model is locally Lyapunov stable, that the coexistence of stable equilibria forces additional non-asymptotically-stable equilibria to exist, that all equilibria lie in a bounded region, and under a hyperbolicity assumption that almost-everywhere stability holds. On three systems our approach is able to recover the energy surface characteristics and improve the convergence speed by 1.8$\times$-8.5$\times$.

0.26

FOSLS-deRhaNN: native de Rham neural classes for H(div) and H(curl) with applications to first-order system least-squares neural network methods for partial differential equations

cs.LG math.NA ·2026-10-06 ·Shun Zhang
similarity 0.58
Abstract

We construct neural approximation classes native to the graph spaces H(div) and H(curl), in two and three dimensions and, for H(div), in any dimension. Every realization lies in the space for all parameter values, and with kinked potentials, such as ReLU networks, the admissible jumps appear at finite width. The classes are images of scalar and componentwise networks under fixed operators of the de Rham complex, and do not involve a mesh or finite element emulation. For H(div) in R^n two native classes are given on an equal footing, with a skew-symmetric potential $A$: $\mathrm{Div}\,A+R_nq+\mathbf{h}$, with the divergence $q$ as an explicit unknown, and $\mathrm{Div}\,A+\mathbf{z}$ with an $H^1$ field $\mathbf{z}$; for H(curl) the analogous classes are $\mathrm{grad}\,φ+Sr+\mathbf{h}$ in two dimensions and $\mathrm{grad}\,φ+\mathbf{z}$ in two and three dimensions. In all of them every interface jump of the field is carried by the potential term, $\mathrm{Div}\,A$ or $\mathrm{grad}\,φ$, while the remaining part has no interface jump (it is an $H^1$ field in the regular-decomposition classes); the classes with $\mathbf{z}$ are the componentwise approach enriched by this term. Known or learned interface geometry enters the potential through factors with trainable amplitudes, and the remaining part if the divergence jumps. The classes lead to the FOSLS-deRhaNN method, first-order system least squares with de Rham neural networks, whose loss is the least-squares functional posed in the natural spaces of the weak formulation; for elliptic equations this includes $H^{-1}$ right-hand sides and $H^{1/2}$ Dirichlet data. Elliptic equations with discontinuous coefficients and curl-curl problems are treated as instances, with the functional equivalent to the error; linear transport with discontinuous solutions and conservation laws with shocks use the same flux classes.

0.46

On global Lyapunov functions being Morse

eess.SY math.DSmath.OC ·2026-10-04 ·Wouter Jongeneel
unusual similarity 0.56
Abstract · 15 pages, 2 figures

Lyapunov functions have been a cornerstone of dynamical systems theory ever since the early 1900s. Moreover and akin to Morse theory, Lyapunov functions have been the key in linking topology to dynamical systems theory. In this note we continue along these lines. Suppose that some vector field on Euclidean space has a unique equilibrium point that is globally asymptotically stable (GAS). Under these conditions, it is known that there is always a smooth Lyapunov function to certify stability. One may wonder if this function can always be chosen to be Morse. We show that if the equilibrium point is hyperbolic, this is indeed true. Moreover, we show that if this would be true in general, then the generalized 4-dimensional smooth Poincaré conjecture (SPC4) must be true. Even so, we provide an example that is GAS, but does not admit a Morse Lyapunov function, closing this route of proving SPC4.

0.29

Universal Approximation of Maximal Lyapunov Functions with Anchored Neural Networks

eess.SY math.OC ·2026-08-18 ·Jun Liu
theory similarity 0.56
Abstract

Maximal Lyapunov functions encode the entire domain of attraction of an asymptotically stable equilibrium, but preserving strict decrease under neural approximation is difficult because its margin vanishes at the equilibrium. For systems locally dominated by an asymptotically stable homogeneous vector field, we construct a continuously differentiable maximal target and an anchored, positivity-preserving neural family. We prove semiglobal universal approximation: strict neural Lyapunov functions and their first derivatives can approximate the target on nested invariant sublevel sets that exhaust the domain of attraction. We also provide directly verifiable conditions under which a candidate neural Lyapunov function can be formally certified, and illustrate the effectiveness of the proposed neural architecture through numerical examples.

0.25

Lagrangian and Hamiltonian Neural Networks With a Dissipative System

cs.LG physics.class-ph ·2026-09-25 ·V. Rayamajhi, J. Singal
similarity 0.55
Abstract · 14 Pages, 7 Figures, 2 Tables, in review. Comments welcome

We investigate the applicability of Lagrangian and Hamiltonian Neural Network models to a dissipative system that has explicit time dependence in its Lagrangian, Hamiltonian, and total energy. To do so we consider these neural network models for simulated systems of a harmonic one-dimensional, one-component oscillator with damping, as well as without damping for comparison. We find that both the Lagrangian and Hamiltonian approaches are able to predict the empirical physical behavior of the damped oscillator systems and to effectively ``learn'' to varying degrees the underlying Lagrangians and Hamiltonians, as has previously been shown to be the case with undamped oscillator systems. These investigations elucidate important properties of Lagrangian and Hamiltonian mechanics, including properties that are not manifest when considering systems without explicit time dependence.

0.33

Unrolled gradients in disguise: bridging interpolation-based and Jacobian regularization for stable neural dynamics

cs.LG math.NA ·2026-11-02 ·Maya Janvier, Etienne Meunier
top venue similarity 0.52
Abstract · Accepted at NeurIPS 2026

Hybrid models and neural differential equations (NDEs) are becoming increasingly important for modelling physical systems; however, they often encounter stability and accuracy issues during long-term integration. Training on unrolled trajectories is known to limit these divergences but quickly becomes too computationally expensive due to the need to compute gradients over an iterative process, making this method impractical for large-scale physical systems (e.g. weather and climate forecasting). Two popular paradigms for improving the stability of learned dynamics are to train on interpolated or noisy samples or to regularize the Jacobian of the learned representation. In this work, we demonstrate that these paradigms can be understood under a common lens and that they both correspond to an approximation of the gradients obtained in an unrolled learning strategy. Building on this understanding, we derive a principled and complete approach to regularize training and demonstrate its impact on the stability of learned dynamical systems.

0.39

Learning Deterministic and Stochastic Forced Hamiltonian Systems

cs.LG math.NAmath.SG ·2026-08-20 ·Benedikt Brantner, Tomasz Tyranowski
theory similarity 0.52
Abstract

We develop a geometric framework for learning deterministic and stochastic forced Hamiltonian systems with neural networks. Motivated by the Lagrange-d'Alembert principle and the theory of variational integrators, we introduce the notion of a Lagrange-d'Alembert map and establish a $C^r$ convergence theorem for first-order one-step methods. Building on these results, we propose Generalized Forced Hamiltonian Neural Networks (GFHNNs), a class of structure-preserving neural networks obtained by concatenating Lagrange-d'Alembert-Euler maps, and prove a universal approximation theorem for this architecture. We further extend the framework to parameter-dependent systems, leading to Parametric Generalized Forced Hamiltonian Neural Networks (PGFHNNs). By interpreting the multiple Stratonovich integrals appearing in the Stratonovich-Taylor expansion as parameters, the same framework can be applied to stochastic forced Hamiltonian systems whenever information about the underlying Wiener process is available. Our numerical experiments demonstrate that the proposed geometric architectures provide significantly improved long-time stability and accuracy compared to non-geometric residual neural networks, while requiring substantially less training data to achieve a comparable level of performance.

0.20