CS Paper Radar

Learning Reduced-Order Dynamics with Singularity via Latent-Augmented Neural Ordinary Differential Equations

Xiaorui Wang, Yu Zhou, Wenjie Mei, Dongzhe Zheng, Yang Bai, Masaaki Nagahara

cs.LG ·submitted 2026-08-22 23:57 UTC · v1
top venue

Abstract

This paper addresses the issue of self-intersecting trajectories (in phase space) in industrial reduced-order modeling and proposes the Latent-Augmented Neural Ordinary Differential Equations (LA-NODEs) framework. From the perspective of artificial intelligence, the proposed method augments conventional neural ordinary differential equations to enhance model expressiveness, enabling the representation of conflicting vector fields that may arise in reduced-order systems, thereby improving learning accuracy. Through theoretical analysis, the underlying mechanism of the framework is established, and a condition for determining the minimum required augmentation dimension is derived. From the perspective of engineering applications, the effectiveness of the proposed method is validated on the reduced-order system of two representative industrial models, namely an interior permanent magnet synchronous motor (IPMSM) drive and a distributed energy system (DES). Experimental results demonstrate that the proposed method can recover system features that are difficult to capture using conventional approaches and achieve superior performance in terms of prediction accuracy and modeling fidelity, thereby providing an effective approach for high-precision data-driven modeling of complex industrial systems.

Closest papers

Nearest neighbours by meaning across the whole index.

Latent-Lagrangian Neural Networks for Reduced Order Modeling of Non-autonomous Nonlinear Dynamical Systems

cs.CE cs.LG ·2026-10-03 ·Anand Kumar Agrawal, Anders Thorin
published similarity 0.68
Abstract

This work proposes a latent Lagrangian-based framework for reduced-order modelling of forced nonlinear dynamical systems. In contrast with conventional Lagrangian or Hamiltonian neural networks, our approach learns a set of latent coordinates sufficient to capture the dynamics conjointly with two neural networks for the latent kinetic and latent potential energies, and leverages force supervision to eliminate the need for an ODE solver during training. Consistency of physical laws in the latent space is ensured through the principle of virtual work. Results show that the model effectively learns the subtle dynamics induced by the system's nonlinearity and non-convex potential energy, and generalizes well to unseen forces and initial conditions. These observations confirm the physical relevance of the proposed approach, and its interest for model reduction.

0.53

An Analytical Review of Model Order Reduction Methodologies of Converter-Dominated Power Systems for Stability Studies

eess.SY ·2026-10-02 ·Goran Grdenić, Marco Fraccaro, Josipa-Pina Milišić
similarity 0.61
Abstract · 53 pages, 4 figures

The rapid integration of renewable energy sources is transforming modern electric power systems into converter-dominated networks characterized by complex multi-timescale dynamics and new stability interactions over a wide frequency range. Accurate analysis of these phenomena requires high-fidelity models of transmission networks and power electronic converters, which often result in large-scale differential-algebraic systems with significant computational burden. This paper provides an analytical review of model order reduction techniques for converter-rich power systems, with particular emphasis on the key equations employed in the reduction process. Advantages and limitations of commonly used strategies, including timescale-based singular perturbation, projection-based, operator-based, data-driven, and machine-learning based methods, are discussed. The synthesis highlights key challenges related to harmonic interactions and multi-frequency dynamics, and outlines directions for the development of computationally efficient yet dynamically accurate reduced-order models for future power systems.

0.29

Reduced-Order Physics-Informed Neural Network with Adaptive Basis Refinement for Structural Identification

cs.CE physics.comp-ph ·2026-08-17 ·Rui Zhang, Konstantinos Vlachas, Eleni Chatzi
similarity 0.59
Abstract

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems. However, their direct application to structural dynamics remains limited by high system dimensionality and model-form errors arising from incomplete physics. Reduced-order models (ROMs) can alleviate the dimensionality bottleneck, yet existing PINN-ROM couplings typically rely on fixed reduced subspaces, target forward simulations, or assume complete physics, restricting their use for inverse identification under parametric variability or incomplete system knowledge. To address these limitations, this work proposes a Reduced-Order Physics-Informed Neural Network (RO-PINN) framework with adaptive basis refinement for structural identification under known and incomplete physics. Via projection, reduced governing equations are embedded directly into the PINN loss, facilitating learning in a low-dimensional latent space. An adaptive scheme updates the projection basis during training so that the latent space is progressively realigned with evolving structural parameters or learned residual restoring forces. This realignment reduces basis-mismatch errors and limits their influence on the inferred residual force. The method is validated on a four-story steel frame with nonlinear hysteretic braces under sparse and noisy measurements. Results show parameter identification comparable to or more accurate than Bayesian model updating with lower computational cost in the considered cases, recovery of unmodeled nonlinear restoring forces under incomplete physics, and joint identification of residual restoring forces and structural parameters within the same framework. Overall, RO-PINN provides a unified framework for structural identification by integrating reduced-order modeling, adaptive basis refinement, and physics-informed learning within a single formulation.

0.34

Dirac-Interconnected Neural Elements: Discovering Modularity in Physical Systems Without Reduction

cs.LG ·2026-10-02 ·Reiho Li, Razmik Arman Khosrovian, Takaharu Yaguchi, Hiroaki Yoshimura, Takashi Matsubara
similarity 0.57
Abstract · 29 pages, 3 figures, 8 tables

Deep learning has shown remarkable success in the data-driven modeling of dynamical systems. Much of its success is attributed not to the flexibility of neural networks but to inductive biases based on physical prior knowledge, such as energy conservation and symplecticity. However, existing methods do not fully exploit the fact that real-world physical systems are interconnections of components. Some methods require the interconnection to be known a priori, while others assume the system to be reducible to an ordinary differential equation (ODE) and learn only the reduced ODE, discarding the algebraic constraints imposed by the interconnection. Here, we propose Dirac-interconnected neural elements (DINEs), a neural network model that represents a physical system as a differential-algebraic equation (DAE), whose algebraic constraints are given by a Dirac structure in kernel representation. With DINEs, we simultaneously identify from data the interconnection among the components as a Dirac structure and learn the characteristics of the components as neural networks. This allows us to keep the learned subsystems in unreduced form and isolate or compose them to make a new system without retraining. Moreover, DINEs can handle partially observable systems. Experimental results demonstrate these capabilities on physical systems beyond the reach of existing methods.

0.30

Data-Driven Learning of Unknown Nonlinear Differential Equations Using Functional Analysis

cs.LG cs.AIeess.SY ·2026-09-03 ·Seyyed Shaho Alaviani, Yongzhi Qu, Gregory W. Vogl
similarity 0.55
Abstract

In this paper, the problem of data-driven discovery of nonlinear ordinary differential equations (ODEs) is recast, and a new interpretable machine learning (ML) method is proposed. The proposed method aims to learn the unknown vector field of nonlinear dynamics without prior knowledge of the system's physics from only one single state trajectory's data. The proposed method has two fundamental differences with existing methods: 1) the formulation presented in this method is derived based on Functional Analysis and Operator Theory, and 2) the cost function is constructed in the function space as a distance between two functions as an integral, instead of the discrete-sum of errors used in existing ML approaches. An incremental learning algorithm is proposed to learn the unknown vector field to handle new training samples in an online manner. The proposed method can discover the unknown vector field from both forced and unforced autonomous and non-autonomous (or time-varying) dynamical systems. The proposed method is able to simultaneously discover unknown external forces as a function of time and unknown underlying dynamics. Finally, numerical examples are given to demonstrate the advantages of the proposed method.

0.25

Dissipative Lagrangian Neural Networks for the Interpretable Modelling of Passive Mechanical Systems

cs.LG cs.CE ·2026-10-11 ·Rob Seabourne, Alice Cicirello
similarity 0.55
Abstract

In this paper, we propose the Dissipative Lagrangian Neural Network (dLNN), a continuous-time system identification technique that separately learns the conservative and dissipative dynamics of a mechanical system directly from data. A key contribution is a novel parametrisation of dissipative forces that (i) is structurally constrained to be dissipative, enforcing passivity of the learned model, (ii) cannot absorb conservative mechanics, and (iii) retains sufficient expressivity to represent a broad family of state-dependent damping and regularised friction forces. The model is validated on prediction tasks on two real-world mechanical systems: trajectory prediction of a chaotic double pendulum and inverse-dynamics modelling of a six-degree-of-freedom industrial robot. Across these tasks, the dLNN demonstrates improved predictive performance over existing Lagrangian architectures while remaining competitive with a black-box neural model. The imposed physical structure also improves generalisation to unseen states, with the benefits becoming particularly pronounced when training data is limited. Finally, we introduce a symbolic distillation procedure that extracts closed-form expressions from the learned physical components. Applied to the industrial robot, this produces interpretable symbolic models that retain high predictive accuracy while reducing the computational overhead associated with evaluating neural Lagrangian models.

0.08

Learning Higher Order DC-DC Converter Control from Inversion

eess.SY ·2026-09-30 ·Kamakshi Tatkare, Ufuk Topcu, Brian Johnson
similarity 0.54
Abstract · Accepted at the IEEE 27th Workshop on Control and Modeling for Power Electronics (COMPEL 2026)

Control design for high-order converters with nonlinear dynamics is generally difficult. Nonlinear controls introduce formidable model complexity whereas linear controls suffer from poor disturbance rejection. Our objective in this paper is to develop a simple neural-network-based controller that learns the control law from supervised trajectories generated by a model-based bounded inversion framework. First, we establish strong invertibility for the converter models. Next, we prescribe the desired closed-loop behavior through a trajectory model that defines the target dynamics. We then invert the converter dynamics numerically to obtain the corresponding duty-cycle and state trajectories. We use these model-based trajectories as supervision and train a neural network to approximate the resulting state-to-duty control law. The results show that the learned controllers accurately recover the inversion-based control action and achieve effective regulation under load and input-voltage disturbances. We validate the method on fourth order Cuk, SEPIC, and zeta converters.

0.54

Physics-Informed Stochastic Configuration Machine: A Backpropagation-Free Neural Network with Fast Training for Nonlinear Differential Equations

cs.AI math.NAcs.LGeess.SY ·2026-08-27 ·Yuehao Song, Zhong Chen, Lihui Cen, Liang Wu, Kai Zhang
similarity 0.54
Abstract · 17 pages, 4 figures

While Physics-Informed Neural Networks (PINNs) have emerged as a transformative paradigm for solving complex differential equations, their reliance on backpropagation-based gradient descent and automatic differentiation (AD) imposes significant computational bottlenecks and severe non-convex optimization challenges. To overcome these fundamental limitations, we propose the Physics-Informed Stochastic Configuration Machine (PI-SCM), a novel backpropagation-free framework for both forward and inverse problems in differential equations. The core mathematical contribution lies in the analytical evaluation of local Jacobians for nonlinear differential operators, which facilitates a linearized representation of the physical loss and projects it into a unified, linearized algebraic subspace. This reformulation allows for the explicit determination of optimal network weights via a sequence of generalized linear least squares solvers, effectively bypassing the iterative traps of traditional nonlinear optimizers. We develop a progressive algorithmic suite comprising localized construction (PI-SC-I), sliding-window updating (PI-SC-II), and global updating (PI-SC-III), and rigorously establish their universal approximation properties. Extensive experiments demonstrate that PI-SCM achieves high-fidelity predictive accuracy and robust parameter identification while accelerating the training process by orders of magnitude compared to standard PINNs. Our work provides a highly efficient and scalable foundation for next-generation, real-time Scientific Machine Learning applications.

0.13