CS Paper Radar

Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees

Hannah Berin-Costain, Jun Liu, Kirsten Morris

eess.SY ·submitted 2026-11-10 00:46 UTC · v1
theory

Abstract

Physics-informed neural network (PINN) Kazantzis--Kravaris--Luenberger (KKL) observers require an approximate solution to a KKL partial differential equation (PDE) and an approximate inverse of this solution. Either approximation can leave a nonzero estimation bias even without measurement noise. In this paper, we remove both errors from the implemented observer by construction. We build an encoder containing an explicitly invertible neural map. Its closed-form inverse provides the internal state reconstruction used to evaluate the learned KKL residual and correct the latent dynamics. This construction makes the synchronization manifold exactly invariant for every value of the network weights. Based on contraction of the residual-corrected observer dynamics, we prove an input-to-state stability (ISS) result for the implemented error dynamics with respect to measurement noise. A direct consequence is that the estimation error converges exponentially to zero in the noise-free setting. We provide two numerical examples, the Van der Pol oscillator and the chaotic Lorenz system, in which the residual-corrected observers achieve exact noise-free convergence and improved error responses compared with released PINN--KKL baselines.

Comment
7 pages, 1 figure, ACC 2027 conference submission

Closest papers

Nearest neighbours by meaning across the whole index.

A KKL Observer Perspective on Reservoir Computing

eess.SY cs.LGmath.DSmath.OC ·2026-10-03 ·Anastasia Bizyaeva, Fernando Castaños, Jaime A. Moreno
theory similarity 0.66
Abstract · 8 pages

Reservoir computing (RC) is a machine learning technique for data-driven modeling of dynamics for forecasting and control, primarily studied in computer science and physics literature with promising applications in neural network learning, physical computing, and neuroscience. Why reservoirs learn and how to choose good reservoir architectures are considered important open questions. We show that the RC problem is mathematically an extension of a classic problem in systems and control theory, the Kazantzis-Kravaris-Luenberger (KKL) observer design problem. As a consequence, many of the questions considered open for RC stand to benefit from a large body of theory in the mature KKL literature, non-exhaustively including on questions of embedding, transverse stability, local and global uniqueness guarantees, and effective data-driven solution constructions. Elaborating on this connection, we show that the surprising forecasting ability of reservoirs is in fact a direct consequence of the well-known observer internal model principle, derive an upper bound on the prediction error over a fixed forecast horizon, and provide a partial explanation for why linear readout training in RC works reasonably well. This work illustrates how classical ideas from systems and control can provide strong theoretical backing and open new questions for modern machine learning methods.

0.42

The internal model principle in reservoir computing

eess.SY math.OC ·2026-10-06 ·Danyal Saqib, Alberto Padoan
similarity 0.59
Abstract · Submitted to the American Control Conference (ACC) 2027

The paper studies learning in reservoir computing systems through the lens of the internal model principle. The key idea is to model training signals as outputs of an exogenous signal generator, thus connecting reservoir computing to output regulation, observer theory, and frequency-domain interpolation. For linear signal generators, we characterize the steady-state response of a linear reservoir through invariant subspaces, establishing connections with Luenberger observers and classical frequency-domain interpolation. For nonlinear signal generators, we obtain analogous results using invariant manifolds, connecting synchronization to Kazantzis-Kravaris/Luenberger observers and readout training to nonlinear moment matching. Case studies illustrate how our perspective explains possible instability of trained predictors and informs reservoir design.

0.11

Adaptive Observer of Nonlinear One-Sided Lipschitz Systems Using Estimated State Regressors With Finite Excitation

eess.SY ·2026-08-31 ·Hamid Taghavifar, Brian Delgado Aguilar
similarity 0.57
Abstract

For systems with unknown parameters, finite excitation and concurrent learning can potentially yield parameter convergence without persistent excitation but the regressor may still depend on inaccessible states, leading to regressor mismatch. In this paper, this problem is addressed for a class of nonlinear systems with one-sided Lipschitz properties and quadratically inner-bounded nonlinearities with bounded disturbances and linearly parametrized uncertainties. To this aim, an output-integral regression is utilized by using measured outputs and estimated states, and history-stack residual is explicitly bounded in terms of state-estimation error and disturbance. Furthermore, a perturbation bound between the estimated-state and true-state information matrices is derived. Additionally, an OSL-QIB LMI condition is applied for the observer design and a projected adaptive law is designed without needing exact output matching. Stability analysis's results indicate the proposed observer and parameter estimation outperform observers without history-stack learning term.

0.13

Higher-Order Interaction Reconstruction via Integral Physics-Informed Neural Networks

cs.LG eess.SY ·2026-11-16 ·Xin Mao, Zhen Xu, Shiyi Yang, Sukwon Yun, Yunmei Liu +3 more
hot direction similarity 0.56
Abstract

Reconstructing higher-order interactions is a fundamental challenge in complex networked systems, with applications in ecological, social, and biological networks. This inverse problem is inherently difficult due to the combinatorial complexity of higher-order structures, the strong nonlinearity of the underlying dynamics, and the prevalence of noisy and sparse observations. In this article, we propose a novel integral physics-informed neural network (IntegralPINN) framework for higher-order interaction reconstruction. Instead of { penalizing derivative-based physics residuals,} we adopt an integral formulation over temporal intervals, which naturally suppresses high-frequency noise and mitigates derivative-induced instability. We further introduce a continuous parameterization of interaction tensors, enabling tractable identification of higher-order structures via gradient-based optimization. We provide theoretical analysis establishing a noise-robust error bound that is independent of derivative amplification when the integration window satisfies an excitation condition. Extensive experiments on ecological dynamics, social contagion, and neuronal synchronization systems demonstrate that IntegralPINN achieves accurate and robust reconstruction under noisy and sparse observations, outperforming state-of-the-art approaches.

0.37

Physics-Informed Learning of Feedback-Linearizing Representations

eess.SY ·2026-09-26 ·Pavlos Kallinikidis, Fengjun Yang, David Snyder, Jacob H. Seidman, Nikolai Matni +2 more
theory similarity 0.56
Abstract

Feedback linearization is a powerful tool in nonlinear control, but finding the linearizing coordinate transform remains challenging. Feedback linearizing transforms are governed by well-established partial differential equations (PDEs) whose well-posedness is based on the Lie-algebraic Frobenius theorem, but solving the PDEs becomes computationally intractable for large system dimensions. To address this challenge, we propose a cascaded physics-informed neural network (PINN) framework to approximately solve these PDEs. By separately parameterizing terms of different Lie derivative orders, we mitigate the compounding errors inherent in fitting high-order Lie derivatives of neural networks. Furthermore, we use the learned transform to design a tracking controller and establish theoretical bounds on its error with respect to inaccuracies in the learned feedback-linearizing representation. We validate our method on a broad class of feedback linearizable systems, including a multi-input, multi-output planar quadrotor and synthetic examples for which analytical approaches are impractical, and demonstrate that our approach can computationally discover effective feedback-linearizing representations of nonlinear systems for control tasks.

0.22

Extrapolating learned dynamics across bifurcations based on generalized synchronization

cs.LG nlin.CDmath.DS ·2026-10-25 ·Lingfeng Chen, Masanobu Inubushi
similarity 0.56
Abstract

Predicting dynamics across bifurcations by extrapolating trained models is crucial in diverse fields of physics. Generalized synchronization provides a framework for understanding dynamical reconstruction by neural networks, especially in the context of reservoir computing. Building on this framework, we derive a formula combining pretrained readouts to reconstruct unseen chaotic dynamics. Using classical Lagrange interpolation theory, we derive rigorous bounds on readout errors and conjugacy residuals. Numerical examples demonstrate accurate prediction of chaotic dynamics across bifurcations.

0.20

Provable State Estimation with Recurrent Models

cs.LG math.OC ·2026-11-06 ·Vincent Andrieu, Pauline Bernard, Lucas Brivadis, Laurent Praly, Christian Wolf
top venuetheory similarity 0.56
Abstract

Estimating the state of a dynamical system from observations is a crucial task in robotics and control. Despite their empirical success, recurrent models often lack formal guarantees on convergence and robustness. We bridge this gap by analyzing these architectures from the perspective of nonlinear observer theory. By framing RNNs as a time-discretization of continuous latent dynamical systems (Neural ODEs), we demonstrate that enforcing a contraction condition on the latent flow guarantees the existence of a smooth, injective map of the true physical state into the latent space. We prove that this architecture acts as a tunable observer: by increasing a single scalar gain that scales the latent vector field, the estimation error can be driven to an arbitrarily small neighborhood of zero at an exponentially fast rate. We further establish quantitative bounds on the MLP complexity required to decode this latent state, and extend our formal guarantees to the discrete-time residual RNN implementation. We validate the theory on a real mobile robotic task, where a provably contracting model outperforms a vanilla GRU with substantially more stable training. We also report that unconstrained GRUs converge to contracting dynamics on this task, suggesting that contraction is an emergent property of well-trained sequence models.

0.39

When Latent Dynamics Meet Data Assimilation: A Benchmark of Koopman-Type Representations

cs.LG ·2026-11-02 ·Zhiwei Zhang, Wenxuan Yuan, Xiaoyuan Cheng, Pouria Behnoudfar, Chuanqi Chen +8 more
benchmark similarity 0.55
Abstract

Koopman representations describe nonlinear dynamics through linear evolution in a transformed space, offering an attractive framework for their linear simplicity and generality. Yet these advantages do not necessarily translate into improved performance in deep latent data assimilation (LDA). We systematically compare seven representative methods and structural baselines across five systems spanning approximately periodic to strongly chaotic dynamics and a broad range of state dimensions. We evaluate forecast and assimilation accuracy, physical state recovery, latent-trajectory behavior, and dynamical consistency, and assess Gaussian error assumptions, objective convexity, and uniqueness of analysis solutions. Our results reveal a trade-off between representational flexibility and optimization tractability. Linear evolution of the latent state can stabilize short-term forecasts but restrict expressiveness in strongly chaotic and high-dimensional systems, without consistently improving assimilation accuracy. Parameterized linear operators offer greater flexibility, yet their joint optimization with the encoder--decoder remains nonconvex. Methods with closed-form analysis updates generally perform better and exhibit greater robustness in our experiments, although matrix inversion remains a computational bottleneck. These findings show that the practical benefits of Koopman structure depend on both sufficient observational information and the choice of assimilation procedure.

0.20