CS Paper Radar

Learning Provable Neural Network Observer for Uncertain Dynamical Systems

Zhangyi Wang, Jiaxu Liu, Song Chen, Chao Xu, Shengze Cai

cs.LG math.OC ·submitted 2026-09-25 04:56 UTC · v2
code/data

Abstract

In many safety-critical applications, control of uncertain dynamical systems relies on observers that estimate states and external disturbances. Neural network observers can improve estimation accuracy, but certifying their Lyapunov stability via Linear Matrix Inequality (LMI) constraints leads to large-scale semidefinite programs (SDPs) that are difficult to solve for large networks. To overcome this scalability bottleneck, we propose a novel two-stage training framework for provably stable neural network observers. Our approach decouples the optimization into a point-guided Lyapunov pre-training phase, which rapidly achieves high estimation accuracy and local stability over sampled states, followed by an LMI fine-tuning phase that efficiently satisfies a strict global Lyapunov stability certificate. We provide formal theoretical guarantees for local stability radii and probabilistic coverage over a prescribed compact error-state domain under specified regularity and sampling assumptions. Experiments on nonlinear control benchmarks and X-29 aircraft ablations show that our LMI-certified neural network observers train significantly faster than direct LMI-based methods and generalize robustly across diverse systems, achieving improved tracking accuracy over a range of observer baselines. The code is available at https://github.com/Berry-Myon/LearningNeuralNetworkObserver.

Closest papers

Nearest neighbours by meaning across the whole index.

Neural Barriers: An Online Certifiable Learning-enhanced Adaptive High Order Safety Critical Control

cs.RO ·2026-10-04 ·Lishuo Pan, Mattia Catellani, An Cao, Lorenzo Sabattini, Nora Ayanian
similarity 0.66
Abstract · 14 pages, 11 figures, 3 tables

Control barrier functions are an effective model-based tool to formally certify the safety of a system. However, transferring their theoretical guarantees to real-world robotics systems requires high model fidelity. For example, payloads or wind disturbances can cause significant model perturbations to an aerial vehicle, leading to safety compromises. In this work, we propose a certifiable online learning-enhanced robust adaptive control barrier function, which adapts to disturbances using a Neural ODE and quantifies its adaptation uncertainty with conformal prediction. Our approach guarantees safety at all time under unknown time-varying model disturbances. It adopts a conservative strategy when the adaptation uncertainty is high; and efficiently adapts to reduce controller conservativeness as it receives more data. Our approach provides a provable safety guarantee with a probability bound under suitable Lipschitz smoothness assumptions on the underlying model and trajectory. These results demonstrate the potential of our method as a practical safety controller for robotics system operating under model perturbations.

0.23

Nesterov-Accelerated Concurrent Learning for Lyapunov-Based Deep Neural Networks

eess.SY ·2026-10-03 ·Hossein Papi, Omkar Sudhir Patil
similarity 0.63
Abstract

Concurrent learning (CL) has recently been extended to Lyapunov-based deep neural networks (DNNs) to obtain parameter convergence under finite rather than persistent excitation. However, the existing first-order law converges slowly, especially for high-dimensional systems and overparameterized networks. To address this problem, this paper develops a Nesterov-accelerated concurrent learning (NACL) adaptation law for uncertain second-order control-affine systems. The developed law drives momentum dynamics with recorded state-input data, so that all hidden layers of the DNN are updated online under a verifiable finite excitation condition. A dynamic state-derivative observer is designed to reconstruct the recorded input without acceleration measurements. The momentum variable introducesa cross term coupling the momentum lag error to the state-dependent DNN Jacobian and the tracking error, and a state-dependent normalization is introduced into the momentum filter to dominate it. A Lyapunov-based analysis establishes exponential convergence of the tracking, momentum, observer, and weight estimation errors to a bounded residual ball. Simulations on a six- degree-of-freedom unmanned underwater vehicle demonstrate a 24.5% and 62.9% reduction in the root-mean-square function approximation error relative to first-order CL and to a higher-order tuner without CL, respectively.

0.14

Joint Learning of Control Lyapunov Functions and Controllers via Stable-by-Design Surrogates

eess.SY cs.LG ·2026-11-16 ·Patricia Pauli, Matthieu Barreau
similarity 0.61
Abstract

Training and verifying neural network-based control Lyapunov functions (CLFs) can be computationally demanding. To address this challenge, we propose a framework that jointly learns a CLF and a stabilizing controller using structured neural networks and a projection-based parameterization. Specifically, we employ Polyak-Lojasiewicz networks (PLNets), which parameterize nonconvex, positive-definite CLF candidates, and construct a stable-by-design surrogate of the closed-loop dynamics that satisfies the Lyapunov decrease condition by construction. The controller combines linear state feedback with a higher-order correction term resembling Sontag's universal formula and is trained to align the resulting closed-loop dynamics with the stable-by-design surrogate. Unlike classical approaches based on Sontag's formula, our framework does not require a known CLF; instead, it learns the CLF and controller simultaneously. We establish local and global stability guarantees for the learned controller and demonstrate the effectiveness of the proposed approach through numerical examples.

0.41

Communication-aware Synthesis of Safe Controllers for Discrete-Time Linear Multi-Agent Systems with Distributed k-Hop Observation

eess.SY ·2026-10-01 ·Yihan Liu, Teng Yan, Meiqi Tian, Bingzhuo Zhong
similarity 0.60
Abstract

This paper studies communication-aware safe control for discrete-time linear multi-agent systems under limited information exchange. The main challenge lies in the coupling between remote-state estimation and safe controller design, since estimation errors affect the state evolution through the controller gains, while the controller design must account for the resulting observer-induced state perturbations to guarantee safety. To address this challenge, a distributed k-hop observer is developed to reconstruct unavailable remote states, and a uniform observer-error bound is derived. The effect of the observer-induced state perturbation on closed-loop safety is accounted for in both the construction of local εi-robust safe invariant (RSI) sets and the enforcement of pairwise relative-state safety constraints. The resulting safety conditions ensure that all agents remain within their local RSI sets while all pairwise relative-state safety constraints are satisfied. A linear matrix inequality (LMI)-based optimization method is developed to jointly synthesize the distributed observers, local controllers, and RSI sets. A case study illustrates the effectiveness of the proposed method.

0.25

Certified Robustness via Sparse Second-Order Cone Relaxations

cs.LG ·2026-10-12 ·Mohammadreza Maleki, Daniel Sadig, Rushendra Sidibomma, Mahyar Fazlyab, Arman Adibi +1 more
benchmark similarity 0.60
Abstract

Certified robustness is critical for deploying neural networks in safety-sensitive settings, but computing exact certificates typically requires solving nonconvex optimization problems. Practical verifiers use convex relaxations: linear programming (LP) relaxations are scalable but often too conservative, whereas semidefinite programming (SDP) relaxations can be substantially tighter but are computationally expensive. We introduce a hierarchy of second-order cone programming (SOCP) relaxations that provide stronger certificates than LP while avoiding the cost of global positive-semidefinite constraints. Our construction combines convex-hull relaxations of ReLU activations, selective McCormick lifting over certified variable bounds, and second-order cone constraints induced by 2-by-2 principal minors. Adding these constraints progressively yields a monotone hierarchy of increasingly tight bounds with a controllable computation-tightness trade-off. On fully connected and convolutional networks on MNIST and CIFAR-10, SOCP-based verification improves certified robust accuracy over LP-based verification and is competitive with alpha,beta-CROWN, while remaining orders of magnitude faster than SDP-based verification. These results position selective second-order constraints as a practical middle ground between scalable LP-based and tight SDP-based certification. Finally, we introduce class-optimized robust evaluation (CORE), which applies tighter relaxations only to target classes not certified by cheaper ones. On the fully connected MNIST benchmark, CORE variants match SDP-cert's certified robust accuracy while reducing average verification time by up to 86.30%.

0.11

Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guarantees

eess.SY cs.LG ·2026-09-26 ·Omkar Sudhir Patil
hot direction similarity 0.60
Abstract

Neural ODEs learn dynamics from trajectory losses, but their adjoint gradients lack the regressor-times-parameter-error structure on which Lyapunov analyses of online adaptation rest, so training on streaming data comes without stability guarantees. We show that this structure is in fact present: the adjoint gradient decomposes exactly into a positive semi-definite trajectory operator acting on the parameter error plus a nonlinear perturbation with explicit, horizon-dependent bounds. A quadratic Lyapunov function then certifies online Neural ODE training over sliding windows under computable gain and horizon conditions, and the same certificate extends to stored data: its drift branch recovers concurrent learning, and its trajectory branch yields NODE-CL, a stored-segment Gauss-Newton method built on batched forward sensitivities that needs no state-derivative estimates. On four DeepMind Control Suite domains, NODE-CL attains the lowest median prediction error on three under velocity measurement noise, where observer-based concurrent learning degrades by up to 8x; with clean measurements it is best on the pendulum and within a factor of 1.6 of the best stored-data baseline on the cartpole and reacher.

0.34

Enforcing Ellipsoidal Constraints in Neural Networks with a Polynomial Safety Layer

eess.SY cs.LGmath.OC ·2026-11-14 ·Rolf Findeisen, Sebastian Hirt, Hoang Hai Nguyen, Grace Li Zhang, Hendrik Alsmeier
similarity 0.60
Abstract · 13 pages, 6 figures

Often the output of a learned mapping must satisfy prescribed constraints. In the control of autonomous systems, for example, the chosen action must keep the system within a collision-free region. We consider the case in which a proposed output is corrected by projection onto a safety ellipsoid. Computing this projection amounts to solving a quadratically constrained quadratic program (QCQP). We construct a neural-network safety layer by unrolling a feasibility-preserving polynomial penalty iteration. The unrolled structure allows the loss gradient to propagate from the feasible output through the safety layer to the network parameters during training. We show how to choose the layer parameters so that every iterate is feasible and give a computable bound on its distance to the exact projection at any prescribed depth. We illustrate the method by training a LiDAR-based policy to control an unmanned aerial vehicle. A privileged model predictive control expert uses the map and the measured vehicle state to generate the training data. In the simulated narrow mazes, the filtered policy avoided wall contact at every tested stage of training, including at initialization, when every unfiltered flight hit a wall. A representative build of the learned policy and its safety layer for an Arm Cortex-M4F microcontroller occupies about 36 KiB of flash, with a RAM budget below 5 KiB.

0.26

Robust Adaptive Lyapunov-Based MPC for Nonlinear Systems with Experimental Validation on Quadcopter Attitude Control

eess.SY ·2026-11-05 ·Teo Protoulis, Alex Alexandridis
similarity 0.60
Abstract

In this paper, a computationally efficient robust adaptive Lyapunov-based model predictive control (RALMPC) framework is proposed for a class of constrained nonlinear systems subject to uncertainties and external disturbances. A radial basis function neural network (RBFNN), introduced to approximate non-parametric uncertainties, is incorporated into a control Lyapunov function analysis, together with integral barrier Lyapunov functionals for state constraint enforcement. This analysis yields control and adaptation laws for parametric uncertainties, external disturbances, RBFNN weights, and worst-case approximation error, rendering the closed-loop system uniformly bounded while ensuring convergence of tracking errors to compact sets around the origin. The resulting guarantees are then embedded into the RALMPC optimal control problem through a contractive constraint, thus combining formal closed-loop stability with real-time performance optimization; at the same time, the adaptation laws allow the RALMPC prediction model to be updated online. Comparative hardware-in-the-loop simulations against state-of-the-art MPC schemes validate the efficacy and computational efficiency of the proposed framework. Ultimately, RALMPC is experimentally validated on a custom-built quadcopter platform for time-varying attitude tracking, demonstrating its practical feasibility; comparisons against alternative strategies confirm its superiority in achieving improved closed-loop performance.

0.34