CS Paper Radar

Learning neural controllers for nonlinear systems from data

Zhongjie Hu, Zhi-Wei Liu, Chen Wang

eess.SY ·submitted 2026-08-29 14:42 UTC · v2

Abstract

This article addresses the problem of designing neural feedback controllers for unknown nonlinear systems. We propose an indirect data-driven framework that uses offline data to identify the system dynamics, upon which a neural feedback controller and a neural Lyapunov function are jointly synthesized. Input constraints are enforced by integrating a hard-saturation structure into the controller architecture. Robust synthesis conditions are derived to account for data perturbations during identification. Formal stability is certified by combining SMT verification with local Lyapunov analysis near the equilibrium. Numerical examples validate the effectiveness of the proposed framework.

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Neural Feedback Linearization for Data-driven Systems via Augmented Lagrangian

cs.LG ·2026-09-21 ·Lakshmi Priya P. K., Andreas Schwung
similarity 0.68
Abstract

The paper proposes a novel data-driven framework for designing and training a feedback linearizing controller by explicitly incorporating relative degree based conditions into the learning process. This enables the conventional feedback controller components to be replaced by neural Lie derivatives, thereby facilitating a fully data-driven feedback linearization framework. Furthermore, practical closed-loop stability is established by deriving sufficient conditions under which bounded identification errors lead to bounded tracking errors. The derived theoretical results are validated through their application to an armature controlled DC motor.

0.12

Predefined-Time Resilient Integral Reinforcement Learning for Input-Constrained Unknown Nonlinear Systems Under FDI Attacks and Disturbances: A Fully Data-Driven Approach

eess.SY ·2026-09-10 ·Tien Dat Vu, Minh Doan
hot direction similarity 0.67
Abstract

This paper investigates optimal control for nonlinear systems with unknown dynamics, input constraints, disturbances, and adversarial signals. The objective is to develop a learning-based control method that allows the designer to prescribe the desired convergence time in advance. An integral reinforcement-learning framework is proposed to avoid requiring exact knowledge of the system dynamics while ensuring that the control input always satisfies the actuator constraints. Current and recorded data are combined to train the critic without requiring persistent excitation. The learning gain is selected directly from the prescribed convergence deadline. Lyapunov analysis is then used to establish practical predefined-time convergence of the coupled state-critic system in the presence of disturbances and adversarial channels. The effectiveness of the proposed method is validated through the stabilization control of a two-link robot manipulator.

0.46

Neural Closed-Loop Identification of Nonlinear Systems with Stability and Generalization Guarantees

eess.SY cs.LG ·2026-10-20 ·Laura Meroi, Mahrokh G. Boroujeni, Leonardo Massai, Giancarlo Ferrari-Trecate
code/data similarity 0.63
Abstract · 16 pages, 11 figures. Preprint submitted to Automatica

Neural networks are expressive models of nonlinear dynamics, but identifying such systems from closed-loop data raises two difficulties: the feedback loop correlates inputs with measurement noise, biasing standard open-loop estimators, and the identified model must be stabilized by the data-collection controller, so that its closed-loop behavior matches the true plant's. We derive a complete parameterization of all nonlinear systems stabilized by a given controller, generalizing the classical dual-Youla parameterization to the nonlinear setting. Building on this characterization, we propose Internal Controller Identification (ICI), a computationally tractable framework for identifying potentially unstable systems while ensuring closed-loop stability by construction; in the linear case, our indirect method reduces to an open-loop identification problem, for which standard consistency results apply. The framework accommodates contextual information, letting a single certified model identify a family of systems, and supports a PAC-Bayesian training objective that, when data are scarce and prior knowledge is available, bounds the identified operator's expected prediction loss. Experiments show that ICI identifies open-loop unstable plants where uncertified baselines diverge, outperforms direct methods under weak excitation and feedback-correlated noise, generalizes zero-shot to environments unseen during training, and, with limited data, avoids the overfitting of empirical risk minimization while providing a non-vacuous generalization bound.

0.39

Joint Learning of Control Lyapunov Functions and Controllers via Stable-by-Design Surrogates

eess.SY cs.LG ·2026-11-16 ·Patricia Pauli, Matthieu Barreau
similarity 0.60
Abstract

Training and verifying neural network-based control Lyapunov functions (CLFs) can be computationally demanding. To address this challenge, we propose a framework that jointly learns a CLF and a stabilizing controller using structured neural networks and a projection-based parameterization. Specifically, we employ Polyak-Lojasiewicz networks (PLNets), which parameterize nonconvex, positive-definite CLF candidates, and construct a stable-by-design surrogate of the closed-loop dynamics that satisfies the Lyapunov decrease condition by construction. The controller combines linear state feedback with a higher-order correction term resembling Sontag's universal formula and is trained to align the resulting closed-loop dynamics with the stable-by-design surrogate. Unlike classical approaches based on Sontag's formula, our framework does not require a known CLF; instead, it learns the CLF and controller simultaneously. We establish local and global stability guarantees for the learned controller and demonstrate the effectiveness of the proposed approach through numerical examples.

0.41

Fixed-Time Resilient Integral Reinforcement Learning for Input-Constrained Unknown Nonlinear Systems Under FDI Attacks and Disturbances: A Data-Driven Admissible Warm Start

eess.SY ·2026-09-12 ·Tien Dat Vu, Minh Doan
hot direction similarity 0.60
Abstract

This paper develops a resilient learning controller for unknown nonlinear systems operating under actuator limits, false-data-injection attacks, and external disturbances. The key idea is to learn a saturated secure policy directly from finite trajectory data while guaranteeing that both the learning error and the closed-loop state converge to compact neighborhoods within a uniform fixed time independent of initial conditions. An integral formulation removes the unknown drift from the implementable learning law, while stored informative data sustain learning after online excitation fades. To mitigate the closed-loop sensitivity to arbitrary critic initialization, pre-deployment data, which may also be reused from the replay stack, are lifted through a finite-dimensional Koopman representation to construct a stabilizing initial policy, whose inverse saturated-policy map provides a data-driven critic-weight warm start. The resulting controller preserves input constraints by construction and guarantees practical fixed-time robustness under persistent attacks and disturbances. The proposed learning and initialization architecture is further verified through a two-link robot stabilization example, where the results demonstrate rapid state recovery, bounded critic learning, reliable actuator-constraint satisfaction, and improved closed-loop behavior under informed critic initialization.

0.44

Direct and Indirect Data-Driven Control with Prior Information about the Equilibrium Manifold

eess.SY ·2026-09-24 ·Yi-Chun Liao, Valentina Breschi, Marco M. Nicotra
published similarity 0.60
Abstract · Accepted at the 65th IEEE Conference on Decision and Control (CDC 2026)

By hinging on the assumption that a system to be controlled is fully unknown, many data-driven control approaches do not leverage available or readily inferable priors. In contrast to this viewpoint, this paper analyzes the impact of using the system's equilibrium subspace to inform direct and indirect linear quadratic regulation. For the indirect case, we show how including a constraint on the equilibrium subspace in the identification problem changes the statistical properties of the learned model. In particular, we show that enforcing consistency with respect to the equilibrium subspace leads to a reduction in the estimator variance that, in turn, enhances model-based control performance. In the direct case, we show how this prior can be leveraged to gain insight into the controlled system without requiring an explicit identification step. These results are supported by both numerical and experimental evidence, showcasing the advantages of explicitly leveraging the equilibrium manifold as a prior in data-driven control.

0.25

Controlled Excitation for Identification of Nonlinear Systems with Saturated Outputs

eess.SY math.OC ·2026-11-06 ·Adel Malik Annabi, Jean-Baptiste Pomet, Dario Prandi, Ludovic Sacchelli
similarity 0.60
Abstract

We consider nonlinear systems whose measured output is the product of an unknown matrix and a known saturation function of the unmeasured state. Generating excitation that allows the matrix to be recovered from the output is challenging when the dynamics are largely unknown. We exploit saturation to construct this excitation. Under a geometric accessibility condition, we derive explicit open-loop controls that drive the state into regions where the saturation takes prescribed values. For componentwise saturations, this condition holds generically with as few as two independent control directions. The controls require no state measurement and only partial knowledge of the dynamics, with no information on the structure of its nonlinear part. The resulting regressor is known in advance, and the unknown matrix is recovered exactly by a closed-form regression. Under stronger structural assumptions and with sufficiently many independent outputs, an output feedback tracks prescribed reference trajectories within the unsaturated region to arbitrary accuracy and permits exact state recovery. Suitably chosen references then also enable exact identification of linearly parameterized (nonlinear) dynamics. We analyze robustness to measurement noise and illustrate the method numerically in the presence of both measurement and dynamical noise.

0.17

Decentralised model predictive control of recurrent neural network models

eess.SY ·2026-11-11 ·Daniele Ravasio, Marcello Farina, Andrea Ballarino
similarity 0.59
Abstract

This work proposes a decentralised nonlinear model predictive control algorithm for systems described by input-coupled recurrent neural network models. The proposed approach exploits closed-loop incremental input-to-state stability to design the local controllers and provide robustness to subsystem couplings. The resulting control scheme guarantees asymptotic convergence to a desired equilibrium while satisfying input and output constraints. Simulation results illustrate the performance of the proposed approach.

0.23