CS Paper Radar

On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

Reza Sadeghi Hafshejani, Mohamad Kazem Shirani Faradonbeh

cs.LG stat.ML ·submitted 2026-11-02 00:38 UTC · v2

Abstract

System identification studies the canonical problem of reliably learning system-dynamics from state and input trajectories. One of its important applications consists of estimating a feedback gain matrix that can stabilize an unknown system. This paper focuses on the analysis of such adaptive stabilization schemes for multivariate linear time-invariant state-space models. The system instability practically renders trajectories short, i.e., the observed data is notably limited. So, it is crucial to tightly consider effects of \emph{all} involved quantities including length and number of trajectories, dimension, controllability Gramian, and signal-to-noise ratio. We put forward a simple, practical, and reliable relationship between the chance that adaptive stabilization (based on system identification) fails to stabilize the system, in terms of all the above-mentioned quantities. Our findings show that despite exponential effects of all other quantities on failure probability, such effects do not hold for signal-to-noise ratio. More specifically, this study shows that the strength of the excitation signal helps stabilization only \emph{logarithmically}; a very important phenomenon that we explain under the term \emph{signal saturation}.

Closest papers

Nearest neighbours by meaning across the whole index.

Incremental Input-to-State Stabilization of Partially Unknown Control-Affine Systems within Prescribed Safe Sets

eess.SY ·2026-11-10 ·P Sangeerth, Poulomee Ghosh, Pushpak Jagtap
similarity 0.65
Abstract

Incremental input-to-state stability ($δ$-ISS) guarantees that the trajectories of a system converge towards one another, up to a gain on the difference of their inputs. Some existing learning-based designs that combine incremental stability with safety achieve only incremental input-to-state practical stability, whose non-vanishing offset can make the guarantee conservative. We consider control-affine systems with a known, full-row-rank input matrix and an unknown drift learned using Gaussian process regression. The prescribed safe set is a superlevel set of a smooth function satisfying a radial condition that ensures a diffeomorphism onto $\mathbb R^n$ and it need not contain any equilibrium of the uncontrolled system. Using this transformation, we design a smooth feedback law and derive sufficient conditions that, under the stated learning assumptions, guarantee with high probability both forward invariance of a compact subset of the safe set and $δ$-ISS on that subset. The incremental estimate uses the distance induced by the transformation and contains no practical offset. Simulations on a Van der Pol oscillator and a Lotka-Volterra system illustrate the proposed approach.

0.27

On sparsity and directional forgetting in adaptive control

eess.SY ·2026-09-20 ·Tochukwu E. Ogri, Trivikram Satharasi, Muzaffar Qureshi, Kyle Volle, Rushikesh Kamalapurkar
similarity 0.62
Abstract

This paper develops a sparsity-promoting memory regressor extension (MRE) adaptation law with directional forgetting for nonlinear control-affine systems with linearly parameterized uncertainty. The objective is to use directional forgetting to selectively discount obsolete information and leverage $\ell_1$ regularization to promote sparsity of the parameter estimates. While $\ell_1$ regularization has been applied to the system identification problem in an offline setting, a contribution of this paper is to develop a recursive least squares update law to implement $\ell_1$ regularization in online adaptive control. In particular, we show that $\ell_1$-regularized recursive least squares is realized via a sliding mode update law. A nonsmooth Lyapunov-based stability analysis is then used to show that the tracking and parameter estimation errors are ultimately bounded under a subspace excitation condition. Simulation results on a Van der Pol oscillator demonstrate the ability of the developed sparsity-promoting MRE controller to recover sparse dynamics while maintaining stable tracking.

0.09

Neural Closed-Loop Identification of Nonlinear Systems with Stability and Generalization Guarantees

eess.SY cs.LG ·2026-10-20 ·Laura Meroi, Mahrokh G. Boroujeni, Leonardo Massai, Giancarlo Ferrari-Trecate
code/data similarity 0.61
Abstract · 16 pages, 11 figures. Preprint submitted to Automatica

Neural networks are expressive models of nonlinear dynamics, but identifying such systems from closed-loop data raises two difficulties: the feedback loop correlates inputs with measurement noise, biasing standard open-loop estimators, and the identified model must be stabilized by the data-collection controller, so that its closed-loop behavior matches the true plant's. We derive a complete parameterization of all nonlinear systems stabilized by a given controller, generalizing the classical dual-Youla parameterization to the nonlinear setting. Building on this characterization, we propose Internal Controller Identification (ICI), a computationally tractable framework for identifying potentially unstable systems while ensuring closed-loop stability by construction; in the linear case, our indirect method reduces to an open-loop identification problem, for which standard consistency results apply. The framework accommodates contextual information, letting a single certified model identify a family of systems, and supports a PAC-Bayesian training objective that, when data are scarce and prior knowledge is available, bounds the identified operator's expected prediction loss. Experiments show that ICI identifies open-loop unstable plants where uncertified baselines diverge, outperforms direct methods under weak excitation and feedback-correlated noise, generalizes zero-shot to environments unseen during training, and, with limited data, avoids the overfitting of empirical risk minimization while providing a non-vacuous generalization bound.

0.39

Robust Model Reference Adaptive Control with Combined Adaptation under Finite Excitation Condition

eess.SY ·2026-08-23 ·Manish Patel, Arnab Maity
similarity 0.61
Abstract

In adaptive control, parametric uncertainties in linear-in-parameter form consist of unknown parameters and known regressor signals. Convergence of the unknown parameters to their ideal values requires the regressor to satisfy a persistent excitation (PE) condition, which depends on future data and is therefore infeasible to guarantee online. Memory-based parameter update laws address this by enabling ideal parameter convergence under the online-verifiable finite excitation (FE) condition. In this paper, a new algorithm is proposed to construct a memory term via the Modified Gram-Schmidt orthogonalization procedure for a class of multi-input multi-output nonlinear systems with an unknown diagonal control effectiveness matrix and bounded nonparametric uncertainties. Under the finite excitation condition, the constructed memory term yields an identity coefficient matrix in the parameter estimation error dynamics. The identity coefficient matrix eliminates the need for time-varying adaptation gains, enables an explicit ultimate bound on the parameter estimation error, and preserves the structure of the nonparametric uncertainty bound under the memory term. Building on this, a combined adaptation law is developed for controller gain estimation under FE. The closed-loop tracking and estimation errors are shown to decay exponentially to a neighborhood of the origin, characterized by an explicit ultimate bound, with a decay rate that depends solely on user-defined gains and system constants, independent of the level of regressor excitation. This removes the dependence of the convergence rate on the level of regressor excitation, a key limitation of existing approaches such as concurrent learning, memory regressor extension, and DREM.

0.24

Reference Replay for Excitation Injection and Subsequent Exponential Convergence under Concurrent Learning Adaptive Control

eess.SY math.OC ·2026-11-16 ·Tom Kaufmann, Johann Reger
theory similarity 0.60
Abstract

Concurrent learning (CL) guarantees precise identification of unknown parameters---if data with finite excitation (FE) happens to be collected online. To improve the reliability of CL, this work establishes a mechanism allowing FE-occurrence to be verified a priori: We propose replaying a given training segment in the reference until data with finite excitation is collected online. Provided the training segment fulfills a certain off-line excitation test, FE then occurs in unknown, but finite time. Moreover, we provide an upper bound on the time-to-FE. Even though this bound involves a dependency on the unknown initial Lyapunov-function value, its structure shows that FE occurs in arbitrarily early replay cycles when increasing the control gain; which may motivate employing a high-gain strategy. The theoretical findings are verified on an academic simulation example.

0.25

Exact Noise Limits for Bounded Scalar Stabilization Experiments

eess.SY math.OC ·2026-09-30 ·Alexey Peregudin, Ngoc Tuan Dinh
similarity 0.60
Abstract · 6 pages, 1 figure. Submitted to the American Control Conference (ACC)

How much unknown process noise can a bounded experiment tolerate while still establishing that the plant can be stabilized? We answer this question for scalar discrete-time systems with bounded inputs, exact state measurements, and a disturbance-energy budget proportional to the experiment length. We distinguish individual stabilizability of every consistent model, stabilization by one common gain, and a common quadratic certificate. We determine their exact noise ceilings for every drift. The last two requirements coincide; individual stabilizability generally tolerates more noise. Bounded periodic inputs approach the ceilings, while adversarial disturbances prevent their attainment. We also determine the long-horizon limits. For unstable plants, a short experiment can establish individual stabilizability at noise levels where every sufficiently long experiment fails. The same obstruction yields upper bounds for multidimensional systems with real eigenvalues. Input design may use plant knowledge, but certification uses only the recorded data and noise bound. The results therefore provide fundamental robustness benchmarks for unknown-plant designs.

0.41

Controlled Excitation for Identification of Nonlinear Systems with Saturated Outputs

eess.SY math.OC ·2026-11-06 ·Adel Malik Annabi, Jean-Baptiste Pomet, Dario Prandi, Ludovic Sacchelli
similarity 0.59
Abstract

We consider nonlinear systems whose measured output is the product of an unknown matrix and a known saturation function of the unmeasured state. Generating excitation that allows the matrix to be recovered from the output is challenging when the dynamics are largely unknown. We exploit saturation to construct this excitation. Under a geometric accessibility condition, we derive explicit open-loop controls that drive the state into regions where the saturation takes prescribed values. For componentwise saturations, this condition holds generically with as few as two independent control directions. The controls require no state measurement and only partial knowledge of the dynamics, with no information on the structure of its nonlinear part. The resulting regressor is known in advance, and the unknown matrix is recovered exactly by a closed-form regression. Under stronger structural assumptions and with sufficiently many independent outputs, an output feedback tracks prescribed reference trajectories within the unsaturated region to arbitrary accuracy and permits exact state recovery. Suitably chosen references then also enable exact identification of linearly parameterized (nonlinear) dynamics. We analyze robustness to measurement noise and illustrate the method numerically in the presence of both measurement and dynamical noise.

0.17

Input-to-State Stability in Distributed Adaptive Identification of Nonlinear Systems without Input Sharing

eess.SY ·2026-11-16 ·Moh Kamalul Wafi
similarity 0.58
Abstract

This paper studies continuous-time distributed adaptive identification of unknown nonlinear systems over directed communication networks without requiring source or neighboring inputs to be shared. Each sensing node reconstructs the source state while adapting local estimates of the unknown linear and nonlinear dynamics using only locally available information and neighboring state estimates. A network-level error representation is derived to characterize the interaction among the communication topology, observer dynamics, parameter uncertainty, and nonlinear mismatch. Norm-based, structured Lyapunov, and robust LMI conditions are established to guarantee that the resulting coupling operator is Hurwitz. Unlike the corresponding discrete-time formulation, the proposed continuous-time adaptive laws do not require normalization. A Lyapunov analysis establishes boundedness of the adaptive parameters and asymptotic convergence of the estimation and source-tracking errors in the unperturbed case. Input-to-state stability is further established under bounded predictor mismatch and source disturbances. Numerical studies over star, cyclic, and path topologies support the theoretical results and demonstrate approximately linear computational scaling with the number of sensing nodes.

0.25