CS Paper Radar

On Delay-robustness of Extremum Seeking of Nonlinear Static Maps with Small Disturbance

Jianzhong Li, Yang Zhu, Hongye Su

eess.SY ·submitted 2026-09-15 02:12 UTC · v1

Abstract

Extremum seeking (ES) is a real-time optimization strategy, thus transmission delays in the feedback loop of ES have big impact on its stability. How big delay that ES control systems are able to withstand? This paper provides a potential answer to this problem. We focus on gradient-based ES for nonlinear static maps subject to known constant delays plus a small time-varying delay uncertainty. We also consider the measurement to be subject to a small disturbance. Different from a majority of existing literature addressing quadratic maps with delays by predictor feedback, this paper deals with a wider class of non-quadratic maps without any predictor or observer for delay compensation. Dither signals in modulation and demodulation are carefully designed to handle constant delays and time-varying delay uncertainties. When the nonlinear map is unknown, we offer a rigorously analytical framework of ES convergence and delay-robustness. When some a prior knowledge of nonlinear maps is available, we are able to provide a quantitative estimation on upper bounds of time delay and dither periods to keep ES systems to remain stable. A suitable choice of ES parameters guarantees practical stability for any large known constant delay.

Closest papers

Nearest neighbours by meaning across the whole index.

Safe Newton-Based Extremum Seeking for Static Maps with Delayed Output Measurements

eess.SY ·2026-09-14 ·Azad Ghaffari, Tiago Roux Oliveira
similarity 0.73
Abstract

This work presents a delayed safe Newton-based extremum seeking (SANES) framework for minimizing an unknown static map subject to an unknown safety constraint. The objective and safety measurements are assumed to be affected by the same constant time delay. To compensate for delayed measurements, a model-free predictor is developed to construct the quantities required for optimization, including the nominal Newton-based extremum-seeking control input and the gradient information used to formulate control Lyapunov function (CLF) and control barrier function (CBF) conditions. Robust CLF--CBF quadratic programs (QPs), subject to parameter-update constraints, are then formulated to account explicitly for derivative-estimation and prediction errors. For the delay-free case, robustness margins are derived from bounds on the extremum-seeking estimation errors, whereas for the delayed case, the margins incorporate both estimation and prediction errors. Practical stability of the nominal Newton-based extremum-seeking dynamics is established directly through a Lyapunov analysis, thereby providing convergence guarantees over the admissible parameter set without relying exclusively on local averaging arguments. Robust CLF and CBF conditions are subsequently derived to establish practical convergence and forward invariance of a robust subset of the prescribed safe set. A numerical case study demonstrates the effectiveness of the proposed SANES framework in achieving constrained optimization despite unknown objective and safety maps and delayed measurements.

0.44

Small-Gain Analysis of Robust Event-Triggered Extremum Seeking for Scalar Maps

eess.SY math.OC ·2026-11-18 ·Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic, Zhong-Ping Jiang
theory similarity 0.62
Abstract · 6 pages and 6 figures

We study a sample-and-hold implementation of gradient extremum seeking for a scalar quadratic map in which the control signal is refreshed only when an event occurs. The event generator acts on the demodulated gradient signal as it is actually measured, rather than on its averaged version, and contains a strictly positive offset, following the small-gain philosophy for robust event-triggered control. Rather than invoking averaging theorems, we work directly with the exact dynamics of the parameter estimation error. In the scalar setting, the demodulated gradient has an explicit sinusoidal structure, which is exploited through a change of variables that absorbs the zero-mean oscillatory perturbation, together with a quadratic Lyapunov function and the persistence of excitation of the probing signal. For a sufficiently fast dither, the estimation error is shown to decay exponentially to a residual neighborhood of the origin whose size is quantified by the dither amplitude and frequency, and by the relative threshold and the offset of the event generator. All constants, including the input-to-state stability gain of the extremum seeking loop, the admissible dither frequency and the positive lower bound on the time between two consecutive events, are given in closed form, so that Zeno behavior is excluded. A simulation example illustrates the results.

0.27

Robust Data-Driven Output Feedback for Systems With Unknown Input Delays

eess.SY ·2026-10-31 ·Ngoc Tuan Dinh, Ba Huy Nguyen, Alexey Peregudin, Egor Dogadin
similarity 0.59
Abstract · 6 pages, 1 figure. Submitted jointly to IEEE Control Systems Letters (L-CSS)

In a history-feedback realization, an input delay increases memory without increasing the number of unknown physical coefficients. We use this structure to design output-feedback controllers for discrete-time systems with one input, one output, and known undelayed order, using noisy input-output data. For a known delay, we derive a necessary and sufficient linear matrix inequality for common-quadratic stabilization of all models consistent with the data. Optimizing its equation-error bound gives a robustness margin for the measured record. For an unknown constant delay in a known interval, we characterize noiseless delay ambiguity and give a sufficient condition for one controller to stabilize all models for every delay consistent with the error bound. Under stated excitation and nondegeneracy assumptions, this procedure is feasible for all sufficiently small equation errors. Numerical examples compare robustness at equal controller memory and show that certified stabilization can succeed while distinct delay models remain compatible with the same data.

0.31

Multivariable Newton-Based Extremum Seeking with Bounded Update Rates

eess.SY ·2026-09-23 ·Farzaneh Karimi, Mohsen Mojiri, Mohammadali Ghadiri-Modarres, Azadeh Mohammadpour
similarity 0.57
Abstract

We propose a multivariable Newton-based extremum seeking scheme, incorporating known bounds on update rates. The design extends the recent bounded extremum seeking scheme to the Newton-based approach, which makes the convergence rate independent of the unknown Hessian by estimating and inverting the Hessian matrix. As a vital part of the Newton-based algorithm, we design an appropriate demodulation matrix to generate an estimate of the Hessian in an average sense. The local exponential stability of the bounded extremum seeking algorithm is proven for general multivariable static maps using averaging analysis. In comparison with previous practical stability results, it guarantees convergence to a neighborhood of the extremum point with an exact convergence rate exhibiting exponential decay. Subsequently, the main stability result is established for the Newton-based bounded extremum seeking approach under a weak Hessian coupling assumption. Simulation results demonstrate the advantage of the proposed approach over bounded extremum seeking by assigning equal, desired convergence rates to all parameters using the Newton approach.

0.11

Towards Co-Designed Event-Triggered Extremum Seeking

eess.SY math.OC ·2026-08-10 ·Roberto Luo, Pedro Henrique Silva Coutinho, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic
similarity 0.53
Abstract · 7 pages, 3 figures

This paper studies event-triggered gradient-based multivariable extremum seeking for nonlinear maps with polytopic Hessian uncertainty. Unlike existing event-triggered extremum-seeking methods, which first fix the controller (typically diagonal) and then design the triggering mechanism, the proposed approach jointly synthesizes the controller and the triggering mechanism through a co-design framework that admits both diagonal and full controller gain matrices. The co-design problem is formulated as a convex optimization problem with linear matrix inequality constraints. Its solution guarantees exponential convergence of the average closed-loop system with a prescribed decay rate while maximizing the admissible triggering threshold to reduce communication. Lyapunov and averaging analyses establish exponential stability of the event-triggered system, and Zeno-freeness is proved to guarantee implementability. Numerical results illustrate that diagonal gains cannot achieve the same triggering thresholds and decay rates as the full controller gain matrices, highlighting the benefits of exploiting Hessian coupling information.

0.07

Deep Reinforcement Learning with Smith-Predictor Delay Compensation

eess.SY ·2026-10-31 ·Moh Kamalul Wafi
published similarity 0.53
Abstract · This is an extended version of the paper published in the proceedings of IEEE American Control Conference (ACC)

Time delays can degrade feedback performance and destabilize a closed loop that is stable without delay. This paper studies Smith-predictor-assisted reinforcement learning for systems with constant input delays. A deep deterministic policy gradient (DDPG) actor is trained on a nominal delay-free environment and deployed with a Smith predictor using a fixed nominal delay. For linear controllers, we derive exact closed-loop maps under plant and delay mismatch and provide small-gain and $ν$-gap robustness conditions. A separate delay-independent Razumikhin condition gives a sufficient stability test for a fixed Lipschitz state-feedback policy. We also study output-error delay identification from a fixed input--output record, deriving the loss gradient and establishing projected-flow descent and local exponential convergence under exact model matching and an excitation condition. These identification results do not imply stability of an online adaptive predictor. Numerical experiments retained from the conference study compare PID, LQR, and DDPG controllers on stable and open-loop unstable first-order plants with valve stiction. The results illustrate the benefit of predictor compensation in the tested configurations and the sensitivity of standalone DDPG to delay and plant changes.

0.45

Asynchronous Model Predictive Control Under Model Mismatch: Stability and Performance Guarantees

eess.SY ·2026-09-08 ·Changrui Liu, Anil Alan, Shengling Shi, Bart De Schutter
similarity 0.52
Abstract · This is the first work to characterize the joint effects of model mismatch, general asynchronous feedback, and prediction horizon on stabili…

Certainty-equivalence model predictive control (CE-MPC) is widely used for its simplicity and efficiency, but theoretical guarantees under asynchronous feedback remain limited. This paper establishes stability and performance guarantees for asynchronous CE-MPC of input-constrained nonlinear systems. We first derive a nominal stability condition and competitive-ratio bound that explicitly account for inter-execution intervals without prescribing a feedback mechanism. A value-function perturbation analysis for quadratic stage costs then accommodates additive, potentially non-smooth model mismatch without constraint qualification conditions. Combining these results yields stability criteria and competitive-ratio bounds for CE-MPC under general asynchronous feedback, including event/self-triggered and multi-step MPC. The guarantees explicitly relate prediction horizon, inter-execution time, and uncertainty magnitude, quantifying performance degradation relative to an ideal infinite-horizon controller. These results clarify tradeoffs between feedback frequency, model accuracy, and horizon length, guiding asynchronous MPC design using approximate or learned models.

0.29

Velocity-Free Funnel Control of Euler-Lagrange Systems: An Artificial-Delay Approach

eess.SY ·2026-11-12 ·Chayan Kumar Paul, Pushpak Jagtap
similarity 0.52
Abstract

Classical funnel control keeps the tracking error within a prescribed, time-varying envelope by increasing the feedback gain as the error approaches the boundary. For mechanical systems, this guarantee typically relies on velocity measurements. We show that it can be retained for fully actuated Euler--Lagrange systems using only position measurements. The proposed controller replaces the velocity error with a difference quotient of the position error over a fixed delay, while preserving the classical unbounded gain. It requires no plant model, reference derivatives, observer, or filter states. The central challenge is to reconcile the averaging inherent in delayed feedback with a gain that can grow without bound near the funnel boundary. We resolve this by establishing an a priori bound on the gain along closed-loop trajectories, independent of the delay. This bound yields a computable delay threshold that guarantees tracking within the prescribed funnel and boundedness of all closed-loop signals. The threshold depends only on bounds on the inertia, forces, and reference. Simulations demonstrate tracking accuracy comparable to full-state funnel control and tolerance of delays substantially longer than certified. With quantized position measurements, the controller also requires substantially less torque than an existing derivative-free funnel controller.

0.30