CS Paper Radar

Small-Gain Analysis of Robust Event-Triggered Extremum Seeking for Scalar Maps

Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic, Zhong-Ping Jiang

eess.SY math.OC ·submitted 2026-11-18 20:38 UTC · v1
theory

Abstract

We study a sample-and-hold implementation of gradient extremum seeking for a scalar quadratic map in which the control signal is refreshed only when an event occurs. The event generator acts on the demodulated gradient signal as it is actually measured, rather than on its averaged version, and contains a strictly positive offset, following the small-gain philosophy for robust event-triggered control. Rather than invoking averaging theorems, we work directly with the exact dynamics of the parameter estimation error. In the scalar setting, the demodulated gradient has an explicit sinusoidal structure, which is exploited through a change of variables that absorbs the zero-mean oscillatory perturbation, together with a quadratic Lyapunov function and the persistence of excitation of the probing signal. For a sufficiently fast dither, the estimation error is shown to decay exponentially to a residual neighborhood of the origin whose size is quantified by the dither amplitude and frequency, and by the relative threshold and the offset of the event generator. All constants, including the input-to-state stability gain of the extremum seeking loop, the admissible dither frequency and the positive lower bound on the time between two consecutive events, are given in closed form, so that Zeno behavior is excluded. A simulation example illustrates the results.

Comment
6 pages and 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Towards Co-Designed Event-Triggered Extremum Seeking

eess.SY math.OC ·2026-08-10 ·Roberto Luo, Pedro Henrique Silva Coutinho, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic
similarity 0.72
Abstract · 7 pages, 3 figures

This paper studies event-triggered gradient-based multivariable extremum seeking for nonlinear maps with polytopic Hessian uncertainty. Unlike existing event-triggered extremum-seeking methods, which first fix the controller (typically diagonal) and then design the triggering mechanism, the proposed approach jointly synthesizes the controller and the triggering mechanism through a co-design framework that admits both diagonal and full controller gain matrices. The co-design problem is formulated as a convex optimization problem with linear matrix inequality constraints. Its solution guarantees exponential convergence of the average closed-loop system with a prescribed decay rate while maximizing the admissible triggering threshold to reduce communication. Lyapunov and averaging analyses establish exponential stability of the event-triggered system, and Zeno-freeness is proved to guarantee implementability. Numerical results illustrate that diagonal gains cannot achieve the same triggering thresholds and decay rates as the full controller gain matrices, highlighting the benefits of exploiting Hessian coupling information.

0.07

On Delay-robustness of Extremum Seeking of Nonlinear Static Maps with Small Disturbance

eess.SY ·2026-09-15 ·Jianzhong Li, Yang Zhu, Hongye Su
similarity 0.62
Abstract

Extremum seeking (ES) is a real-time optimization strategy, thus transmission delays in the feedback loop of ES have big impact on its stability. How big delay that ES control systems are able to withstand? This paper provides a potential answer to this problem. We focus on gradient-based ES for nonlinear static maps subject to known constant delays plus a small time-varying delay uncertainty. We also consider the measurement to be subject to a small disturbance. Different from a majority of existing literature addressing quadratic maps with delays by predictor feedback, this paper deals with a wider class of non-quadratic maps without any predictor or observer for delay compensation. Dither signals in modulation and demodulation are carefully designed to handle constant delays and time-varying delay uncertainties. When the nonlinear map is unknown, we offer a rigorously analytical framework of ES convergence and delay-robustness. When some a prior knowledge of nonlinear maps is available, we are able to provide a quantitative estimation on upper bounds of time delay and dither periods to keep ES systems to remain stable. A suitable choice of ES parameters guarantees practical stability for any large known constant delay.

0.14

Safe Newton-Based Extremum Seeking for Static Maps with Delayed Output Measurements

eess.SY ·2026-09-14 ·Azad Ghaffari, Tiago Roux Oliveira
similarity 0.58
Abstract

This work presents a delayed safe Newton-based extremum seeking (SANES) framework for minimizing an unknown static map subject to an unknown safety constraint. The objective and safety measurements are assumed to be affected by the same constant time delay. To compensate for delayed measurements, a model-free predictor is developed to construct the quantities required for optimization, including the nominal Newton-based extremum-seeking control input and the gradient information used to formulate control Lyapunov function (CLF) and control barrier function (CBF) conditions. Robust CLF--CBF quadratic programs (QPs), subject to parameter-update constraints, are then formulated to account explicitly for derivative-estimation and prediction errors. For the delay-free case, robustness margins are derived from bounds on the extremum-seeking estimation errors, whereas for the delayed case, the margins incorporate both estimation and prediction errors. Practical stability of the nominal Newton-based extremum-seeking dynamics is established directly through a Lyapunov analysis, thereby providing convergence guarantees over the admissible parameter set without relying exclusively on local averaging arguments. Robust CLF and CBF conditions are subsequently derived to establish practical convergence and forward invariance of a robust subset of the prescribed safe set. A numerical case study demonstrates the effectiveness of the proposed SANES framework in achieving constrained optimization despite unknown objective and safety maps and delayed measurements.

0.44

Extremum Seeking Control: Three Revolutions and the Road Ahead

eess.SY math.OC ·2026-08-31 ·Tiago Roux Oliveira
position similarity 0.55
Abstract · Preprint submitted for consideration in The Journal of The Franklin Institute Bicentennial Invited Papers (36 pages, 16 figures)

The history of extremum seeking is not merely the history of an algorithm; it is the history of an idea. Few ideas in control engineering have demonstrated the remarkable longevity of extremum seeking control (ESC). Invented more than one hundred years ago, ESC has continually reinvented itself while remaining faithful to its original objective: enabling systems to optimize their performance without relying on accurate mathematical models. This perspective article proposes that the evolution of ESC is best understood through three scientific revolutions. The first Engineering Revolution (1922-1999) established the engineering principles of model-free optimization; the second Mathematical Revolution (2000-2010) provided the rigorous mathematical foundations that transformed ESC into a mature discipline of nonlinear control; and the third ongoing Infinite-Dimensional and Cyber-Physical Revolution (2010-present) continues to expand its scope toward delays, partial differential equations, distributed optimization, event-triggered implementations, and increasingly complex cyber-physical systems. Beyond recounting this historical evolution, we offer a personal perspective on why ESC has remained relevant across successive technological eras. We argue that its enduring influence arises because the fundamental engineering challenge has never changed: "how can a dynamical system learn to improve its own performance when the optimum is unknown?" As optimization, learning, and feedback control become increasingly intertwined, ESC appears uniquely positioned to contribute to a new generation of intelligent autonomous systems, pointing toward what may become the field's fourth scientific revolution.

0.18

Multivariable Newton-Based Extremum Seeking with Bounded Update Rates

eess.SY ·2026-09-23 ·Farzaneh Karimi, Mohsen Mojiri, Mohammadali Ghadiri-Modarres, Azadeh Mohammadpour
similarity 0.55
Abstract

We propose a multivariable Newton-based extremum seeking scheme, incorporating known bounds on update rates. The design extends the recent bounded extremum seeking scheme to the Newton-based approach, which makes the convergence rate independent of the unknown Hessian by estimating and inverting the Hessian matrix. As a vital part of the Newton-based algorithm, we design an appropriate demodulation matrix to generate an estimate of the Hessian in an average sense. The local exponential stability of the bounded extremum seeking algorithm is proven for general multivariable static maps using averaging analysis. In comparison with previous practical stability results, it guarantees convergence to a neighborhood of the extremum point with an exact convergence rate exhibiting exponential decay. Subsequently, the main stability result is established for the Newton-based bounded extremum seeking approach under a weak Hessian coupling assumption. Simulation results demonstrate the advantage of the proposed approach over bounded extremum seeking by assigning equal, desired convergence rates to all parameters using the Newton approach.

0.11

Minimax optimal dual control of positive systems: an exact solution for scalar input-sign uncertainty

eess.SY math.OC ·2026-08-15 ·Fethi Bencherki, Tomas J. Meijer, Anders Rantzer
similarity 0.55
Abstract

While recent advances in minimax dual control have led to exact solutions for uncertain general linear time-invariant systems as well as (sub)optimal dual controllers, corresponding results for linear positive systems are still lacking. This paper aims to fill this gap and thereby pave the way toward scalable dual control algorithms. We study the general minimax optimal dual control problem for positive linear systems with unknown dynamics and reformulate it as a standard zero-sum dynamic game. By allowing randomized control inputs, we solve the corresponding Bellman equation exactly for the scalar case with sign uncertainty in the input. This yields an implicit dual control policy that is optimal both in terms of cost and $\ell_1$-gain. The optimal dual policy uses exploration in a specific region of the hyperstate space to conduct optimal probing. Outside this exploration regime, the controller reduces to a deterministic certainty equivalence policy, indicating that sufficient information has been obtained to identify the correct input direction. In addition, these results allow us to analyze fundamental limitations of minimax dual control for positive systems and provide a foundation for more general dual control problems for positive systems for future work.

0.04

Globally Certified Invariant-Ellipsoid Control from Data

eess.SY ·2026-09-30 ·Ngoc Tuan Dinh, Egor Dogadin, Alexey Peregudin
theory similarity 0.55
Abstract · 6 pages, 2 figures. Submitted jointly to IEEE Control Systems Letters (L-CSS) and the American Control Conference (ACC)

This letter develops a data-based method for designing state feedback for a discrete-time linear system under bounded disturbances. For each admissible feedback gain and scalar design parameter, a Lyapunov equation determines an invariant ellipsoid: a region that the state cannot leave under the permitted disturbances. We optimise the gain and parameter to minimise a trace-based measure of the resulting output enclosure. At each parameter value, value iteration gives a lower cost bound, while separate controller evaluation gives an achievable upper bound. These bounds also let us assess whole parameter intervals without evaluating every point. We prove that the search stops after finitely many evaluations with a stabilising state-feedback gain whose objective is within any prescribed absolute tolerance of the infimum over the chosen ellipsoid family. Neither an initially stabilising gain nor attainment of the infimum is assumed. The guarantee assumes exact arithmetic and a sufficiently informative batch of exact measurements, including disturbances during data collection; the resulting feedback uses only the state. A position--velocity example illustrates the bounds, controller checks, and computational cost.

0.32

Resilient Extremum Seeking Control for Cyber-Physical Systems Under Denial-of-Service Attacks

eess.SY math.OC ·2026-09-12 ·Filipe da Silva Bastos Teixeira, Pedro Henrique Silva Coutinho, Tiago Roux Oliveira, Miroslav Krstic
similarity 0.54
Abstract · Preprint submitted to IEEE Transactions on Control of Network Systems (12 pages, 4 figures)

Extremum seeking control (ESC) relies on deliberately injected excitation to extract optimization information from measured outputs, making its networked implementation particularly vulnerable to denial-of-service (DoS) attacks. This paper develops a resilient discrete-time ESC architecture for cyber-physical systems subject to DoS attacks. By holding the most recently successfully transmitted signals during DoS intervals, the proposed mechanism yields averaged error dynamics with an exponentially contracting mode under successful communication and a neutral mode under attack. For deterministic DoS attacks, practical exponential convergence to the extremum is established under an average bound on the attack duration, with an explicit convergence rate depending on the fraction of time under attack. For probabilistic DoS attacks, almost-sure and in-probability convergence properties are established via stochastic averaging, with the attack success probability explicitly entering the convergence rate. A key finding is that a seemingly natural zero-input strategy can fundamentally compromise ESC: attacks synchronized with the dither generate an $\mathcal{O}(1/a)$ bias in the averaged dynamics, where $a$ is the dither amplitude, and can displace the equilibrium from the true optimizer. Thus, under the proposed hold-based architecture, increasingly severe DoS attacks primarily slow the optimization process rather than destroy its stability, provided that communication is not permanently blocked. Numerical simulations illustrate the theoretical guarantees and the failure mechanism induced by dither-synchronized attacks.

0.54