CS Paper Radar

Towards Co-Designed Event-Triggered Extremum Seeking

Roberto Luo, Pedro Henrique Silva Coutinho, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic

eess.SY math.OC ·submitted 2026-08-10 21:27 UTC · v1

Abstract

This paper studies event-triggered gradient-based multivariable extremum seeking for nonlinear maps with polytopic Hessian uncertainty. Unlike existing event-triggered extremum-seeking methods, which first fix the controller (typically diagonal) and then design the triggering mechanism, the proposed approach jointly synthesizes the controller and the triggering mechanism through a co-design framework that admits both diagonal and full controller gain matrices. The co-design problem is formulated as a convex optimization problem with linear matrix inequality constraints. Its solution guarantees exponential convergence of the average closed-loop system with a prescribed decay rate while maximizing the admissible triggering threshold to reduce communication. Lyapunov and averaging analyses establish exponential stability of the event-triggered system, and Zeno-freeness is proved to guarantee implementability. Numerical results illustrate that diagonal gains cannot achieve the same triggering thresholds and decay rates as the full controller gain matrices, highlighting the benefits of exploiting Hessian coupling information.

Comment
7 pages, 3 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Small-Gain Analysis of Robust Event-Triggered Extremum Seeking for Scalar Maps

eess.SY math.OC ·2026-11-18 ·Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic, Zhong-Ping Jiang
theory similarity 0.72
Abstract · 6 pages and 6 figures

We study a sample-and-hold implementation of gradient extremum seeking for a scalar quadratic map in which the control signal is refreshed only when an event occurs. The event generator acts on the demodulated gradient signal as it is actually measured, rather than on its averaged version, and contains a strictly positive offset, following the small-gain philosophy for robust event-triggered control. Rather than invoking averaging theorems, we work directly with the exact dynamics of the parameter estimation error. In the scalar setting, the demodulated gradient has an explicit sinusoidal structure, which is exploited through a change of variables that absorbs the zero-mean oscillatory perturbation, together with a quadratic Lyapunov function and the persistence of excitation of the probing signal. For a sufficiently fast dither, the estimation error is shown to decay exponentially to a residual neighborhood of the origin whose size is quantified by the dither amplitude and frequency, and by the relative threshold and the offset of the event generator. All constants, including the input-to-state stability gain of the extremum seeking loop, the admissible dither frequency and the positive lower bound on the time between two consecutive events, are given in closed form, so that Zeno behavior is excluded. A simulation example illustrates the results.

0.27

Safe Newton-Based Extremum Seeking for Static Maps with Delayed Output Measurements

eess.SY ·2026-09-14 ·Azad Ghaffari, Tiago Roux Oliveira
similarity 0.63
Abstract

This work presents a delayed safe Newton-based extremum seeking (SANES) framework for minimizing an unknown static map subject to an unknown safety constraint. The objective and safety measurements are assumed to be affected by the same constant time delay. To compensate for delayed measurements, a model-free predictor is developed to construct the quantities required for optimization, including the nominal Newton-based extremum-seeking control input and the gradient information used to formulate control Lyapunov function (CLF) and control barrier function (CBF) conditions. Robust CLF--CBF quadratic programs (QPs), subject to parameter-update constraints, are then formulated to account explicitly for derivative-estimation and prediction errors. For the delay-free case, robustness margins are derived from bounds on the extremum-seeking estimation errors, whereas for the delayed case, the margins incorporate both estimation and prediction errors. Practical stability of the nominal Newton-based extremum-seeking dynamics is established directly through a Lyapunov analysis, thereby providing convergence guarantees over the admissible parameter set without relying exclusively on local averaging arguments. Robust CLF and CBF conditions are subsequently derived to establish practical convergence and forward invariance of a robust subset of the prescribed safe set. A numerical case study demonstrates the effectiveness of the proposed SANES framework in achieving constrained optimization despite unknown objective and safety maps and delayed measurements.

0.44

Extremum Seeking Control: Three Revolutions and the Road Ahead

eess.SY math.OC ·2026-08-31 ·Tiago Roux Oliveira
position similarity 0.63
Abstract · Preprint submitted for consideration in The Journal of The Franklin Institute Bicentennial Invited Papers (36 pages, 16 figures)

The history of extremum seeking is not merely the history of an algorithm; it is the history of an idea. Few ideas in control engineering have demonstrated the remarkable longevity of extremum seeking control (ESC). Invented more than one hundred years ago, ESC has continually reinvented itself while remaining faithful to its original objective: enabling systems to optimize their performance without relying on accurate mathematical models. This perspective article proposes that the evolution of ESC is best understood through three scientific revolutions. The first Engineering Revolution (1922-1999) established the engineering principles of model-free optimization; the second Mathematical Revolution (2000-2010) provided the rigorous mathematical foundations that transformed ESC into a mature discipline of nonlinear control; and the third ongoing Infinite-Dimensional and Cyber-Physical Revolution (2010-present) continues to expand its scope toward delays, partial differential equations, distributed optimization, event-triggered implementations, and increasingly complex cyber-physical systems. Beyond recounting this historical evolution, we offer a personal perspective on why ESC has remained relevant across successive technological eras. We argue that its enduring influence arises because the fundamental engineering challenge has never changed: "how can a dynamical system learn to improve its own performance when the optimum is unknown?" As optimization, learning, and feedback control become increasingly intertwined, ESC appears uniquely positioned to contribute to a new generation of intelligent autonomous systems, pointing toward what may become the field's fourth scientific revolution.

0.18

Continuous-Time Covariance Steering with Common Free-Final Time: Finite-Horizon Solutions and Infinite-Horizon Limits

eess.SY math.OC ·2026-08-10 ·Akan Selim, Fengjiao Liu, Siddhartha Ganguly, Panagiotis Tsiotras
similarity 0.58
Abstract · 38 pages, submitted to a journal

This article studies the optimal common free-final time problem for steering the state covariance of a continuous-time stochastic linear system between prescribed initial and terminal covariance matrices. We first establish a deterministic reformulation of the SDE-constrained free-final time stochastic optimal control problem (SOCP). For the ensuing SOCP, we provide necessary conditions for optimality and establish sufficient conditions for the optimal common final time to be finite. Subsequently, we characterize the asymptotic behavior of the finite-horizon optimal solutions as the final time tends to infinity, the invariant sets and trajectories associated with this limiting regime, and derive the sensitivity of the Hamiltonian with respect to the common final time. Finally, leveraging these sensitivities, we develop a trust-region line-search algorithm together with an infinite-horizon case detection method, and demonstrate its performance on three different problems: (a) an illustrative covariance-steering example, (b) a demonstration of spacecraft maneuver using covariance control, and (c) Gaussian mixture to Gaussian mixture steering.

0.41

Multivariable Newton-Based Extremum Seeking with Bounded Update Rates

eess.SY ·2026-09-23 ·Farzaneh Karimi, Mohsen Mojiri, Mohammadali Ghadiri-Modarres, Azadeh Mohammadpour
similarity 0.58
Abstract

We propose a multivariable Newton-based extremum seeking scheme, incorporating known bounds on update rates. The design extends the recent bounded extremum seeking scheme to the Newton-based approach, which makes the convergence rate independent of the unknown Hessian by estimating and inverting the Hessian matrix. As a vital part of the Newton-based algorithm, we design an appropriate demodulation matrix to generate an estimate of the Hessian in an average sense. The local exponential stability of the bounded extremum seeking algorithm is proven for general multivariable static maps using averaging analysis. In comparison with previous practical stability results, it guarantees convergence to a neighborhood of the extremum point with an exact convergence rate exhibiting exponential decay. Subsequently, the main stability result is established for the Newton-based bounded extremum seeking approach under a weak Hessian coupling assumption. Simulation results demonstrate the advantage of the proposed approach over bounded extremum seeking by assigning equal, desired convergence rates to all parameters using the Newton approach.

0.11

Globally Certified Invariant-Ellipsoid Control from Data

eess.SY ·2026-09-30 ·Ngoc Tuan Dinh, Egor Dogadin, Alexey Peregudin
theory similarity 0.56
Abstract · 6 pages, 2 figures. Submitted jointly to IEEE Control Systems Letters (L-CSS) and the American Control Conference (ACC)

This letter develops a data-based method for designing state feedback for a discrete-time linear system under bounded disturbances. For each admissible feedback gain and scalar design parameter, a Lyapunov equation determines an invariant ellipsoid: a region that the state cannot leave under the permitted disturbances. We optimise the gain and parameter to minimise a trace-based measure of the resulting output enclosure. At each parameter value, value iteration gives a lower cost bound, while separate controller evaluation gives an achievable upper bound. These bounds also let us assess whole parameter intervals without evaluating every point. We prove that the search stops after finitely many evaluations with a stabilising state-feedback gain whose objective is within any prescribed absolute tolerance of the infimum over the chosen ellipsoid family. Neither an initially stabilising gain nor attainment of the infimum is assumed. The guarantee assumes exact arithmetic and a sufficiently informative batch of exact measurements, including disturbances during data collection; the resulting feedback uses only the state. A position--velocity example illustrates the bounds, controller checks, and computational cost.

0.32

Dual Control: On Exploration-Exploitation in Linear Systems

eess.SY math.OC ·2026-08-20 ·Tomas J. Meijer, Anders Rantzer
published similarity 0.55
Abstract · To be published in Annual Review of Control, Robotics, and Autonomous Systems Vol. 10 (2027)

The term "dual control" refers to the dual objective of simultaneously balancing exploration and exploitation. Problems of this kind have been studied for nearly a century. This paper is devoted to theory and methodology relevant for optimal control of linear time-invariant systems whose parameters are initially unknown and must be learned by active probing. We review the main ideas underlying four major research directions: Multi-armed bandits, self-tuning regulators, regret rate minimizing controllers, and minimax optimal dual controllers. The first three have a long history and rich literature, whereas the fourth provides a promising framework for robust dual control.

0.34

Minimax optimal dual control of positive systems: an exact solution for scalar input-sign uncertainty

eess.SY math.OC ·2026-08-15 ·Fethi Bencherki, Tomas J. Meijer, Anders Rantzer
similarity 0.55
Abstract

While recent advances in minimax dual control have led to exact solutions for uncertain general linear time-invariant systems as well as (sub)optimal dual controllers, corresponding results for linear positive systems are still lacking. This paper aims to fill this gap and thereby pave the way toward scalable dual control algorithms. We study the general minimax optimal dual control problem for positive linear systems with unknown dynamics and reformulate it as a standard zero-sum dynamic game. By allowing randomized control inputs, we solve the corresponding Bellman equation exactly for the scalar case with sign uncertainty in the input. This yields an implicit dual control policy that is optimal both in terms of cost and $\ell_1$-gain. The optimal dual policy uses exploration in a specific region of the hyperstate space to conduct optimal probing. Outside this exploration regime, the controller reduces to a deterministic certainty equivalence policy, indicating that sufficient information has been obtained to identify the correct input direction. In addition, these results allow us to analyze fundamental limitations of minimax dual control for positive systems and provide a foundation for more general dual control problems for positive systems for future work.

0.04