CS Paper Radar

Extremal-Phase-Guided Sequential Convex Optimization: Model Order Reduction

Mustafa Oğuz Yeğin, Hitay Özbay, Tomáš Vyhlídal

eess.SY ·submitted 2026-11-04 18:06 UTC · v1
benchmark

Abstract

Fixed-order frequency-weighted H-infinity approximation is a nonconvex problem, and local optimization methods can be sensitive to initialization. We present extremal-phase-guided sequential convex optimization (EPGSCO) for stable fixed-order rational approximation. We introduce a novel phase-guidance technique motivated by the all-pass structure underlying optimal Hankel-norm approximation, with a phase template fitted to the error-magnitude derivative at dominant peaks. We integrate this guidance with dominant-peak selection, focused frequency grids, and adaptive pole-residue and polynomial-coefficient updates to address stagnation and improve approximation accuracy. CD-player examples and benchmarks with known optimal errors evaluate the algorithm against established methods. Comparisons with classical sequential convex optimization (SCO) under shared settings for the common components assess the combined contribution of phase guidance and adaptive frequency refinement. Results demonstrate improved accuracy in most of the tested cases and attainment of the known optimum from four tested initializations for a constructed order-42 benchmark, with additional computation in some cases.

Comment
20 pages, 6 figures, 6 tables, submitted to International Journal of Control

Closest papers

Nearest neighbours by meaning across the whole index.

A Local-Linearly Convergent Algorithm for Nonconvex Equality-Constrained Optimization

cs.LG math.OCstat.ML ·2026-08-12 ·Frank E. Curtis, Lingjun Guo, Daniel P. Robinson
similarity 0.59
Abstract

For solving nonconvex equality-constrained optimization problems, a recent Gradient-Eigenstep Algorithm by Goyens et al.~is an iteration-efficient approach, based on minimizing Fletcher's augmented Lagrangian function, for finding an approximate second-order stationary point from an arbitrary starting point. In this paper, the analysis of this algorithm is extended, offering a two-fold contribution. First, it is shown that a local-linear rate of convergence can be obtained by this method if it is initiated sufficiently close to a strong second-order stationary point and employs a sufficiently small step-size parameter and sufficiently large penalty parameter. In this case, the algorithm reduces to a gradient descent algorithm applied to minimize Fletcher's augmented Lagrangian. Second, as a particularly useful application of the first result, it is shown that the Gradient-Eigenstep algorithm can be used as an iteration-efficient subproblem solver in the context of a progressive sampling strategy for solving equality-constrained optimization problems when the objective and constraint functions are defined by large sample averages, ultimately offering an algorithm with an improved worst-case sample complexity when compared to an approach that solves a full-sample problem directly.

0.04

High-Order Sinusoidal Modeling for Precise Parameter Refinement

eess.SP eess.AS ·2026-10-15 ·Shaowen Chen, Tomoki Toda
unusual similarity 0.57
Abstract · This manuscript is currently under review for publication in the IEEE Transactions on Signal Processing. This work has been submitted to the…

Although the amplitude estimation of sinusoids is a linear and tractable problem when their frequencies are known, the accuracy of signal modeling is fundamentally limited by the inevitable frequency mismatches produced by existing methods. Quasi-harmonic modeling (QHM) and its extensions (aQHM and eaQHM) offer the ability to refine frequency estimates while extracting amplitudes; however, their extraction and correction capabilities remain limited. In this paper, we first revisit QHM methods from the perspective of frequency mismatches, and reveal that their performances are essentially constrained by the order of the model. Specifically, QHM methods are linear models and thus incapable of capturing higher-order frequency variations, leading to suboptimal modeling accuracy. Second, to address this limitation, we propose a higher-order modeling framework that enables more precise approximation of signal components. Eventually, we qualitatively characterize the optimization problem and employ the Levenberg--Marquardt (LM) algorithm for parameter estimation. As a result, the proposed method allows for significantly improved estimation of amplitudes, frequencies, and phases of sinusoidal components, enabling more accurate signal modeling. Experiments on both simulation study and speech signals demonstrate the superiority of the high-order model in frequency refinement and parameter extraction and its robustness under additive noise conditions.

0.24

Adaptively Incorporating Directional Hints into Zeroth-Order Optimization

cs.LG math.OC ·2026-09-08 ·Alexander Ryabchenko, Jian Qian, Wenlong Mou
similarity 0.57
Abstract

We study zeroth-order optimization of nonconvex functions with the aid of directional hints, which are cheap but potentially inaccurate approximations of the true gradient direction, given by linear subspaces at each iteration. To leverage these hints adaptively while maintaining robustness to their quality, we introduce Control-Variate Zeroth-Order Descent (CV-ZOD), a new framework that refines the classical zeroth-order gradient estimator with a control variate that can be set based on the directional hints. We first show that the oracle algorithm that optimally sets the reference vector and step size at each iteration achieves a convergence rate that interpolates between the first-order $O(1/T)$ rate and the zeroth-order $O(d/T)$ rate, depending on the quality of the hints along the trajectory. We then develop a practical variant of CV-ZOD that achieves the same oracle guarantee up to logarithmic factors, without any prior knowledge of the hint quality. We validate the method empirically on simulation-based scientific optimization tasks, demonstrating sustained progress on nonconvex landscapes where zeroth-order descent is slower and existing guided methods stall as guidance deteriorates.

0.28

Robust Data-Driven Controller Synthesis from Sampled and Uncertain Frequency Response Estimates using Integral Quadratic Constraints

eess.SY ·2026-10-14 ·Luuk Marceau Spin, Maurice W. P. M. H. Heemels, Nathan van de Wouw, Roland Toth
similarity 0.54
Abstract · 15 pages, 6 figures, none other publications

In this paper, we develop a novel MIMO controller synthesis method that relies solely on frequency-domain data of discrete-time systems. The approach is based on an iterative design procedure using \emph{integral quadratic constraints} (IQCs). It generalizes existing data-driven methods that approximate semi-infinite IQC conditions by enforcing them on a finite set of measured frequency points. Such approximations do not provide guarantees on the continuous frequency axis and may fail to capture inter-frequency behavior. We address this limitation by formulating a convex optimization problem that preserves robustness guarantees over the entire frequency range. In particular, the proposed method explicitly accounts for inter-frequency behavior of both plant and controller, leading to certified robust stability and performance. The effectiveness and computational efficiency of the approach are demonstrated using experimentally obtained frequency response data from industrial-grade semiconductor equipment. The synthesized controller is implemented on the physical setup, and its performance is validated in real-time experiments.

0.35

ALDER: A Single-Loop Augmented-Lagrangian Damped Extragradient Method for Nonconvex--Concave Minimax Problems with Nonlinear Coupled Constraints

cs.LG math.OCstat.ML ·2026-10-31 ·H. Zhang, M. Zhang, Z. Xu, Y. -H. Dai
similarity 0.52
Abstract

ALDER, a single-loop augmented-Lagrangian damped extragradient method, is proposed for smooth nonconvex--concave minimax problems with nonlinear coupled inequality constraints. Within an augmented-Lagrangian framework, ALDER combines prediction--correction steps for the primal variables with explicit projected-and-relaxed multiplier updates in a single loop. The penalty parameter is fixed throughout each run, eliminating inner-loop subproblem solves and iterative penalty updates. We establish uniform boundedness of the relaxed multiplier sequence and, under an extended Mangasarian--Fromovitz constraint qualification, boundedness of the projected output multiplier. Building on these bounds, we show that ALDER finds an $\varepsilon$-KKT point within $\mathcal{O}(\varepsilon^{-7/2})$ complete first-order oracle evaluations in the strongly concave setting and $\mathcal{O}(\varepsilon^{-4})$ in the concave setting. These bounds improve upon the best known complexity bounds for multi-loop algorithms for this problem class, achieved by FAL, by removing a $\log(1/\varepsilon)$ factor, while retaining a single-loop update structure.

0.18

Hybrid Sequential Feedback Optimization for Wind Farm Power Maximization

eess.SY math.OC ·2026-09-15 ·Shijie Huang, Sergio Grammatico
published similarity 0.52
Abstract · Accepted to the 65th IEEE Conference on Decision and Control (CDC 2026)

This paper considers feedback optimization for optimal steady-state operation of nonlinear discrete-time systems when the steady-state input-output map and its sensitivity are expensive to compute. We propose a hybrid extension of sequential feedback optimization (SFO) that augments the model-based SFO gradient with correction terms through a convex combination with summable diminishing weights. Two variants are studied: one based on recursive least-squares (RLS) sensitivity estimation, and another on extremum seeking control (ESC) gradient estimation. Under contractivity and smoothness assumptions, we show that both hybrid schemes preserve the convergence of SFO to a neighborhood of the optimal steady state. The proposed methods are validated through a wind farm power maximization problem using a medium-fidelity model, demonstrating improved early transient performance compared to pure SFO.

0.36

Optimal Allocation of Grid-Forming Frequency Shaping Control

eess.SY ·2026-09-21 ·Zhaomin Lyu, Ding Zhang, Yan Jiang
similarity 0.52
Abstract

Various inverter-based control strategies have been proposed to improve frequency security for power systems with high renewable penetration. Among them, the grid-forming frequency shaping control is particularly promising due to its ability to shape the post-contingency aggregate system frequency dynamics into first-order with prescribed rate of change of frequency (RoCoF) and steady-state frequency deviation. Moreover, the shaped aggregate dynamics depends on the harmonic sum of all inverter transfer functions rather than on their distribution. In light of this, here we explore how to allocate shaping control resources to minimize the transient control effort needed to achieve ideal coherent dynamics. We formulate it as a constrained optimization problem by tackling two main difficulties. First, we make the squared $\mathcal{H}_2$ norm legitimate quantification of transient control cost under step power imbalances through a system transformation. Second, we simplify the $s$-domain constraint for Nadir elimination into a standard constraint that is easy to implement in optimization. The resulting non-convex optimization problem can be solved by existing successive convexification method. The effectiveness of the allocation has been verified on the modified Icelandic Power Network test case.

0.28

Near-Optimal Single-Loop Predictor--Corrector Extragradient Method for Strongly Convex--Strongly Concave Minimax Optimization

cs.LG math.OCstat.ML ·2026-09-17 ·Minhao Zhang, Zi Xu
similarity 0.51
Abstract

We study smooth strongly convex--strongly concave minimax optimization in the deterministic unconstrained setting, without assuming a bilinear or separable structure. Although existing multi-loop methods attain near-optimal condition-number dependence, standard single-loop methods generally exhibit a substantial complexity gap. To close this gap, we propose the Single-Loop Predictor--Corrector Extragradient Method with Damped Momentum (PCE-DM), which combines an extragradient prediction--correction scheme with a novel auxiliary feedback recursion for the weaker-curvature variable. PCE-DM uses fixed parameters and two new full-gradient evaluations per iteration after one initialization query, while requiring no inner solves, accuracy schedules, or staged restarts. We develop a Lyapunov analysis that controls the predictor--corrector mismatch through corrected-gradient increments and establish last-iterate linear convergence. Specifically, PCE-DM computes an $\varepsilon$-accurate relative solution, measured by the squared Euclidean distance to the saddle point, within $\mathcal{O}\!\left(\sqrt{κ_xκ_y} \log(2κ_xκ_y/\varepsilon)\right)$ full-gradient queries. This result closes the condition-number complexity gap between standard single-loop methods and near-optimal multi-loop methods, matching the known lower-bound order up to logarithmic factors while retaining fixed, explicit single-loop updates. Numerical experiments on regularized linear regression and AUC maximization demonstrate the computational efficiency of PCE-DM.

0.44