CS Paper Radar

A Dynamic Aggregation Strategy Enhanced Efficient Global Optimization Algorithm for Solving High-Dimensional Turbomachinery Design Problems

Qineng Wang, Zhendong Guo, Yun Chen, Guangjian Ma, Liming Song, Jun Li

cs.LG cs.CE ·submitted 2026-09-13 13:46 UTC · v1
publishedbenchmark

Abstract

In order to solve the high-dimensional ($d \geq 30$) expensive black-box problems within budget, an efficient global optimization (EGO) algorithm with a dynamic aggregation strategy is proposed, labeled as DA-EGO. Specifically, the DA-EGO decomposes the original high-dimensional design space into a set of low-dimensional subspaces for efficient surrogate-based optimization search, and the optimal solutions of subspaces are combined as an elite point for the global search. Most importantly, the subspaces are not fixed. Instead, the subspace variables are updated in each iteration, according to the variable interaction analyses in the sub- and full-spaces. The perturbation method and the analysis of variance are used to detect variable interactions. To further accelerate the optimization progress, the searching ranges of subspaces are also adaptively adjusted according to the analyses of subspace optimization results of the previous iteration. Tests on 21 benchmark instances, comprising seven functions at 30, 60, and 90 dimensions, show that DA-EGO is effective on separable and partially separable problems under a budget of 1500 function evaluations. Its advantage is case-dependent: on the non-separable shifted Rosenbrock function, GSGA performs better at 60 and 90 dimensions, while the 30-dimensional results are statistically comparable to IKAEA and GSGA. Moreover, the advantage of DA-EGO is also seen in the aerodynamic optimization of a transonic rotor blade with 28 variables as well as the compressor stage optimization with 60 variables. With the above, the effectiveness of the proposed DA-EGO has been well demonstrated.

Comment
Author manuscript updated to align core methods and results with the published article; 37 pages, 14 figures, 11 tables
Journal ref
Engineering Optimization 57(2), 514-542 (2025)
DOI
10.1080/0305215X.2024.2325651

Closest papers

Nearest neighbours by meaning across the whole index.

KT-EGO: A Knowledge Transfer Assisted Efficient Global Optimization Algorithm for Solving High-Dimensional Expensive Black-Box Problems

cs.CE cs.LG ·2026-09-28 ·Qineng Wang, Liming Song, Yun Chen, Guangjian Ma, Zhendong Guo +1 more
publishedbenchmarkhighly cited similarity 0.68
Abstract · 25 pages, 12 figures; abridged author manuscript

Many engineering problems involve optimizing a high-dimensional expensive black-box (HEB) design space. To solve such problems efficiently, we propose a knowledge transfer assisted efficient global optimization (EGO) algorithm, labeled as KT-EGO, which extends the EGO algorithm for solving problems over higher dimensions (i.e., $d>20$). Specifically, the original design space is divided into several low-dimensional subset design spaces. More importantly, in order to extract information from the subset design spaces to accelerate the progress of full optimization, we propose a surrogate-based data fusion strategy in KT-EGO. And further, a searching strategy with an adaptive variable range is devised to enhance the exploitation of promising areas. To show the effectiveness of our proposed algorithm, it is compared against the state-of-the-art algorithms over 12 benchmark functions and a 28-dimensional engineering optimization for the design of compressor blade, which fully validates the effectiveness of the KT-EGO for solving HEB problems.

0.49

A Novel Multi-fidelity Surrogate for Turbomachinery Design Optimization

cs.CE physics.flu-dyn ·2026-09-10 ·Qineng Wang, Liming Song, Zhendong Guo, Jun Li, Zhenping Feng
publishedbenchmark similarity 0.63
Abstract · Conference author manuscript; 10 pages, 12 figures. Related journal article: DOI 10.1115/1.4064228

Turbomachinery design optimization involves expensive black-box problems. Sample-efficient multi-fidelity optimization (MFO) offers an efficient solution. By utilizing multi-fidelity surrogates (MFS), the MFO algorithm can use fewer high-fidelity samples aided by low-fidelity samples to establish an accurate surrogate model. However, when MFS is used in sequential sampling optimization, it has been observed that the final optimal solution obtained by single-fidelity optimization (SFO) is better than that of MFO, even though MFO performs better at the early stages. This can be attributed to the assumption of an even and nested distribution of samples, which is incorrect when using a sequential adding strategy. To address these issues, we propose a novel algorithm called multi-single-fidelity optimization (MSFO) to overcome the limitations of the conventional MFO procedures. In the surrogate establishment of MSFO, we use the density-based spatial clustering of applications with noise (DBSCAN) method to detect local areas where low-fidelity samples are no longer effective. A combination of both global MFS and local single-fidelity surrogate model, built using high-fidelity samples alone, is used to establish an ensemble, which improves the anti-interference ability of the algorithm against misleading low-fidelity data. The effectiveness of the MSFO algorithm is verified first on numerical benchmark functions. Then, the algorithm is used to optimize the aerodynamic profile of a turbine and the film cooling layout design of a turbine endwall. Here, high-fidelity sample sources are obtained from fine-mesh CFD simulations, whereas low-fidelity sample sources are obtained from the same simulations run on a coarser mesh. The results demonstrate that our MSFO algorithm performs significantly better than the conventional SFO and MFO processes, with a higher level of robustness.

0.72

A practical DIRECT-type algorithm for medium-scale black-box global optimization

cs.LG math.NA ·2026-09-09 ·Linas Stripinis, Remigijus Paulavičius
publishedbenchmarkunusual similarity 0.59
Abstract · 46pages, 13 figures, 4 tables

The DIRECT algorithm is a deterministic global optimization method known for its versatility and balanced exploration-exploitation strategy. However, DIRECT-type algorithms are primarily effective for low-dimensional problems and often exhibit slow convergence as dimensionality increases, limiting their applicability to more complex optimization tasks. To address this limitation, this paper introduces X-DTC-GL, a novel DIRECT-type algorithm that incorporates dynamic partitioning and hybridization techniques. The dynamic partitioning approach adaptively refines the search space based on local one-dimensional surrogate models, enabling rapid subdivision of promising hyper-rectangles. The hybridization strategy selectively employs a hill-climbing method to exploit promising regions identified by the surrogate models. Extensive experiments on four diverse benchmark suites demonstrate that X-DTC-GL significantly outperforms existing DIRECT-type baselines, achieving improvements of ~12% in solvability and ~27% in solution quality. Performance-profile analyses indicate the fastest convergence on up to ~40% of instances, the best runtime performance on ~17% of problems, and competitive overall execution times. By improving performance within the partition-based framework, these advances strengthen the algorithm's competitiveness in state-of-the-art black-box optimization.

0.54

Hybrid Joint-Selective Optimization: Reduced-Space Levenberg-Marquardt Refinement of Low-Dimensional Parameters of Interest

cs.LG math.NAcs.NEmath.OC ·2026-09-29 ·Muhammad Luthfi Shahab, Gabriella Alfa Indahsari, Imam Mukhlash, Hadi Susanto
similarity 0.58
Abstract

This paper introduces a hybrid joint-selective optimization (HJSO) framework for large-scale numerical problems in which a small subset of trainable quantities is of primary interest. We partition the full parameter vector into a high-dimensional remaining block and a low-dimensional block of parameters of interest (POIs), perform joint first-order optimization over the full parameter set, and then freeze the remaining variables while applying a reduced-space Levenberg-Marquardt (LM) refinement to the POIs. The method is designed for settings in which the POIs are low-dimensional but strongly influence the quality of the computed solution, while the full parameter space remains too large for full-space second-order methods. The framework is evaluated on three representative problems: a matrix eigenvalue problem, an inverse Bratu problem solved with a physics-informed neural network, and a 100-dimensional nonlinear Black-Scholes problem solved with the DeepBSDE method. In each test, HJSO reaches prescribed POI-error thresholds faster than the corresponding joint first-order baseline and improves the final POI accuracy for the reported solver configurations. The contribution is therefore not a universal optimizer, but a practical reduced-space strategy for problems with known low-dimensional parameters of interest and expensive high-dimensional training variables.

0.20

A Novel Multi-fidelity Surrogate for Efficient Turbine Design Optimization

cs.CE physics.flu-dyn ·2026-09-10 ·Qineng Wang, Liming Song, Zhendong Guo, Jun Li, Zhenping Feng
publishedhighly cited similarity 0.58
Abstract · Journal author manuscript; 12 pages, 13 figures. Related conference article: DOI 10.1115/GT2023-104237

To solve the turbine design optimization problems efficiently, surrogate-based optimization (SBO) algorithms are frequently used. To further reduce the cost of turbine design, the multi-fidelity surrogate (MFS) based optimization is proposed by the researchers, who resort to augmenting the small number of expensive high-fidelity (HF) samples by a large portion of low-fidelity (LF) but cheap samples in surrogate modeling and optimization process. Nonetheless, according to our observations, the MFS based optimization sometimes can only have better convergence rate at the early stage of optimization process, but yielding worse final solution than the single-fidelity surrogate (SFS) based optimization that uses high-fidelity samples alone. The reason behind can be explained as follows. With the increase of HF samples in the optimization process, the LF samples can cause negative effect and therefore misleading the optimization search. To address the above issue, an ensemble weighted multi-fidelity surrogate (EMFS) is proposed. Specifically, the density-based spatial clustering of applications with noise (DBSCAN) is used to detect the region where the MFS cannot build a more accurate surrogate, and a local SFS is built there. Then, an EMFS is built by combining the MFS and SFS with adaptive weights, which is used to guide the optimization process. The related algorithm is named as multi- and single-fidelity surrogate fused optimization, i.e., MSFO. Through tests on GE-E3 blade optimization and the film cooling layout design of a turbine endwall, the effectiveness of proposed MSFO is well demonstrated.

0.75

Parallel Multi-Fidelity Expected Improvement Method for Efficient Global Optimization

cs.CE ·2026-09-23 ·Zhendong Guo, Qineng Wang, Liming Song, Jun Li
publishedhighly cited similarity 0.57
Abstract · 13 pages, 6 figures

Multi-Fidelity optimization (MFO) has received extensive attentions in engineering design, which resorts to augmenting the small number of expensive high-fidelity (HF) samples by a large number of low-fidelity (LF) but cheap samples to improve the optimization performance. A key factor that influences the effectiveness of MFO is how to adaptively assign samples for HF and LF simulations in the iteration process. To address such sample assignment issue in MFO, we propose a new infill criterion named as Filter-GEI, which imposes an adaptive filter function on top of the generalized expected improvement (GEI) acquisition function. In particular, by taking the correlations between HF and LF models into account, the Filter-GEI can efficiently allocate HF and LF samples to achieve a good balance in between the local and global search. Furthermore, considering parallel computing, the Filter-GEI infills multiple HF and LF samples in each iteration, which can further improve its efficiency as computing power increases. Through tests on five mathematical toy problems and one engineering problem for the turbine blade design, the effectiveness of the proposed algorithm has been well demonstrated.

0.60

High-dimensional Multi-objective Bayesian Optimization with Learned Variable Interactions

cs.LG cs.AI ·2026-08-12 ·Hongyan Wang, Jiayu Huang, Haotian Zheng, Xin Gao, Chi Ding +4 more
published similarity 0.56
Abstract · 13 pages, 15 figures, 3 tables

Multi-objective Bayesian optimization (MOBO) is effective in identifying the Pareto fronts for expensive black-box problems. However, most current MOBO approaches are limited to low-dimensional decision space due to its exponential sampling complexity. This paper presents decision variable interaction analysis-based MOBO, ViaMOBO, a generic framework for expensive multi-objective problems with high-dimensional decision space. The key idea of ViaMOBO is that it utilizes a variable interaction analysis model to determine whether the decision space can be completely or partially divided, and then performs local Bayesian optimization in the divided decision subspaces. Through the variable analysis model, it can be derived whether the objectives in black-box problems are separable, partially separable, or non-separable based on the potential independent or interdependent relationships among decision variables without any strong assumptions. We compare ViaMOBO with the state-of-the-art MOBO methods on both synthetic and real-world benchmarks. The experimental results demonstrate that ViaMOBO outperforms other related MOBO baselines in approximating the Pareto front of high-dimensional expensive multi-objective problems.

0.28

Topology optimization with buckling constraints: Adaptive eigenvalue aggregation and modality identification

cs.CE ·2026-09-17 ·Badvelu Pranay Prabha, Prabhat Kumar
similarity 0.56
Abstract · 33 pages

This paper presents novel approaches to tackle two key challenges in topology optimization problems with buckling constraints: determining how many eigenvalues to aggregate and identifying the eigenvalue modality at the optimal design. We demonstrate the mathematical inconsistencies that arise when choosing an arbitrary fixed number of eigenvalues for aggregation. Specifically, if the multiplicity of the critical eigenvalues is smaller than the chosen subset size, coalescence with higher-order eigenvalues can occur. Neglecting these during aggregation causes incorrect sensitivities, while simply increasing the preselected eigenvalue count unnecessarily raises computational costs. To resolve this issue, we propose an approach that dynamically determines the exact number of eigenvalues required at each optimization iteration. The proposed approach reduces computation time significantly while maintaining competitive performance relative to the conventional method across the numerical experiments presented. Additionally, accurately predicting modality at the optimal point is crucial for understanding the buckled mode shapes of optimized designs. A new optimization formulation is proposed using the difference between eigenvalues to capture the true eigenvalue modality. This formulation is first validated on a classical 1D clamped column, successfully predicting both the bimodal solution and the optimal eigenvectors. The approach demonstrates that the optimal solutions for the wall reinforcement and shear-loaded hinged plate problems for the given set of parameters are trimodal and tetramodal, respectively.

0.27