CS Paper Radar

Parallel Multi-Fidelity Expected Improvement Method for Efficient Global Optimization

Zhendong Guo, Qineng Wang, Liming Song, Jun Li

cs.CE ·submitted 2026-09-23 04:06 UTC · v1
publishedhighly cited

Abstract

Multi-Fidelity optimization (MFO) has received extensive attentions in engineering design, which resorts to augmenting the small number of expensive high-fidelity (HF) samples by a large number of low-fidelity (LF) but cheap samples to improve the optimization performance. A key factor that influences the effectiveness of MFO is how to adaptively assign samples for HF and LF simulations in the iteration process. To address such sample assignment issue in MFO, we propose a new infill criterion named as Filter-GEI, which imposes an adaptive filter function on top of the generalized expected improvement (GEI) acquisition function. In particular, by taking the correlations between HF and LF models into account, the Filter-GEI can efficiently allocate HF and LF samples to achieve a good balance in between the local and global search. Furthermore, considering parallel computing, the Filter-GEI infills multiple HF and LF samples in each iteration, which can further improve its efficiency as computing power increases. Through tests on five mathematical toy problems and one engineering problem for the turbine blade design, the effectiveness of the proposed algorithm has been well demonstrated.

Comment
13 pages, 6 figures
Journal ref
Structural and Multidisciplinary Optimization 64(3), 1457-1468 (2021)
DOI
10.1007/s00158-021-02931-1

Closest papers

Nearest neighbours by meaning across the whole index.

A Novel Multi-fidelity Surrogate for Efficient Turbine Design Optimization

cs.CE physics.flu-dyn ·2026-09-10 ·Qineng Wang, Liming Song, Zhendong Guo, Jun Li, Zhenping Feng
publishedhighly cited similarity 0.64
Abstract · Journal author manuscript; 12 pages, 13 figures. Related conference article: DOI 10.1115/GT2023-104237

To solve the turbine design optimization problems efficiently, surrogate-based optimization (SBO) algorithms are frequently used. To further reduce the cost of turbine design, the multi-fidelity surrogate (MFS) based optimization is proposed by the researchers, who resort to augmenting the small number of expensive high-fidelity (HF) samples by a large portion of low-fidelity (LF) but cheap samples in surrogate modeling and optimization process. Nonetheless, according to our observations, the MFS based optimization sometimes can only have better convergence rate at the early stage of optimization process, but yielding worse final solution than the single-fidelity surrogate (SFS) based optimization that uses high-fidelity samples alone. The reason behind can be explained as follows. With the increase of HF samples in the optimization process, the LF samples can cause negative effect and therefore misleading the optimization search. To address the above issue, an ensemble weighted multi-fidelity surrogate (EMFS) is proposed. Specifically, the density-based spatial clustering of applications with noise (DBSCAN) is used to detect the region where the MFS cannot build a more accurate surrogate, and a local SFS is built there. Then, an EMFS is built by combining the MFS and SFS with adaptive weights, which is used to guide the optimization process. The related algorithm is named as multi- and single-fidelity surrogate fused optimization, i.e., MSFO. Through tests on GE-E3 blade optimization and the film cooling layout design of a turbine endwall, the effectiveness of proposed MSFO is well demonstrated.

0.75

A Novel Multi-fidelity Surrogate for Turbomachinery Design Optimization

cs.CE physics.flu-dyn ·2026-09-10 ·Qineng Wang, Liming Song, Zhendong Guo, Jun Li, Zhenping Feng
publishedbenchmark similarity 0.60
Abstract · Conference author manuscript; 10 pages, 12 figures. Related journal article: DOI 10.1115/1.4064228

Turbomachinery design optimization involves expensive black-box problems. Sample-efficient multi-fidelity optimization (MFO) offers an efficient solution. By utilizing multi-fidelity surrogates (MFS), the MFO algorithm can use fewer high-fidelity samples aided by low-fidelity samples to establish an accurate surrogate model. However, when MFS is used in sequential sampling optimization, it has been observed that the final optimal solution obtained by single-fidelity optimization (SFO) is better than that of MFO, even though MFO performs better at the early stages. This can be attributed to the assumption of an even and nested distribution of samples, which is incorrect when using a sequential adding strategy. To address these issues, we propose a novel algorithm called multi-single-fidelity optimization (MSFO) to overcome the limitations of the conventional MFO procedures. In the surrogate establishment of MSFO, we use the density-based spatial clustering of applications with noise (DBSCAN) method to detect local areas where low-fidelity samples are no longer effective. A combination of both global MFS and local single-fidelity surrogate model, built using high-fidelity samples alone, is used to establish an ensemble, which improves the anti-interference ability of the algorithm against misleading low-fidelity data. The effectiveness of the MSFO algorithm is verified first on numerical benchmark functions. Then, the algorithm is used to optimize the aerodynamic profile of a turbine and the film cooling layout design of a turbine endwall. Here, high-fidelity sample sources are obtained from fine-mesh CFD simulations, whereas low-fidelity sample sources are obtained from the same simulations run on a coarser mesh. The results demonstrate that our MSFO algorithm performs significantly better than the conventional SFO and MFO processes, with a higher level of robustness.

0.72

A Dynamic Aggregation Strategy Enhanced Efficient Global Optimization Algorithm for Solving High-Dimensional Turbomachinery Design Problems

cs.LG cs.CE ·2026-09-13 ·Qineng Wang, Zhendong Guo, Yun Chen, Guangjian Ma, Liming Song +1 more
publishedbenchmark similarity 0.57
Abstract · Author manuscript updated to align core methods and results with the published article; 37 pages, 14 figures, 11 tables

In order to solve the high-dimensional ($d \geq 30$) expensive black-box problems within budget, an efficient global optimization (EGO) algorithm with a dynamic aggregation strategy is proposed, labeled as DA-EGO. Specifically, the DA-EGO decomposes the original high-dimensional design space into a set of low-dimensional subspaces for efficient surrogate-based optimization search, and the optimal solutions of subspaces are combined as an elite point for the global search. Most importantly, the subspaces are not fixed. Instead, the subspace variables are updated in each iteration, according to the variable interaction analyses in the sub- and full-spaces. The perturbation method and the analysis of variance are used to detect variable interactions. To further accelerate the optimization progress, the searching ranges of subspaces are also adaptively adjusted according to the analyses of subspace optimization results of the previous iteration. Tests on 21 benchmark instances, comprising seven functions at 30, 60, and 90 dimensions, show that DA-EGO is effective on separable and partially separable problems under a budget of 1500 function evaluations. Its advantage is case-dependent: on the non-separable shifted Rosenbrock function, GSGA performs better at 60 and 90 dimensions, while the 30-dimensional results are statistically comparable to IKAEA and GSGA. Moreover, the advantage of DA-EGO is also seen in the aerodynamic optimization of a transonic rotor blade with 28 variables as well as the compressor stage optimization with 60 variables. With the above, the effectiveness of the proposed DA-EGO has been well demonstrated.

0.48

KT-EGO: A Knowledge Transfer Assisted Efficient Global Optimization Algorithm for Solving High-Dimensional Expensive Black-Box Problems

cs.CE cs.LG ·2026-09-28 ·Qineng Wang, Liming Song, Yun Chen, Guangjian Ma, Zhendong Guo +1 more
publishedbenchmarkhighly cited similarity 0.56
Abstract · 25 pages, 12 figures; abridged author manuscript

Many engineering problems involve optimizing a high-dimensional expensive black-box (HEB) design space. To solve such problems efficiently, we propose a knowledge transfer assisted efficient global optimization (EGO) algorithm, labeled as KT-EGO, which extends the EGO algorithm for solving problems over higher dimensions (i.e., $d>20$). Specifically, the original design space is divided into several low-dimensional subset design spaces. More importantly, in order to extract information from the subset design spaces to accelerate the progress of full optimization, we propose a surrogate-based data fusion strategy in KT-EGO. And further, a searching strategy with an adaptive variable range is devised to enhance the exploitation of promising areas. To show the effectiveness of our proposed algorithm, it is compared against the state-of-the-art algorithms over 12 benchmark functions and a 28-dimensional engineering optimization for the design of compressor blade, which fully validates the effectiveness of the KT-EGO for solving HEB problems.

0.49

Simple Extensions of Single-Objective Acquisition Functions and Hedge Strategies for Multi-Objective Bayesian Optimization

cs.LG math.OCstat.ML ·2026-09-25 ·Haris Moazam Sheikh
published similarity 0.54
Abstract · 40th Conference on Neural Information Processing Systems (NeurIPS 2026)

Multi-objective Bayesian optimization (MOBO) is commonly approached through specialized acquisition functions or scalarization schemes designed to explicitly account for trade-offs among non-preferential objectives. In this work, we show that such complexity might be unnecessary. We propose a framework that extends standard single-objective acquisition functions directly to the multi-objective setting through a hypervolume-based methodology. We further extend hedge strategies for acquisition functions, which are typically used only in single-objective optimization, to the multi-objective regime. Our approach requires minimal modification to existing Bayesian optimization pipelines and avoids the need for bespoke multi-objective formulations. We demonstrate how a broad class of commonly used single-objective acquisition functions and hedge strategies can be adapted in a principled manner to handle multiple objectives, while preserving their intuitive interpretation and computational efficiency. Empirically, we evaluate the proposed methods across a range of synthetic and real-world multi-objective benchmarks. Despite their simplicity, our extensions consistently match or outperform more complex state-of-the-art MOBO methods in terms of optimization performance and sample efficiency. These results suggest that effective multi-objective Bayesian optimization can be achieved by reusing and carefully extending well-established single-objective acquisition strategies, offering a simpler and more flexible alternative to existing approaches.

0.27

Reduced-Space Multi-Fidelity Bayesian Optimization of Process Simulation Models

cs.LG math.OC ·2026-09-15 ·Niki Triantafyllou, Andrea Bernardi, Maria M. Papathanasiou
publishedhot direction similarity 0.53
Abstract · Accepted at the 20th Learning and Intelligent Optimization Conference (LION 20), 2026. Corrected author version. This version corrects a typ…

Optimizing industrial process flowsheets is often computationally prohibitive due to the high cost of rigorous simulations and the curse of dimensionality inherent in complex design spaces. To address these challenges, we present a reduced-space multi-fidelity Bayesian optimization (RS-MFBO) framework designed for high-dimensional, expensive black-box functions. The approach integrates Global Sensitivity Analysis (GSA) for dimensionality reduction with a fidelity-augmented Gaussian process that captures correlations between low-cost approximations and expensive high-fidelity evaluations. A cost-aware acquisition strategy, augmented with cooldown and promotion mechanisms, adaptively guides the allocation of samples across fidelities. The framework is validated on two distinct industrial process simulators: a plasmid DNA bioprocess in SuperPro Designer and a green fuel synthesis plant in Aspen HYSYS. Results across diverse economic and physical objectives demonstrate that the proposed method substantially reduces the number of high-fidelity simulator evaluations while maintaining competitive optimization performance compared to single-fidelity baselines. These results highlight RS-MFBO as a scalable, simulator-agnostic approach for cost-constrained black-box optimization.

0.39

MF-SCBO : Multi-fidelity Scalable Constrained Bayesian Optimization

cs.LG math.OC ·2026-09-24 ·Lucas Palazzolo, Mickaël Binois, Laëtitia Giraldi
benchmark similarity 0.52
Abstract

Many real-world optimization problems rely on expensive simulations or experiments, making the efficient use of available data essential. Multi-fidelity optimization of high-dimensional black-box functions subject to black-box constraints is increasingly relevant as the cost of objective evaluations continues to rise in applications such as machine learning, engineering, and control. To our knowledge, no existing method simultaneously addresses high-dimensionality, black-box constraints, an arbitrary number of fidelity levels, and non-nested sampling. In this work, we extend the Scalable Constrained Bayesian Optimization method to the multi-fidelity setting, resulting in the MF-SCBO method. The proposed approach is evaluated on standard benchmark functions as well as challenging problems. The experimental results demonstrate that MF-SCBO generally achieves better convergence than both the single-fidelity SCBO and the other multi-fidelity method considered in this high-dimensional and constrained settings.

0.21

LLM-Assisted Multi-Fidelity Bayesian Optimization: Fusing Expert Knowledge with Numerical Data

cs.LG cs.AIcs.CE ·2026-11-18 ·Dongjun Han, Mingyu Lee, Ikjin Lee
similarity 0.50
Abstract · 35 pages, 8 figures, 3 tables

Multi-fidelity Bayesian optimization (MFBO) reduces engineering design cost by combining inexpensive low-fidelity (LF) models with a few accurate high-fidelity (HF) evaluations and sequentially selecting designs to evaluate. However, when HF data are scarce, the LF-HF discrepancy is difficult to learn from numerical data alone, especially when physics omitted in the LF model makes it design-dependent. Yet even without sufficient data, domain experts often know which physics the LF model omits and under which conditions its effect grows. Existing multi-fidelity (MF) models cannot use such qualitative knowledge directly, but large language models (LLMs) can interpret it and compare designs accordingly. The proposed LLM-Assisted MFBO adds a knowledge basis to the conventional MF model: from an expert description of the omitted physics, an LLM judges which of two designs requires the larger signed residual correction, and a pairwise Gaussian process converts these judgments into the basis. HF data calibrate its contribution and sign, so the knowledge is not trusted blindly. On a lithium-ion battery design problem, the proposed method reduced the regret area under the curve of conventional MFBO by 61%. Knowledge quality, rather than the choice of LLM, determined whether the search was accelerated, as shown by a controlled study that varied the two independently. A knowledge-level ablation further quantified the contribution of each knowledge statement. These results show that LLM-interpreted expert knowledge can complement numerical data as an information source in MFBO.

0.29