CS Paper Radar

Robust Active Learning for More Efficient and Reliable Paths to Optimal Design

Hayriye Pehlivan Solak, Francesco Di Fiore, Jeroen Wackers, Riccardo Pellegrini, Andrea Serani, Matteo Diez, Laura Mainini

cs.CE cs.LG ·submitted 2026-10-28 10:11 UTC · v1

Abstract

Simulation-driven design optimization requires active learning strategies that efficiently combine models with different computational costs and levels of fidelity. We introduce Multifidelity Cost-Aware Screening (MF-CAS), which enables the joint selection of sampling location and fidelity using a surrogate that provides decomposed uncertainty intervals rather than a complete predictive probability distribution. MF-CAS exploits the contribution of each fidelity to the high-fidelity uncertainty together with its computational cost to determine whether a candidate should first be evaluated at low fidelity or directly progressed towards high fidelity. The method is assessed on the constrained 14-dimensional hydrodynamic optimization of the DTMB 5415 hull under a deliberately limited computational budget. MF-CAS achieves an approximately 9.0% resistance reduction, compared with 6.7% for the best baseline optimisation method, demonstrating that incorporating fidelity-resolved uncertainty directly into the joint location-fidelity decision can substantially improve multifidelity active learning efficiency.

Comment
Global Conference on Naval Architecture and Ocean Engineering (G-NAOE) 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Stream-Based Active Learning with Cooperative Neural Networks for Data-Efficient Partial Inverse Design: An Automotive Glass Run Channel Case Study

cs.LG cs.AI ·2026-10-07 ·Agung Nugraha, Hyerin Kwon, Heungjun Im, Gian Antariksa, Jihwan Lee
similarity 0.61
Abstract · 21 pages, 12 figures, 3 tables

Inverse design in engineering often runs into a simple problem. Each labeled training sample must be produced through expensive simulation, so building a large dataset is slow and costly. This study addresses that problem for partial inverse design, where only some design variables are specified and the rest must be inferred to reach a target performance value. We propose CoNN-AL, a framework for data-efficient partial inverse design that adds stream-based active learning to the Cooperative Neural Network with Denoising Autoencoder (CoNN-DAE). The model estimates predictive uncertainty through Monte Carlo dropout and uses it to decide, in real time, which incoming candidate samples are worth labeling, so the limited labeling budget is spent on the most informative designs. We validate the framework on a real-world automotive glass run channel dataset of more than 900,000 unique simulated designs. With only 20,000 actively selected labels, about 2.3% of the training pool, CoNN-AL reaches R-squared values of 0.967 to 0.982 across all missing-variable levels, approaching the upper-bound models trained on far more data. It reaches R-squared of at least 0.95 with 30 to 40% fewer labels than random sampling at the more difficult missing-variable levels and, at the most challenging level, is the only strategy in this study to reach R-squared of 0.98. Together with this work, we publicly release the dataset to support future research on data-driven design.

0.29

Localized Generative Design of Ship Hulls with Diffusion Models and High-Fidelity Assessment

cs.AI math.APmath-ph ·2026-10-09 ·Hadi Keramati, Mohammed A. Hannan, Patrick Kirchen, Sina Tousi, Joonas Riekkinen +2 more
benchmark similarity 0.60
Abstract

Practical ship design requires localized refinement and performance evaluation. This paper presents a reward-directed diffusion framework for localized hull optimization. Parametric masking during dataset generation restricts geometric changes to selected variables, including the bulbous bow and forebody, while preserving full-hull continuity. Surrogate-assisted sequential Monte Carlo sampling targets reduced predicted calm-water resistance, with stability retained through training data and displacement matched during screening. An automated viscous free-surface CFD pipeline, validated against measurements for two benchmark container ships, evaluates a generated variant and GenHull E, a hull refined by a naval architect within the same representation. At matched KRISO Container Ship (KCS) displacement, the generated variant has comparable total resistance at $F_n=0.195$ but 45-50% higher resistance at $F_n=0.250$ and $0.260$, missed by empirical screening. GenHull E achieves 6-8% lower total resistance up to $F_n=0.240$ but higher resistance above $F_n=0.250$ as opposing friction and pressure trends reverse the gains. Aggregating resistance across this crossover can conceal tradeoffs that emerge when friction and pressure components are evaluated separately. The assessment reveals an inability to represent a faired bulbous bow and a reward lacking viscous pressure and stability terms. These findings show how high-fidelity assessment informs improved representations and objectives for physically realizable generative designs.

0.24

Multifidelity Operator Inference for Non-intrusive Model Reduction under Data Scarcity

cs.LG math.NAstat.CO ·2026-11-10 ·Vivian Zhang, Tomoki Koike, Atticus Rex, Elizabeth Qian
similarity 0.59
Abstract · 21 pages, AIAA SciTech Forum 2027

Many-query analyses, in which a computational model is repeatedly evaluated, play an important role in uncertainty quantification and optimization for engineering design. However, many-query analyses can be prohibitively expensive when considering high-fidelity numerical models, especially those governed by partial differential equations (PDEs). Surrogate modeling replaces costly simulations with cheap approximations, enabling practical uncertainty quantification and design workflows. Machine learning (ML) approaches to surrogate modeling have gained significant traction in the development of surrogate models due to their non-intrusive nature; they do not require access to the underlying simulation code. The Operator Inference (OpInf) approach, in particular, fits reduced operators to state and corresponding time derivative data. However, high-fidelity training data is scarce due to limited computational budgets, and OpInf models trained on such scarce data often exhibit high variance, a critical liability in high-risk engineering design. We propose Multifidelity Operator Inference (MF-OpInf), which reduces this variance by supplementing scarce high-fidelity snapshots with abundant low-fidelity data drawn from coarser discretizations of the same problem. MF-OpInf handles data across varying fidelity levels by utilizing a multifidelity linear regression framework to estimate the reduced operators. Numerical experiments on model PDE problems demonstrate that MF-OpInf predicts PDE solution fields with higher accuracy compared to the high-fidelity-only OpInf with the same computational budget.

0.37

MF-SCBO : Multi-fidelity Scalable Constrained Bayesian Optimization

cs.LG math.OC ·2026-09-24 ·Lucas Palazzolo, Mickaël Binois, Laëtitia Giraldi
benchmark similarity 0.57
Abstract

Many real-world optimization problems rely on expensive simulations or experiments, making the efficient use of available data essential. Multi-fidelity optimization of high-dimensional black-box functions subject to black-box constraints is increasingly relevant as the cost of objective evaluations continues to rise in applications such as machine learning, engineering, and control. To our knowledge, no existing method simultaneously addresses high-dimensionality, black-box constraints, an arbitrary number of fidelity levels, and non-nested sampling. In this work, we extend the Scalable Constrained Bayesian Optimization method to the multi-fidelity setting, resulting in the MF-SCBO method. The proposed approach is evaluated on standard benchmark functions as well as challenging problems. The experimental results demonstrate that MF-SCBO generally achieves better convergence than both the single-fidelity SCBO and the other multi-fidelity method considered in this high-dimensional and constrained settings.

0.21

Reduced-Space Multi-Fidelity Bayesian Optimization of Process Simulation Models

cs.LG math.OC ·2026-09-15 ·Niki Triantafyllou, Andrea Bernardi, Maria M. Papathanasiou
publishedhot direction similarity 0.57
Abstract · Accepted at the 20th Learning and Intelligent Optimization Conference (LION 20), 2026. Corrected author version. This version corrects a typ…

Optimizing industrial process flowsheets is often computationally prohibitive due to the high cost of rigorous simulations and the curse of dimensionality inherent in complex design spaces. To address these challenges, we present a reduced-space multi-fidelity Bayesian optimization (RS-MFBO) framework designed for high-dimensional, expensive black-box functions. The approach integrates Global Sensitivity Analysis (GSA) for dimensionality reduction with a fidelity-augmented Gaussian process that captures correlations between low-cost approximations and expensive high-fidelity evaluations. A cost-aware acquisition strategy, augmented with cooldown and promotion mechanisms, adaptively guides the allocation of samples across fidelities. The framework is validated on two distinct industrial process simulators: a plasmid DNA bioprocess in SuperPro Designer and a green fuel synthesis plant in Aspen HYSYS. Results across diverse economic and physical objectives demonstrate that the proposed method substantially reduces the number of high-fidelity simulator evaluations while maintaining competitive optimization performance compared to single-fidelity baselines. These results highlight RS-MFBO as a scalable, simulator-agnostic approach for cost-constrained black-box optimization.

0.39

Enabling risk and reliability analysis in next-generation computational tools via multifidelity methods

cs.CE math.OCstat.CO ·2026-11-03 ·Anirban Chaudhuri, Karen Willcox
similarity 0.57
Abstract · Review article

Risk and reliability analysis are fundamental to the design, assessment, and operation of safety-critical complex systems; however, their integration into next-generation computational tools is constrained by the cost of uncertainty quantification with expensive computational models. The computational challenge is particularly prohibitive for tail-sensitive quantities, such as probabilities of failure, conditional values-at-risk, and buffered probabilities of failure, where accurate estimation can require a large number of model evaluations. Multifidelity methods provide a framework for addressing this computational bottleneck by combining information from models of varying accuracy and cost while retaining the predictive accuracy of the high-fidelity model. This review summarizes the state of the art in methods that enable scalable risk and reliability analysis using multifidelity control variates, multifidelity importance sampling, and multifidelity active learning.

0.31

A Novel Multi-fidelity Surrogate for Turbomachinery Design Optimization

cs.CE physics.flu-dyn ·2026-09-10 ·Qineng Wang, Liming Song, Zhendong Guo, Jun Li, Zhenping Feng
publishedbenchmark similarity 0.57
Abstract · Conference author manuscript; 10 pages, 12 figures. Related journal article: DOI 10.1115/1.4064228

Turbomachinery design optimization involves expensive black-box problems. Sample-efficient multi-fidelity optimization (MFO) offers an efficient solution. By utilizing multi-fidelity surrogates (MFS), the MFO algorithm can use fewer high-fidelity samples aided by low-fidelity samples to establish an accurate surrogate model. However, when MFS is used in sequential sampling optimization, it has been observed that the final optimal solution obtained by single-fidelity optimization (SFO) is better than that of MFO, even though MFO performs better at the early stages. This can be attributed to the assumption of an even and nested distribution of samples, which is incorrect when using a sequential adding strategy. To address these issues, we propose a novel algorithm called multi-single-fidelity optimization (MSFO) to overcome the limitations of the conventional MFO procedures. In the surrogate establishment of MSFO, we use the density-based spatial clustering of applications with noise (DBSCAN) method to detect local areas where low-fidelity samples are no longer effective. A combination of both global MFS and local single-fidelity surrogate model, built using high-fidelity samples alone, is used to establish an ensemble, which improves the anti-interference ability of the algorithm against misleading low-fidelity data. The effectiveness of the MSFO algorithm is verified first on numerical benchmark functions. Then, the algorithm is used to optimize the aerodynamic profile of a turbine and the film cooling layout design of a turbine endwall. Here, high-fidelity sample sources are obtained from fine-mesh CFD simulations, whereas low-fidelity sample sources are obtained from the same simulations run on a coarser mesh. The results demonstrate that our MSFO algorithm performs significantly better than the conventional SFO and MFO processes, with a higher level of robustness.

0.72

Exploiting Gradients in Bayesian Inference of Expensive Simulators

cs.LG stat.ML ·2026-10-08 ·Šimon Soldát, Václav Šmídl
top venuecode/data similarity 0.55
Abstract · 8 pages, 4 figures. Code: https://github.com/soldasim/BOSIP.jl

Simulators based on differential equations are ubiquitous in science and engineering. They are often used in simulation-based inference to evaluate the posterior distribution of the input parameters based on real-world observations of the simulator outputs. However, inference becomes challenging when individual simulator evaluations are computationally expensive. In such cases, a Bayesian optimization-based active learning approach with Gaussian process surrogate models has been used to maximize the information obtained from a limited simulation budget. Recently, gradients of simulator outputs with respect to input parameters have become increasingly available, yet they are rarely exploited for inference. Even though we only need to learn the simulator input-output relationship, gradient information can provide an additional valuable signal to guide the active learning procedure. This is of particular interest in the case of expensive simulators, when sample efficiency is crucial. In this paper, we demonstrate how incorporating gradient information into the Gaussian process surrogate accelerates Bayesian optimization-based inference under a limited simulation budget. Our results show significant improvement in convergence speed from using gradient information. For reverse-mode differentiation, the inference efficiency gains are maintained when accounting for the additional computational cost. In contrast, for forward-mode differentiation, the inference speed-up does not outweigh the computational costs. These results indicate that gradient-enhanced surrogates are beneficial primarily in problems where the number of parameters exceeds the output dimensionality, where reverse-mode differentiation is efficient.

0.61