CS Paper Radar

A Hybrid Gaussian Process-Extreme Gradient Boosting Machine Learning Framework for Robust Knockdown Factor Prediction and Reliability-Based Design of Thin Spherical Shell Caps

Budhaditya De, Rohan Majumder, Devasmit Dutta, Aman Deep Gupta, Sudib Kumar Mishra

cs.LG ·submitted 2026-10-11 19:30 UTC · v1
theory

Abstract

Elastic buckling remains a critical concern in the design of deep spherical shell caps, given that experiments reveal a significant reduction of critical loads from those predicted by linearized eigen-buckling analysis. This discrepancy has been attributed to initial geometric imperfections and is often reconciled through a dimensionless parameter, namely the knockdown factor (KDF). However, conventional KDFs (NASA SP-8007; Eurocode 3) are highly conservative, as they represent the lower bound of an extensive body of experimental data. This study aims to narrow the conservatism in the KDFs for spherical shell caps through machine learning (ML) regression models trained on experimental data on spherical shell buckling. A hybrid model is proposed by combining Gaussian Process Regression (GPR) with Extreme Gradient Boosting (XGBoost), and its improved performance is demonstrated over conventional ML algorithms, i.e., the Artificial Neural Network (ANN), Support Vector Regressor (SVR), Random Forest Regressor (RFR), and Histogram-based Gradient Boosting (HGBoost). Each of these models uses six input features and a single output, i.e., the KDF. The most critical feature affecting the KDF is ascertained through a sensitivity analysis. The study concludes with a reliability-based design framework that relies on the predictive ML model to obtain safety-consistent, yet less conservative, KDFs.

Closest papers

Nearest neighbours by meaning across the whole index.

A Physics-informed Neural Network Approach for Robust Buckling Load Prediction and Reliability-Based Design of Thin Truncated Conical Shells

cs.LG ·2026-08-22 ·Devasmit Dutta, Budhaditya De, Rohan Majumder, Sudip Kumar Mishra
similarity 0.66
Abstract

Thin-walled truncated conical shells are widely used in aerospace, marine, offshore, and lightweight infrastructure systems due to their high strength-to-weight ratio and geometric efficiency. Their buckling resistance under axial compression, however, is highly sensitive to geometric imperfections, manufacturing tolerances, material variability, and nonlinear instability effects. Conventional design procedures rely on conservative knockdown factors (KDFs), such as those recommended in NASA SP-8019, which do not explicitly account for shell geometry, fabrication quality, data uncertainty, or target reliability. This study develops a physics-informed neural network (PiNN) framework for predicting critical buckling loads of thin truncated conical shells and integrates the trained surrogate within a reliability-based design (RBD) formulation. The model combines geometric and material descriptors with mechanics-informed features derived from shell stability theory and the localized reduced stiffness method (LRSM). A physics-informed loss function penalizes mechanically inadmissible predictions exceeding the theoretical elastic buckling load. The framework is trained and evaluated using 133 experimental Mylar conical shell tests under axial compression. Compared with a conventional deep neural network (DNN), the PiNN improves predictive accuracy, reduces mean absolute error, and enhances physical consistency. The trained PiNN is then used to evaluate reliability indices and calibrate safety-consistent KDFs for prescribed target reliability levels. Results demonstrate that the PiNN-RBD framework provides an efficient approach for uncertainty-aware design of imperfection-sensitive shell structures.

0.49

On the Brittleness of Maximum Likelihood Estimation for Gaussian Process Hyperparameter Optimization

cs.LG stat.MLstat.ME ·2026-08-13 ·Tyler R. Johnson, Kian Ben-Jacob, Christopher P. Muller, Ramin Bostanabad
code/data similarity 0.53
Abstract · 26 pages, 10 figures, 2 tables

Machine learning (ML) has become an indispensable part of modern engineering design workflows. A crucial step in training an ML model is the selection of the loss function which can be systematically formulated via various techniques such as maximum likelihood estimation (MLE) and cross-validation . While MLE is one of the most popular, effective, and intuitive mechanisms for training ML models, it is brittle: if the assumptions underpinning it are not met, the trained ML model may generalize poorly. This brittleness affects even Gaussian processes (GPs) which are widely used in engineering design and are often (incorrectly) presumed to be very robust to overfitting. In this paper, we fundamentally evaluate the brittleness of MLE in the context of training GPs for probabilistic regression or classification tasks. We compare theoretically grounded metrics against MLE and propose practical solutions. Our extensive studies demonstrate the effectiveness of our solutions in downstream design tasks such as Bayesian optimization and provide a blueprint for practitioners to build accurate and robust GPs that can even outperform tabular foundation models in terms of prediction accuracy, uncertainty quantification, and inference cost. Our contributions are publicly available via GitHub at https://github.com/Bostanabad-Research-Group/GP-vs-TabPFN-vs-GPyTorch.

0.30

From Grey-Box to Green-Box: When can Physics-Informed Machine Learning Reduce Carbon Footprints in Structural Health Monitoring?

cs.LG ·2026-09-27 ·Daisy R. Bradley, Nathan A. Hinchliffe, Daniel J. Pitchforth, Matthew R. Jones, Elizabeth J. Cross
similarity 0.52
Abstract · 27 pages, 15 figures

Machine learning plays an increasingly vital role in engineering, but the corresponding increase in compute time is not without environmental cost. Physics-informed machine learning or "grey-box" models have been developed to overcome some of the limitations of traditional black-box learners, utilising the physical insight that an engineer would have about the structure they are modelling and have shown promising results in the structural engineering field among many others. This work explores whether an additional advantage could be a reduced environmental impact, considering the relationship between training data quantity and training time, linking this duration to carbon emissions from computing. In a structural health monitoring context, four physics-informed machine learning approaches - spanning Gaussian processes and neural networks - are evaluated: residual modelling, input augmentation, hybrid modelling, and constrained learning. The emissions for training each of the models to reach a given error threshold is compared, and in most examples, shown to be lower for the physics-informed models (with input augmented models being an exception). This reduction in training emissions further compounds the environmental savings achieved by collecting and storing less data. Although promising results, we cannot expect a silver bullet and the case studies demonstrate that a trade-off is needed between the increased complexity that comes from introducing physics into a machine learner, against the gain from reduced training data requirements.

0.23

The norm, not the labels: training and evaluating finite-element surrogates for stress analysis in the energy norm

cs.CE cs.LG ·2026-11-09 ·Ruifeng Cao, Xidan Song
similarity 0.52
Abstract · 45 pages, 6 figures; supplementary material (37 pages, 4 figures) appended

Finite-element surrogates predict the stresses of a new design in one evaluation, but are usually trained on solutions with a displacement loss and compared by it, although engineering decisions rest on stresses. Application in engineering: stress analysis of perforated plates and solids with cavities, parametric families in which holes concentrate stress. Contribution to artificial intelligence: training and evaluating such surrogates in the energy norm, with or without solutions, and screening their predictions without solutions. For linear elastostatics, minimising the assembled discrete potential energy is exactly supervised regression in this norm: the energy gap of a prediction is the strain energy of its stress error. A displacement loss under-weights the stiff modes that carry the strains. In pre-registered comparisons, changing only the norm of the supervised loss cut a three-dimensional transformer's median energy-norm error 7.5-fold and its median von Mises error 6.1-fold; in two dimensions it more than halved the von Mises error, also on held-out instances. In three dimensions, the transformer trained on the energy alone came within a factor of 1.3 of the energy-norm-supervised one in median energy-norm and von Mises error. It was more accurate than the displacement-supervised one on all five metrics in every seed. Given the stiffness matrix, a Ritz projection was more accurate than the label-free transformer, in the seed means, on every metric but peak stress. No network transferred to a substantially finer mesh. The energy ranks predictions of a load case, and its sign flags those worse than the zero field.

0.47

Boosted Physics-Informed Neural Networks for Solving Homogeneous and Non-Homogeneous Lane-Emden Type Equations

cs.LG math-phastro-ph.GAcs.NE ·2026-10-31 ·Luke Oluwaseye Joel
hot direction similarity 0.51
Abstract · 24 pages, 25 figures

The Lane-Emden Equation is a class of nonlinear differential equations commonly used to model phenomena in astrophysics and mathematical physics, such as stellar structure and thermal behavior in polytropic gas spheres. This study presents a novel hybrid framework that integrates Physics-Informed Neural Networks (PINNs) with boosting methods to enhance the accuracy and robustness of solutions for Lane-Emden type differential equations. Standard PINNs leverage physical laws encoded within the loss function, but their predictive performance can be constrained by optimization challenges and approximation errors. To address this, we introduce a post-processing boosting stage where the residual errors from the PINN prediction are modeled using some regression algorithms - including LightGBM, Random Forest, XGBoost, and Support Vector Regression (SVR). The outputs from these boosted models are aggregated to generate a corrected, high-fidelity prediction. The proposed methodology is systematically validated through quantitative metrics and comparative analysis against the standard PINN baseline. The results demonstrate that the boosted PINN framework significantly reduces prediction error, and improves generalization, offering a powerful and flexible approach for solving scientific and engineering problems governed by differential equations.

0.33

Structured Extrema Errors in Classical Surrogates for Viscous Burgers: A Physics-Consistent Interpretation

cs.LG physics.flu-dyn ·2026-09-07 ·Youssef Oubari
similarity 0.51
Abstract · 21 pages, 13 figures, 13 tables

We study the local errors of classical machine-learning surrogate models, which approximate the time evolution of the one-dimensional viscous Burgers equation. Four models are compared on the same prediction task, using the spatial grid values directly: radial basis function (RBF) kernel ridge regression (KRR), linear Ridge, ExtraTrees, and Random Forests. Across all four models, the one-step residual, defined here as the true value minus the predicted value at each grid point, forms clear curved branches near predicted maxima and minima. A more detailed analysis of KRR shows that these errors are much more strongly related to the second spatial derivative, which measures local curvature, than to the first spatial derivative. Near a smooth extremum, predicted value and curvature form a local two-branch fold. Under our local curvature-based model of the residual, this fold predicts a leading-order near-parabolic relation between predicted value and residual. This geometric result motivates a direct test of the Burgers advection (transport) and diffusion (smoothing) terms. For KRR and Ridge, regression tests on held-out trajectories, a control that breaks the spatial alignment of the diffusion term, and a spectral test of high-frequency content are consistent with insufficient viscous smoothing at moderate and high viscosity. In this case, the surrogate retains more small-scale structure than the true future state. The same physical explanation is much weaker for the tree models. Finally, a correction that uses only predicted quantities reduces both one-step error and error during recursive rollout, where each prediction is used as the next input.

0.33

Two-stage Residual Learning for Modelling Strength-Informed Optimisation of Thermal Systems

cs.LG ·2026-10-14 ·Talha Ansar, Waqar Muhammad Ashraf, Abdulelah S. Alshehri, Omar Bayomie
similarity 0.50
Abstract

Aggregate performance metrics do not identify local modelling inaccuracies in machine learning (ML) surrogates used for thermal-system optimisation. This study assesses local modelling strength through validation-based reliability screening and post-optimisation residual assessment. A two-stage residual learning (TSRL) framework, built on artificial neural networks (ANNs), is developed for modelling-strength-informed and domain-constrained optimisation of thermal systems. Within the TSRL framework, a base ANN predicts the process output, and a residual ANN learns the signed residuals left by the base ANN. The TSRL framework is implemented on two case studies of thermal systems, including 817 simulation observations of a crude distillation unit and operating records from a 395 MW industrial gas turbine. The TSRL framework reduces the test root mean square error (RMSE) from 10.3 g/s to 4.7 g/s for Fuel Oil in the refinery dataset and from 151 kJ/kWh to 105 kJ/kWh for turbine heat rate (THR). The base ANNs trained within TSRL are embedded in domain-constrained optimisation problems, and the modelling strength at each computed solution is assessed using the locked residual-score threshold. Each computed solution receives a good modelled region (GMR) or weak modelled region (WMR) label to inform ML model-based decision-making for safety-critical operation of thermal systems.

0.17

Data-Driven Surrogate-Model for Real-Time Loads Prediction in Floating Wind Farms

eess.SY ·2026-10-13 ·Federico Bellini, Majid Ebrahimi, Alessandro Fontanella, Marcus Becker, Jan-Willem Van Wingerden +2 more
similarity 0.50
Abstract

This work presents a data-driven load-surrogate modelling framework for real-time control of floating offshore wind farms. The proposed methodology uses mid-fidelity simulations performed with OpenFAST and FAST.Farm together with MLife fatigue analysis to generate Damage Equivalent Load (DEL) datasets of floating wind turbines under wake steering conditions. A two-stage surrogate modelling approach is adopted: first, a Feed-Forward Neural Network (FFNN) is trained using data from simulations of a single floating wind turbine, while a second stage corrects the residual error between the FFNN predictions and FAST.Farm simulations using either Gaussian Process Regression (GPR) or an additional FFNN. The results show that the proposed framework can estimate DELs with errors generally below 15% for tower base bending moment, blade root bending moment, yaw bearing moment, and fairlead tension, while maintaining computational times compatible with real-time applications. The study also highlights the challenges related to generalization of the load-surrogate model under varying environmental and control conditions, especially for large floating wind farms. Overall, the proposed methodology demonstrates the potential of surrogate-based DEL estimation for load-aware floating wind farm control applications.

0.19