CS Paper Radar

Response-balanced sampling relocates rather than improves accuracy in slope-stability surrogates under a fixed simulation budget

Iancu-Bogdan Teodoru, Alessia Amelio, Mircea Aniculăesi, Irina Lungu

cs.CE ·submitted 2026-10-28 20:12 UTC · v1
code/data

Abstract

Machine-learning surrogates of slope stability learn factors of safety (FOS) that only physics-based analyses produce, so analyses are the budget to allocate. Because Latin hypercube sampling (LHS) of the parameters covers the FOS unevenly, a natural remedy is to choose part of the training points to even out the FOS distribution. We test this response-balanced sampling at a fixed budget. A random-forest screener trained on a 300-point LHS seed predicts the FOS of 200,000 candidates, and 300 further limit-equilibrium analyses are allocated to even out the FOS over the selection range, $[0.5, 6]$. The design is compared with 300 further LHS analyses over five realizations of the added points, on two test sets, under two independently tuned tree-ensemble families, with ablations throughout; an oracle drawing from 22,000 solved analyses meets the intended density exactly. The primary criterion is the log-scale root-mean-square error (log-RMSE) on the decision range, FOS $\in [0.5, 2)$, against continued LHS. Response-balanced sampling does not systematically improve accuracy; it relocates accuracy along the FOS axis, consistently across realizations, from $[1, 2)$ to $[0.5, 1)$, following the training density actually achieved, even when the intended density is met exactly. On the decision range no screener-selected design shows a demonstrated gain, and with known bin membership that verdict stands, in this design. Within the selection range, LHS gives $[0.5, 1)$ 11-12% of the points against a log-uniform target's 27.9%, but $[1, 2)$ already 35-37%: the region that is rare need not be where decisions are made.

Comment
36 pages, 4 figures, 5 tables, plus 82 pages of supplementary material (10 figures, 33 tables). Submitted to Data-Centric Engineering. Data: https://doi.org/10.5281/zenodo.23618253 ; code: https://github.com/bteodoru/surrogate-guided-slope-stability (release archived at https://doi.org/10.5281/zenodo.23727659)

Closest papers

Nearest neighbours by meaning across the whole index.

Beyond Point Prediction: Artificial Representative Trees with Uncertainty

cs.LG stat.ML ·2026-09-21 ·Lea L. Mairhöfer, Silke Szymczak, Björn-Hergen Laabs, Tuwe Löfström-Cavallin
benchmark similarity 0.60
Abstract · 28 pages and 10 figures (without appendix)

Random forests (RFs) predict well but are opaque, whereas single decision trees are interpretable but unstable. Artificial representative trees (ARTs) were developed as interpretable surrogate models for RFs, but their use as standalone prediction models with uncertainty quantification has not been systematically investigated. We combine ARTs with leaf-wise Mondrian conformal predictive systems (CPS), enabling a single tree to provide continuous predictions, prediction intervals, and probabilities of exceeding arbitrary thresholds. We compared ARTs with CPS against decision trees with CPS and separate regression and probability trees across five simulation scenarios, 21 benchmark datasets, and a cross-sectional NHANES example data set. Repeated cross-validation assessed predictive performance, interpretability, and stability. ARTs with CPS yield compact, structurally stable trees with substantially more reproducible split-variable selection than decision trees across benchmark datasets and NHANES. Decision trees showed slightly better predictive performance and narrower prediction intervals, while coverage was broadly comparable. CPS-based trees generally achieved lower and less variable Brier scores than multi-model approaches. Combining ARTs with CPS therefore provides a single, interpretable, and stable model for continuous predictions and calibrated probabilities, balancing predictive performance with reproducibility and transparency in settings where stability and interpretability are essential.

0.26

A budget-dependent crossover between coverage- and response-based training-set selection for machine-learned interatomic potentials

cs.LG ·2026-09-05 ·Jia Bi, Alin-Marin Elena
similarity 0.57
Abstract

Selecting compact training sets for machine-learned interatomic potentials requires deciding whether to preserve structural diversity or target configurations on which models disagree. The better choice can depend on how much data is retained, making a comparison at one training-set size insufficient. Here we link selection criteria to prediction accuracy through a budget-resolved comparison of retrained MACE models on GAP-20 Carbon and pooled revised MD17. Structural coverage is compared with a response-guided selector that targets disagreement between a coverage-trained model and a full-data reference. This retrospective response witness tests the value of model disagreement for compressing an already labelled pool. At 5\%, coverage gives smaller absolute deviations from the full-data error than random sampling across four force endpoints in both datasets. The witness has larger deviations than coverage at 1\% and 5\%, but the ordering reverses at 20\%. At 20\%, witness-selected models also lower direct held-out force errors by 0.46--5.89\% relative to coverage, with all eight paired training-seed intervals favouring the witness. Six errors fall below the full-data reference. Mean force-error reductions are 0.164--0.167~meV~$\textÅ^{-1}$, with larger gains for tail and masked endpoints. Complementary analyses show that learned similarity preserves the coverage ranking, while selecting by frozen-model error gives higher error than embedding coverage. These findings establish retained-data budget as a deciding variable in atomistic training-set selection and provide a direct test of when response-guided compression improves on structural coverage.

0.32

Interpreting Random Forests: Comparing Surrogate Models and Rule Extraction Methods

cs.LG stat.MEstat.ML ·2026-11-14 ·Lea L. Mairhöfer, Jonathan B. Krause, Björn-Hergen Laabs, Silke Szymczak
benchmark similarity 0.55
Abstract · 4 figures

Random forests (RFs) often achieve high prediction performance, but their ensemble structure can be difficult to interpret. Surrogate models and rule extraction methods offer interpretable approximations, yet guidance on selecting an appropriate method for a specific research question remains limited. We compared 12 methods for interpreting RFs, with a decision tree as a prediction-oriented reference, across 11 simulation settings and 67 benchmark datasets for regression and classification. Evaluation addressed prediction and structural similarity to the RF, model complexity, prediction performance, and runtime. Simulations additionally assessed explainability using known effect and noise variables. No method performed best across all objectives. For regression, SLIM provided the strongest general performance for prediction similarity or performance on test data, while a linear model offered a simpler global interpretation of linear effects when performance was comparable. For classification, inTrees achieved the strongest overall benchmark performance, with CTree and OC-CART providing useful alternatives. ART consistently produced the most compact representations. NH and SIRUS offered strong structural similarity for regression, while MRT most closely reproduced RF variable usage in the classification simulations, illustrating that prediction-oriented rankings do not necessarily identify the best structural explanation. Outcome-type restrictions, runtime limits, and method-specific failures reduced result availability for several approaches and should be considered alongside performance when selecting a method. Method selection should therefore be guided by the outcome type, anticipated data structure, and intended interpretability objective. Prediction similarity alone is insufficient for explaining an RF and should be considered jointly with structural similarity and model complexity.

0.24

Improving the Predictive Performance of Bootstrap Aggregating by Dirichlet Resampling

cs.LG stat.MLstat.ME ·2026-09-18 ·Quoc Viet Le, Joonha Park
similarity 0.53
Abstract · 29 pages (10 main text, 19 pages appendix), 21 tables, 3 algorithms. No figures

We revisit Breiman's observation that reducing inter-tree correlation without weakening individual trees can improve random forests. Building on this principle, we introduce two variants: Dirichlet-Multinomial Bagging Random Forest (DM) and Dirichlet-Weighted Random Forest (DW). Both modulate sample reweighting via a concentration parameter $α>0$. We provide a simple theoretical criterion that clarifies when these variants behave indistinguishably from standard random forests, and we use it to guide a lightweight tuning strategy. In a controlled evaluation on public classification benchmarks, DM and DW are consistently competitive and often stronger than other random-forest (RF) baselines, with negligible additional runtime.

0.33

Coefficient Calibration as Selection Pressure in Symbolic Regression

cs.LG ·2026-10-07 ·Mattia Billa, Veronica Guidetti, Federica Mandreoli
similarity 0.53
Abstract · 18 pages, 8 figures, 7 tables

In memetic symbolic regression, candidate structures are compared after coefficient calibration, so the calibration protocol itself contributes to evolutionary selection. Standard centralized calibration evaluates each structure at its pooled-sample optimum, ignoring how stable this calibration is under covariate shifts, and can thus favor structures whose fit relies on sample-specific coefficients. We propose Dirichlet-Sinkhorn Constant Averaging (DSCA), a calibration strategy that partitions the optimization data into equally sized subsets with different covariate distributions, calibrates each candidate independently on every partition, and evaluates it at the mean of the resulting parameters. We show that the excess loss of DSCA relative to centralized calibration vanishes at the population level for correctly specified, identifiable expressions, whereas under misspecification it persists when partition-specific calibrations do not aggregate to the pooled optimum. On synthetic benchmarks and ten real-world datasets, DSCA improves functional recovery and the accuracy-complexity trade-off over centralized Broyden-Fletcher-Goldfarb-Shanno and Levenberg-Marquardt calibration, under selection by negative log-likelihood and by the Akaike and Bayesian information criteria. Mechanism analyses associate the DSCA excess loss with the generalization gap and show that the effect is not reproduced by repeated centralized fitting. These results indicate that controlled heterogeneous calibration provides a complementary source of selection pressure in symbolic-regression search.

0.28

When Single-Dataset Conclusions Fail: A 45-Task Study of Threshold Tuning and Resampling for Imbalanced Classification

cs.AI cs.LG ·2026-08-17 ·Diyorbek Musaev
benchmarkcode/data similarity 0.53
Abstract · 13 pages, 3 figures, 5 tables. Code and per-run metrics released

Class-imbalance handling is routinely evaluated on a single benchmark dataset, and the resulting conclusions are reported as if they were properties of the method. We show this practice is unsafe. On the public Kaggle credit-card fraud dataset, under a leakage-free nested cross-validation protocol in which the decision threshold is selected on a held-out inner validation fold, a plain Random Forest at the default 0.5 threshold attains F1 = 0.861 +/- 0.021, and threshold tuning yields it no benefit (delta-F1 = -0.002). Read alone, this supports an appealing conclusion: for a well-calibrated ensemble, imbalance handling is unnecessary. We then apply the identical protocol to 45 binary tasks spanning imbalance ratios from 1:1.5 to 1:178 (2,025 model fits, four model families). The conclusion reverses. Random Forest benefits most from threshold tuning across the suite (delta-F1 = +0.101 +/- 0.134), not least, while three other families replicate their fraud-dataset behaviour almost exactly. SMOTE likewise harms the fraud dataset but helps across the suite (mean delta-F1 = +0.076; 138 wins, 39 losses; Wilcoxon p = 2.7e-17). Two further results. Threshold-tuning benefit is non-monotonic in the imbalance ratio: near zero below 1:5, peaking at +0.120 in the 1:15-1:40 band, declining to +0.045 beyond 1:100 - explaining why the fraud dataset, at 1:577, is an unrepresentative place to study the question. And we reject an intuitive heuristic: validation-set calibration error does not predict tuning benefit (expected calibration error r = -0.087; Brier r = +0.137), so calibration diagnostics cannot tell a practitioner whether tuning is worthwhile. We release the protocol, the 45-task harness, and all per-run metrics.

0.39

Clustering-Based Artificial Tree Ensembles for Random Forest Approximation

cs.LG ·2026-11-13 ·Lea L. Kronziel, Maren S. Wieder, Silke Szymczak, Björn-Hergen Laabs
benchmark similarity 0.52
Abstract · 5 figures

Random Forests (RFs) offer strong prediction performance but are difficult to interpret. Most representative trees (MRTs) and artificial representative trees (ARTs) provide surrogate explanations, but a single tree may miss patterns within a forest. We investigate benefits and limitations of clustering-based representative tree ensembles for RF surrogate modeling and assess the contribution of similarity-based clustering relative to random tree partitions. Using linear and nonlinear simulations and regression benchmarks, we evaluate fidelity, prediction accuracy, complexity, and prediction stability against equally sized ensembles of top-ranked MRTs and randomly selected trees. Increasing ensemble size generally improves fidelity, accuracy, and prediction stability. ART ensembles show higher fidelity in simulations and often greater prediction stability for small ensembles. Compared with random tree partitions, similarity-based clustering generally improves ART fidelity in simulations and often on benchmarks. On benchmark datasets, MRT-based ensembles generally achieve higher fidelity and prediction accuracy, whereas ART ensembles have fewer terminal nodes. ART ensembles provide compact surrogates when reduced complexity matters and their fidelity and prediction accuracy meet application requirements. These findings clarify both the trade-offs of representative tree ensembles as RF surrogates and the contribution of similarity-based clustering beyond random clustering.

0.32

Growing a Stand, Not a Tree: Joint Canopy Generation Reproduces Crown Shyness

cs.CV ·2026-08-27 ·Guang Yang, Fengchen Liu
unusual similarity 0.52
Abstract · 8 pages plus references, 8 figures

In closed forests, neighboring tree crowns often stop short of touching, leaving a network of narrow gaps known as crown shyness. The pattern belongs to the stand rather than to any single tree, which makes it a natural probe of a question in generative modeling: can a learned model produce a set of objects whose defining structure exists only between them? We formulate stand-level canopy generation as set generation with a flow-matching model, in which attention between trees is the only channel through which coupling can arise. Trained on stands grown by a resource-competition simulation that is provably not reducible to per-tree geometry, the joint model halves the clearance distribution error of an identical-capacity model that generates each tree alone, and the advantage persists at stem densities outside the training range. Against field measurements of a tropical oak forest, a single calibrated scalar yields held-out agreement in gap magnitude and crown asymmetry. The directional statistics of the gaps are controlled by stem placement rather than by the growth rule, and match the field once stem jitter is calibrated. Crown shyness, in both the simulation and the learned model, is a property of the stand and not of the tree.

0.29