CS Paper Radar

Efficient regime boundary detection in discontinuous simulation models

Federico Betti, Eleni Chatzi, Paolo Tiso

cs.CE physics.comp-ph ·submitted 2026-10-26 18:14 UTC · v1

Abstract

Many computational models exhibit multiple operating regimes separated by abrupt or non-smooth transitions as the input parameters vary. Such regime transitions complicate the construction of global parametric reduced-order models, often necessitating large training datasets to capture the distinct system behaviors. Accurate regime boundary detection instead enables localized modeling strategies by partitioning the parameter space into regions of qualitatively distinct behavior. In many cases, regime switching corresponds to the excursion set of a simulator output. When such a quantity is discontinuous or non-smooth, regression-based algorithms for level set estimation can struggle to correctly approximate the boundary. In this work, we show that solving a resulting binary classification problem can improve sample efficiency and we further propose a novel adaptive sampling strategy for support vector machines. Unlike uncertainty-based sampling schemes, the proposed approach uses a continuous search space and efficiently explores the currently estimated boundary in its tangential directions by gradient-based dynamic sampling. Because the decision function admits analytical gradients, this exploration incurs negligible computational overhead relative to the underlying model evaluations. Then, a space-filling subset of the generated samples is selected as the next batch to be queried. We demonstrate improved sample efficiency compared to existing active learning algorithms on analytical and numerical examples. The proposed method provides a sample-efficient framework for regime boundary detection in a broad class of discontinuous simulation-driven problems.

Closest papers

Nearest neighbours by meaning across the whole index.

Closing the Loop: Co-Evolving EM for Irregular Time Series Generation in Lifted Representations

cs.LG ·2026-11-10 ·Idan Arbiv, Gal Fadlon, Omri Azencot
top venuecode/data similarity 0.59
Abstract · Accepted to NeurIPS 2026; The first two authors contributed equally and are co-leading authors

Regular time-series generation from irregular time series is typically reduced to one-shot imputation: complete each partial sequence once, freeze the completions, and train a generator on the resulting surrogate dataset. We show that this open-loop strategy is structurally flawed. Point imputers collapse ambiguous missing regions to conditional averages, while stochastic imputers become stale as the generator evolves; the binding constraint is therefore iteration, not imputer design. We introduce a co-evolving Monte Carlo EM framework that closes the imputer-generator loop. Each E-step samples missing values from the posterior of the current generator, and each M-step retrains the generator on these completions, preserving unconditional generator training. Since our diffusion prior operates in a lifted 2D representation while observations live in time-series space, we further introduce Posterior Sampling for Lifted Representations (PSLR), which enforces operator-consistent conditioning, uncertainty preservation, and manifold consistency during the E-step. Across ten datasets and four corruption regimes, our method achieves state-of-the-art performance, improving over the strongest baselines by 59% in discriminative score, 15% in predictive score, 73% in Context-FID, and 71% in feature-correlation error. Ablations show that our approach reduces average discriminative score by 73% over single-step baselines, closing most of the remaining gap to the clean-data oracle. Code is available at https://github.com/azencot-group/PSLR.

0.46

Quenched Ensemble Sampling

cs.LG stat.MLstat.CO ·2026-09-14 ·David Yallup
similarity 0.59
Abstract · 27 pages, 8 figures

Some of the sharpest challenges in sampling from the energy functions of physical systems arise at phase transitions, where the density of states changes abruptly and many sampling algorithms stall. Nested sampling is a particle method that traverses the density of states under a hard energy constraint and is known to be robust to such transitions, but its application in high dimension is limited by the difficulty of sampling under that constraint. In this work we introduce Quenched Ensemble Sampling, which generalises the hard constraint to a family of repulsive potentials at the energy boundary. This preserves the quenched path of monotonically decreasing energy while making the constrained target amenable to scalable gradient-based kernels. We demonstrate on synthetic models of phase transitions that our method estimates the marginal likelihood and draws posterior samples across a first-order transition where popular alternatives such as tempering fail. We apply the procedure to marginal likelihood estimation in Bayesian neural networks, enabling model comparison between network architectures. Finally, in a high-dimensional continuous lattice field theory, we show that this method traverses a first-order transition and estimates the partition function.

0.35

TEMPO: Regime-Aware Operator Learning with Locally Adapted POD Bases

cs.LG ·2026-11-16 ·Rodion Akinzhala, Alexander Terentyev, Alexey Golubev, Yury Maximov
similarity 0.58
Abstract

Operator learning approximates the solution map of a parametric partial differential equation from data, enabling fast prediction at new parameter values without repeated simulation. The dominant approach fits a single global low-rank basis, typically a proper orthogonal decomposition (POD), to all solution snapshots. This fails when the snapshots span qualitatively different solution shapes, from smooth diffusive profiles to near-discontinuous shocks. We propose TEMPO (Trajectory Expectation-Maximization Mixture of POD Operators), a two-phase framework for regime-aware operator learning. In the offline phase, TEMPO recovers latent regimes via expectation-maximization, fitting a dedicated linear or nonlinear basis to each discovered regime. In the online phase, a gating network and per-regime branch networks are trained jointly, routing new inputs to the regimes at inference. We test TEMPO on Burgers' flow, Sod shock tubes, Coanda flow, Darcy flow, Navier-Stokes flow and the heterogeneous Helmholtz equation. With 64 total POD modes, TEMPO gives 18.61% test error on Burgers', compared with 19.61% for global POD. It also gives lower errors on Coanda and Helmholtz.

0.23

Computationally Efficient Data Generation for Learning Nonlinear MPC Policies

eess.SY ·2026-11-07 ·Pietro Gori, Anton Pozharskiy, Franco Angelini, Manolo Garabini, Moritz Diehl +1 more
similarity 0.58
Abstract

Learning MPC requires large datasets generated by repeatedly solving MPC problems. For Nonlinear MPC (NMPC), dataset generation is computationally expensive because feasible initial states are difficult to sample efficiently. The feasible set is often non-convex or even disconnected, and many randomly sampled states are infeasible, leading to wasted optimization solves and unnecessary computational effort. In this work, we propose a data-generation framework for learning NMPC policies that combines active-set exploration with projection-based sampling. First, a bilevel formulation samples activity weights to promote solutions associated with different active sets while preserving optimality for the original NMPC problem; second, a simpler slack-based formulation uses weighted slack variables to target different active sets at the single level. These reference solutions are then used to construct local linearized feasible sets, from which candidate initial states are sampled and projected through the nonlinear NMPC problem to recover feasible and locally optimal training samples. Our approach is up to $37\times$ faster than baseline uniform sampling with $99\%$ acceptance rate, while maintaining a representative coverage of the feasible set.

0.13

Threshold-Aware Conformal Routing

cs.LG cs.CE ·2026-10-01 ·Shiwei Tan, Huzefa Rangwala, Danielle C. Maddix
similarity 0.58
Abstract

High-fidelity simulations are essential to scientific and engineering design, but can be expensive to run repeatedly. Learned surrogates offer a faster alternative, yet their higher errors may alter downstream decisions. This accuracy-speed tradeoff creates a need to determine whether a surrogate can be used or the full simulator remains necessary. We study decisions determined by whether a scalar quantity of interest lies above or below a fixed threshold. For each input, we use the surrogate when its conformal interval lies entirely on one side of the threshold and route the input to simulation when the interval intersects it. Standard conformal prediction constructs intervals without reference to the downstream decision threshold: even a narrow interval near the threshold can cross it and trigger simulation, whereas a wider interval farther away can remain entirely on one side and require no simulation. We introduce Threshold-Aware Conformal Routing (TACR), which learns an input-dependent scale using a threshold-aware objective that concentrates interval tightness near the decision boundary. Exact split-conformal calibration on held-out data preserves distribution-free marginal coverage, which also upper-bounds the probability of an incorrect threshold decision that is not routed. Across various scientific and engineering datasets, TACR reduces simulator deferrals by 14-75% relative to standard conformal prediction at the same coverage target. Against a variant without threshold-local weighting but with similar predictor accuracy, TACR further reduces deferrals by 10-24% on four datasets. These results show that optimizing interval allocation for routing can reduce simulator calls without weakening the standard conformal guarantee.

0.27

Opening the Black Box of Classifier-Free Guidance via Information Bottleneck

cs.LG ·2026-10-09 ·Jiayang Gao, Tianyi Zheng, Jiayang Zou, Fengxiang Yang, Luyao Fan +3 more
top venue similarity 0.58
Abstract · Accepted to NeurIPS 2026

Classifier-free guidance (CFG) is a standard technique for improving conditional generation in diffusion models, yet its activation schedule is usually selected heuristically. In practice, most existing CFG-based methods rely on a pre-defined activation policy throughout inference, while recent dynamic variants often depend on hand-designed schedules without a principled theoretical explanation of when conditional information is most useful. In order to understand how the informational relevance between conditioning inputs and the score function evolves over the course of generation, we explore when guidance should be activated from an information-theoretic perspective. In this work, we formulate the diffusion trajectory as a time-dependent information bottleneck and show that the effectiveness of conditional information is not uniform throughout sampling, but becomes significantly stronger after a critical stage characterized by a Fisher-information balance condition. Motivated by this insight, we propose a training-free dynamic CFG strategy for inference. Rather than prescribing a fixed schedule in advance, our method constructs a stochastic process from conditional and unconditional score statistics and activates guidance when the estimated guidance gain crosses a prescribed threshold. This yields an adaptive activation rule that aligns condition injection with the underlying generation dynamics, while also recovering interval-based guidance as a limiting special case. Extensive experiments across diverse architectures and tasks, demonstrate that our method is effective, robust, and broadly applicable. Beyond empirical improvements, our framework provides an interpretation of dynamic guidance methods and a principled foundation for inference-time control in conditional diffusion models.

0.43

Nonlocal Transition Kernel for Efficient Learning of Restricted Boltzmann Machines

cs.LG stat.MLcond-mat.dis-nn ·2026-08-18 ·Kaiji Sekimoto, Muneki Yasuda
similarity 0.58
Abstract

Learning restricted Boltzmann machines (RBMs) is computationally challenging because it requires expectations whose exact evaluation is generally intractable. The expectations are typically evaluated using a sampling approximation based on blocked Gibbs sampling (BGS), which is a local Markov chain Monte Carlo transition kernel. However, the locality of BGS can lead to poor sampling quality when the RBM has high energy barriers, thereby degrading learning performance. Deep tempering (DT), which performs parallel tempering over a sequence of learnable RBMs including the training RBM, alleviates this locality issue. However, DT algorithmically requires multiple steps to move through the RBM sequence to achieve a nonlocal transition. In this paper, we propose a transition kernel defined over the RBM sequence used in DT. The proposed kernel has a round-trip structure over the sequence, enabling nonlocal moves within a single transition while leaving the RBM sequence invariant. Numerical experiments show that the proposed kernel performs nonlocal transitions more frequently and achieves higher sampling quality with fewer transitions than BGS and DT. We further verify that learning based on the proposed kernel is more stable and mitigates the training failures observed with BGS- and DT-based learning.

0.32

Generative Learning of Separatrices

cs.LG math.DSstat.ML ·2026-08-13 ·Ellis R. Crabtree, Dimitris G. Giovanis, Anastasia Georgiou, George Datseris, Ioannis G. Kevrekidis
similarity 0.58
Abstract · 15 pages, 8 figures

The identification and reconstruction of the boundaries separating basins of attraction in multistable, multidimensional dynamical systems presents a fundamental challenge in computational dynamics. These structures govern transition pathways and other important large timescale behavior, yet they remain typically under-sampled since their neighborhood does not get routinely visited during direct simulations. Traditional computational approaches face computational limitations in high-dimensional systems and require a priori knowledge of the dynamical system and its equations. Simplistic sampling methods such as random or uniform sampling of the phase space typically fail to quantitatively approximate separatrices and their structure altogether. We introduce and implement a framework that combines supervised classification with generative modeling to address this challenge. Our approach first trains neural network classifiers on uniformly or randomly sampled initial conditions labeled by their corresponding basins of attraction in the system of interest. Using uncertainty metrics of the trained classifier to quantify decision boundaries, the method then identifies these high uncertainty regions and boundaries of the classifier as preliminary approximate separatrices. Subsequently, score-based generative models are trained specifically on samples from high-uncertainty regions, ultimately generating densities of samples consistent with the empirical density of samples on or close to the manifold that constitutes the separatrix between basins in the sampled region. This approach leverages the complementary strengths of (a) discriminative models for global phase space partitioning and (b) generative models for detailed geometric sampling, resulting in a systematic, iterative, data-driven framework that produces empirically consistent reconstructions of (approximate) separatrix manifolds.

0.10