CS Paper Radar

Continually learning neural-operator surrogate for three-dimensional airborne electromagnetic Bayesian inversion

Jaehong Chung, Andrew Lockwood, Jef Caers

cs.LG physics.geo-ph ·submitted 2026-08-26 15:43 UTC · v1
survey

Abstract

Three-dimensional probabilistic inversion of time-domain airborne electromagnetic (AEM) data is limited by the cost of the forward solve. Even though one simulation takes only tens of seconds, a Bayesian inversion of a survey of millions of soundings requires of order $10^{10}$ forward evaluations. To address this, we develop a continually learning neural-operator surrogate of the three-dimensional AEM forward operator that replaces the solver inside the Bayesian inversion. We start from the point of view that regardless of what geological prior is specified, Maxwell's laws remain invariant. Secondly, we avoid the limitation of learning on a single prior by continual learning on consecutive priors, which means our surrogate becomes richer as it is applied in future case studies, either by the authors, or by the scientific community. We use a validity check built on ensemble disagreement to divert cases with measurements outside the training range to the solver. Driven by the surrogate, the identical Markov chain Monte Carlo sampler reproduces the full-solver posterior, and its credible intervals cover the truth within 2.6 percentage points. Applied to the 2013 Capricorn TEMPEST survey in Western Australia, the surrogate inverts over two million soundings in seconds, a computation infeasible for the solver. Testing the geological prior against the entire survey costs minutes. The framework delivers uncertainty-quantified conductivity imaging at survey scale, which we believe is essential to perform near real-time mineral-systems targeting with geophysics.

Closest papers

Nearest neighbours by meaning across the whole index.

Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent

cs.LG stat.MLphysics.geo-ph ·2026-10-13 ·Chao Li, Mrinal K. Sen, Sergey Fomel, Yangkang Chen
similarity 0.60
Abstract

Full waveform inversion (FWI) is a powerful tool for high-resolution subsurface model reconstruction, but it remains highly nonlinear and ill-posed, especially when the initial model is inaccurate or the acquired data are noisy and incomplete. Annealed Stein variational gradient descent (ASVGD) provides a particle-based Bayesian framework for FWI by approximating the posterior distribution with an ensemble of velocity models, thereby enabling uncertainty quantification beyond a single deterministic solution. However, conventional ASVGD-FWI commonly relies on simple handcrafted priors, such as Gaussian or smoothing assumptions, which are often insufficient to represent complex geological structures. To address this limitation, we introduce a learned diffusion model (DM) as an implicit regularization mechanism within the ASVGD-FWI framework. Instead of explicitly evaluating the diffusion prior density, the trained diffusion model acts as a learned geological projection operator that guides updated particles toward the distribution of plausible velocity models. In this way, the proposed method combines data consistency from FWI, posterior diversity from ASVGD, and structural realism from the diffusion prior. Numerical experiments demonstrate that the diffusion-regularized ASVGD-FWI produces more geologically consistent mean models, suppresses nonphysical artifacts, and yields uncertainty estimates that are more concentrated around structurally complex and poorly constrained regions. These results suggest that learned diffusion priors can effectively enhance Bayesian FWI by improving both inversion stability and the interpretability of posterior uncertainty.

0.03

Accelerating posterior sampling in Bayesian inverse problems with diffusion models: an online-offline perspective

cs.LG math.NAmath.STstat.ML ·2026-10-31 ·Duc-Lam Duong
similarity 0.57
Abstract

Bayesian inverse problems require both informative prior models and computationally feasible posterior inference. Score-based diffusion models provide expressive learned priors, but their use for inversion introduces a conditioning problem: the score of a noised posterior is generally unavailable from a prior score alone. This selective survey reviews the principal approaches to that problem, including likelihood guidance, spectral and projection methods, sequential Monte Carlo corrections, and amortized conditional training. We organize methods by how they split cost between offline preparation and online inference, and compare their assumptions, advantages and limitations, with emphasis on computational speedups. Some ongoing directions and open questions are gathered at the end.

0.05

Autoregressive Physics-Informed Neural Operator Surrogates and Joint 4-D Seismic-Production Bayesian History Matching

cs.LG stat.ML ·2026-09-29 ·Clement Etienam, David Blom, Hari Pattathil, Tsubasa Onishi, Harpreet Sethi +5 more
theory similarity 0.57
Abstract · 40 pages, 15 figures, 6 tables, 4 algorithms

We present a surrogate-accelerated Bayesian history-matching framework, demonstrated on a realistic synthetic model ($N=100{,}188$ cells). The forward map $\mathcal{G}$ is replaced by a Fourier neural operator $\mathcal{G}_θ$ trained in a closed loop, $\hat{x}_{n+1}=\mathcal{G}_θ(u,\hat{x}_n)$, with the discrete black-oil residual $R(x_{n+1},x_n)$ as a physics-informed neural operator (PINO) penalty, truncated backpropagation and noise injection. We assimilate production data and 4-D seismic using adaptive regularised ensemble Kalman inversion (aREKI), and synthesise $ΔV_p$ inside the rollout via a closed-form Gassmann transform of the surrogate, under a two-stage schedule (aREKI on production, then an ensemble smoother with multiple data assimilation, ES-MDA, on both). To temper the ill-posedness, we invert $(\log K,φ)$ not in $\mathbb{R}^{2N}$, where $N_e\ll 2N$ leaves a rank-deficient covariance and a null space the data never inform, but on a chart $u=Ψ(\tilde m)$, $\tilde m\in\mathbb{R}^{d}$, $d\ll 2N$, given by a Parseval-exact truncated cosine transform or a variational auto-encoder decoder. The ensemble then spans its own search space; the directions the data cannot constrain are cut to those the chart can express, and every member decodes to a geologically plausible field. For the rollout we prove an exposure bound $W_1\le\sum_j L^{\,n-1-j}\mathbb{E}e_j$, a physics-penalty contraction $\|D_x\mathcal{G}_θ\|\leα<1$ under a small residual defect, and an $\mathcal{O}(ρ^K)$ truncation bias. A Loewner-order inequality $\mathcal{I}_p\preceq\mathcal{I}_p+\mathcal{I}_s$ explains why joint assimilation is no less informative. On held-out data, $\mathcal{G}_θ$ attains $R^2>0.999$ on pressure and saturation and rolls out in $0.579$ s, a $\sim2500\times$ speed-up, bringing an $N_e=190$-member, $N_a=10$-iteration joint inversion within one GPU-hour.

0.30

Physics-Informed Multi-Task Surrogate Model for the Martian Nightside Thermosphere

cs.LG astro-ph.EP ·2026-09-09 ·Sergey Nikiforov
similarity 0.56
Abstract · 5 pages, 1 figure, 2 tables. 3rd Conference on AI in and for Space (SPAICE 2026)

Modeling the Martian nightside thermosphere remains challenging due to sparse in situ sampling and strong coupling among transport, magnetic, and seasonal processes. Purely data-driven models can produce non-physical artifacts, such as density inversions, in poorly sampled altitude regimes. We present a multi-task physics-informed neural network that simultaneously predicts the base-10 logarithmic densities of four neutral species (O, CO$_2$, N$_2$, and Ar) using more than a decade of MAVEN/NGIMS observations (MY 32-38, 2014-2025). A shared backbone learns a common representation of the nightside thermospheric state and branches into species-specific output heads. A weak monotonicity prior is incorporated via automatic differentiation by penalizing positive vertical gradients in logarithmic density. Experiments using an orbit-disjoint train/validation/test split show that physics-informed regularization substantially reduces non-physical inversions while preserving predictive skill and slightly improving it in the best-performing configuration, as measured by RMSE, MAE, and $R^2$. The resulting model provides a computationally efficient surrogate for nightside thermospheric reconstruction with improved vertical consistency.

0.31

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

cs.LG cs.CE ·2026-09-17 ·Jiachen Yao, Zi-Siang Hsu, Xi Deng, Aditi Gupta, Xin Ju +3 more
benchmarkcode/datahighly cited similarity 0.56
Abstract · 32 pages, 10 figures, 21 tables; the code is available at https://github.com/neuraloperator/PosteriorBench

Generative models are increasingly used to solve scientific inverse problems, but existing evaluations still focus primarily on whether a method can produce a single plausible reconstruction. This is insufficient for ill-posed problems, where multiple solutions may be consistent with the same sparse or noisy observations. In these settings, a method can achieve strong pointwise accuracy while still failing to capture the true posterior through mode collapse, overconfident uncertainty, or averaging incompatible solutions. We introduce PosteriorBench, a benchmark for evaluating the distributional accuracy of generative inverse solvers. PosteriorBench evaluates four physics-based inverse problems: Darcy flow inversion, Poisson source recovery, carbon capture and storage, and light transport material inference. For each task, we construct high-fidelity reference posteriors using computationally heavy but established procedures such as rejection sampling and Markov chain Monte Carlo, enabling direct assessment of whether solvers recover the full set of solutions rather than the single best sample. We pair these references with a five-metric posterior evaluation suite: posterior-mean error, posterior-standard-deviation error, maximum mean discrepancy, sliced Wasserstein distance, and radially averaged power-spectrum error. These metrics assess pointwise accuracy, marginal uncertainty, distributional alignment, and global frequency fidelity. The benchmark spans sparse sensing, low-resolution observations, nonlinear forward models, varying noise levels, and multimodal priors, with a unified pipeline for distribution matching and uncertainty quantification. Our experiments reveal substantial distribution-matching gaps across current solvers, while showing that neural operators improve resolution robustness, and guidance weights and generation noise are key to posterior-variance calibration.

0.48

Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problems

cs.AI physics.optics ·2026-08-18 ·Charles Dove, Laura Waller
similarity 0.56
Abstract

Neural network surrogates are an emerging alternative to traditional electromagnetic wave simulators like finite-difference time-domain (FDTD); their goal is to replace rigorous physical simulations with pre-trained neural networks that solve wave-scattering forward and inverse problems orders of magnitude faster. However, nonrecurrent, single-step surrogates have scaled only to a few tens of simulation variables. Here, we show that this barrier can be overcome by dynamically generating salient training examples during training, rather than randomly sampling the large space of possible examples. We introduce an algorithm that runs in parallel with surrogate training, using gradient ascent to search refractive-index and source configurations for cases where the surrogate disagrees with a full-wave ground-truth simulator. We also use source and ground-truth normalization with an evolving replay dataset to stabilize and accelerate learning. Using this approach, we train a fast, single-step surrogate for two-dimensional wave scattering with up to 41,772 controllable variables, including dense, freely configurable grids of refractive indices and complex-valued sources. The resulting neural surrogate is robustly accurate across diverse structured and unstructured examples and generalizes inductively to larger domains, reaching over 3 million controllable variables without retraining, a $73.8\times$ increase. We demonstrate the surrogate on large-scale forward simulations and inverse design of freeform beam splitters and gradient-index (GRIN) lenses up to 98 wavelengths wide, showing comparable or better performance than FDTD-based designs, with speedups from $1.29\times$ to $26.5\times$. These results demonstrate a practical path toward fast, robustly accurate, inductively scalable neural simulators for photonic inverse design and other wave-scattering inverse problems.

0.24

Flow Matching for Fast Posterior Sampling in Bayesian Inverse Problems

cs.LG math.NAstat.CO ·2026-10-01 ·Jan Blechschmidt, Oliver G. Ernst, Moritz Poguntke, Björn Sprungk
similarity 0.56
Abstract · 38 pages, 18 figures

Sampling from the posterior is the central task of computational Bayesian inverse problems. The standard workhorse in Bayesian inference---Markov chain Monte Carlo (MCMC)---is sequential, yields correlated samples, and must be rerun for each new observation. Conditional flow matching offers an amortized alternative: a transport map, trained once on joint samples of parameter and data, that yields independent approximate posterior samples for any observation at negligible online cost, without new likelihood evaluations. We give a careful, MCMC-literate assessment of flow matching for PDE-based inverse problems with function-valued parameters. Exploiting the flow's tractable density, we derive computable accuracy estimates for the learned posterior in total variation distance and Kullback--Leibler divergence and, moreover, propose a hybrid sampler that is made asymptotically exact by Metropolization. We validate the accuracy estimates and demonstrate amortization in several numerical examples, including electrical impedance tomography and a likelihood-free Lotka--Volterra model. Flow matching reproduces posterior means and credible bands closely at a fraction of the forward solves required by MCMC, but its accuracy degrades for concentrated posteriors and for observations that are atypical under the prior.

0.26

Source Distribution Estimation by Posterior Averaging

cs.LG ·2026-09-02 ·Trung-Dung Hoang, Lisa M. Koch
benchmark similarity 0.56
Abstract

Simulation-based science often requires a distribution over simulator parameters whose push-forward reproduces a set of real observations: this is the source distribution estimation (SDE) problem. Existing methods fit the source against a likelihood surrogate trained once from a fixed proposal prior. Their objective is therefore stated only in terms of the surrogate instead of the true simulator, which may fail for inaccurate areas in parameter space where the surrogate was never trained. We instead solve SDE by expectation maximization: an E-step trains an amortized posterior on fresh simulations from the current source estimate, and an M-step refits the source to the average of that posterior over the observed data. We give two parameterizations, (1) separate source and posterior flows and (2) a single shared conditional flow. We evaluate our method on three benchmark tasks under both broad and misspecified initial priors. Both improve on existing fixed surrogate approaches and on iterated variants of each, most clearly on Lotka--Volterra, where no baseline falls below 0.96 data-space C2ST while our methods reach 0.64-0.68 in three of four initial-prior settings.

0.10