CS Paper Radar

Depth-progressive 3D seismic velocity model building via 2D generative diffusion models

Shijun Cheng, Randy Harsuko, Mohammad H. Taufik, Tariq Alkhalifah

cs.AI physics.geo-ph ·submitted 2026-10-10 11:09 UTC · v1
benchmark

Abstract

Three-dimensional (3D) velocity model building (VMB) remains computationally challenging with conventional approaches and native 3D neural networks, largely due to the prohibitive memory and training cost of full 3D formulations. Therefore, we introduce a depth-progressive framework that achieves 3D VMB using 2D generative diffusion models through a depth-as-channel formulation, in which the depth dimension of each 3D velocity patch is mapped to the channel dimension of a 2D U-Net. This allows the model to synthesize overlapping depth patches sequentially from shallow to deep while conditioning the prediction of the deeper patch on the shallower one, as well as on any available geophysical constraints, including well logs and structural attributes. During training, paired shallow-deep patch pairs with randomized overlaps are used to teach the network how deeper velocity structures relate to shallower information, and a classifier-free guidance strategy enables the model to handle missing constraints gracefully. At inference, starting from a shallow velocity prior, the model recursively generates deeper patches in a top-down manner, and a depth-attenuated Gaussian blending scheme merges overlapping predictions into spatially coherent 3D volumes while accounting for the progressive accumulation of uncertainty at greater depths. Numerical experiments on both in-distribution benchmark models, including Overthrust, SEAM Arid, and SEG/EAGE, and the out-of-distribution Marmousi model demonstrate that the method effectively propagates shallow velocity priors downward and produces high-quality 3D velocity volumes across a range of geological settings and conditioning scenarios. Compared to a 3D benchmark of equivalent architecture, the proposed method significantly reduces parameter count, training cost, and inference cost, while maintaining superior VMB accuracy.

Closest papers

Nearest neighbours by meaning across the whole index.

DeepStratNet: A Context-Aware Coordinate Regression Framework for Seismic Horizon Tracking under Sparse Labels

cs.CV ·2026-10-01 ·Aniq Ahmad, Musham Ahmad Malik, Ahmad Mustafa, Heather Bedle
similarity 0.72
Abstract

Automatic horizon tracking is a foundational task in 3D seismic interpretation. Most existing deep learning approaches formulate it as dense semantic segmentation, typically using U-Net-based architectures. The model produces a probability map over all pixels that must be post-processed to extract precise horizon coordinates, while horizon picks in time/depth must be converted into dense masks for training. Unpicked seismic traces are consequently treated as background, which can hinder convergence, and both pre- and post-processing can introduce errors into the final interpretation. Moreover, 2D segmentation models do not inherently capture inter-slice context, while 3D models are often computationally prohibitive. We instead formulate horizon tracking as a bounded coordinate regression problem, where the model directly predicts the time/depth coordinate of the target horizon at each lateral position. We propose a lightweight regression head compatible with any pretrained vision backbone, coupled with an LSTM module to model inter-slice context and produce a continuous horizon surface across the volume. A combination of L1 and L2 losses supervises predictions at valid horizon picks, while a geology-informed regularization enforces lateral continuity between successive traces. Under controlled experimental conditions, we evaluate four pretrained vision backbones under both segmentation and regression configurations on a seismic volume from New Zealand. The proposed approach consistently outperforms its segmentation counterparts quantitatively, using metrics including RMSE and PCC, and qualitatively, while also demonstrating greater robustness to increasing sparsity of training picks. Finally, we show that prediction variation across successive traces captures local variations in geological complexity, providing an automated quality control measure for downstream seismic interpretation.

0.24

Physical Cross-Modal Masked Autoencoding for Seismic-to-Well Representation Learning

cs.LG physics.geo-ph ·2026-09-28 ·Meher Gajula, Keyla Gonzalez, Ben Lasscock, Alejandro Valenciano
similarity 0.68
Abstract · 11 pages, 3 figures

Learning from scientific measurements often requires aligning modalities with different spatial support and resolution. Subsurface characterization is an extreme dense-sparse problem in which 3D seismic provides volumetric but indirect measurements and well logs provide high-resolution 1D measurements at sparse borehole locations. We introduce a physically grounded cross-modal masked autoencoder (CM-MAE) for seismic-to-well representation learning. The model jointly tokenizes seismic volumes and well-log depth patches, embeds both modalities in continuous physical coordinates using four-axis rotary position embeddings, and reconstructs masked targets with a cross-modal decoder. Sparse Mixture-of-Experts layers provide modality-specific capacity while dense attention allows information exchange between modalities. Pretraining uses 23 seismic volumes covering approximately 178,000 square km across U.S. offshore and onshore basins, together with approximately 92,000 wells. Matched-mask ablations show strongly asymmetric information flow. Seismic context improves held-out well-log reconstruction by 9.73%, while well-log context improves seismic reconstruction by 0.65%. We evaluate seismic-only pseudo-log predictions against independent interpreter-drawn salt-geobody masks to determine whether they contain geologic signal. Across offshore U.S. surveys, compressional-slowness-derived salt scores reach an AUROC of 0.910. In onshore basins, predicted compressional slowness preserves formation-scale structure and partial relative organization in an unseen survey despite calibration drift. CM-MAE learns useful seismic-to-well representations under extreme modality asymmetry, although absolute pseudo-log calibration remains survey-dependent.

0.21

Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent

cs.LG stat.MLphysics.geo-ph ·2026-10-13 ·Chao Li, Mrinal K. Sen, Sergey Fomel, Yangkang Chen
similarity 0.67
Abstract

Full waveform inversion (FWI) is a powerful tool for high-resolution subsurface model reconstruction, but it remains highly nonlinear and ill-posed, especially when the initial model is inaccurate or the acquired data are noisy and incomplete. Annealed Stein variational gradient descent (ASVGD) provides a particle-based Bayesian framework for FWI by approximating the posterior distribution with an ensemble of velocity models, thereby enabling uncertainty quantification beyond a single deterministic solution. However, conventional ASVGD-FWI commonly relies on simple handcrafted priors, such as Gaussian or smoothing assumptions, which are often insufficient to represent complex geological structures. To address this limitation, we introduce a learned diffusion model (DM) as an implicit regularization mechanism within the ASVGD-FWI framework. Instead of explicitly evaluating the diffusion prior density, the trained diffusion model acts as a learned geological projection operator that guides updated particles toward the distribution of plausible velocity models. In this way, the proposed method combines data consistency from FWI, posterior diversity from ASVGD, and structural realism from the diffusion prior. Numerical experiments demonstrate that the diffusion-regularized ASVGD-FWI produces more geologically consistent mean models, suppresses nonphysical artifacts, and yields uncertainty estimates that are more concentrated around structurally complex and poorly constrained regions. These results suggest that learned diffusion priors can effectively enhance Bayesian FWI by improving both inversion stability and the interpretability of posterior uncertainty.

0.03

Self-attention summary networks for subsurface velocity-model building from common-image gathers

cs.LG physics.geo-ph ·2026-10-07 ·Shiqin Zeng, Yunlin Zeng, Abhinav Prakash Gahlot, Zijun Deng, Felix J. Herrmann
similarity 0.65
Abstract

Common-image gathers (CIGs) contain physically meaningful information about velocity-model errors through reflector focusing and residual moveout, but in conventional imaging workflows they are typically used only as diagnostic tools. In this work, we propose a multiscale self-attention summary network that maps high-dimensional 3D CIG volumes into compact conditioning embeddings for probabilistic subsurface velocity inversion. These learned embeddings preserve offset-dependent kinematic structure and spatial coherence while reducing variability caused by background-velocity mismatch. Conditioned on these summary embeddings, a flow-matching model learns a transport from a Gaussian source distribution to the posterior distribution of plausible velocity fields. Numerical experiments show that, compared with direct conditioning on raw CIGs, the proposed summary network improves posterior velocity inference. In particular, the multiscale attention design provides greater robustness to background-model mismatch, yielding more accurate posterior reconstructions and lower predictive uncertainty.

0.31

Spatial-Spectral Interactive POCS Network for Large-Gap Seismic Data Interpolation

cs.CV ·2026-10-31 ·Baisong Jiang, Chunxia Zhang, Anxiang Di, Xiaoli Wei, Xiangyu Zhao +2 more
similarity 0.64
Abstract

Large gaps in seismic acquisition disrupt reflection events and hinder spectral recovery. Existing seismic interpolation deep unfolding networks primarily rely on localized spatial priors, limiting their ability to aggregate the global context necessary for reconstructing these extensive missing regions. We propose a spatial-spectral interactive projection-onto-convex-sets network (SSI-POCS) to tackle this severely ill-posed problem. By unfolding the classical iterative solver, our network integrates physical consistency with dual-domain deep priors via learned transforms, soft thresholding, and exact data reinsertion. Within the learned prior, a spatial Restormer branch captures local waveform structures, while a fast Fourier convolution (FFC) branch extracts global context, effectively suppressing incoherent components and enhancing spectral energy concentration in the $f-k$ domain. A dual-domain fusion module exchanges these complementary features via bidirectional channel attention and gated modulation, yielding substantial interpolation improvements. To overcome the severe loss of lateral continuity caused by large gaps, we introduce structural similarity (SSIM) supervision, complemented by focal frequency loss (FFL) and transform consistency constraints to suppress incoherent high-frequency components and regularize training. Experiments on a synthetic salt dome and a North Sea field dataset under 50% random and consecutive trace removal demonstrate the effectiveness of SSI-POCS. It significantly enhances event continuity across large gaps and mitigates artifacts, achieving a 3.285~dB SNR improvement over the best competing method while reducing parameters by 75.66%.

0.43

Physical-State-Guided Diffusion Sampling for Full-Waveform Inversion

cs.LG ·2026-09-11 ·Chen Min, Haowen Jiang, Zheng Ma, Xiong-Bin Yan
similarity 0.64
Abstract · 47 pages, 13 figures

Full waveform inversion (FWI) reconstructs subsurface velocity models from seismic mea surements but faces the challenges of ill-posedness and nonlinearity, making accurate inversion dependent on suitable initialization and effective prior constraints. Classical methods stabi lize the inversion and improve convergence by designing hand-crafted regularization terms, yet these terms provide limited descriptions of complex geological structures. Recent diffusion based methods learn more detailed structural priors from data and integrate them into inverse problem solvers. We propose Physical-State-Guided Diffusion Sampling (PSG), which decouples diffusion posterior sampling into two mutually interacting processes: regularized FWI optimiza tion and conditional diffusion sampling with linear guidance. PSG shows overall improvements in reconstruction accuracy, preservation of prior structure, and robustness over classical and diffusion-based baselines across diverse OpenFWI inversion scenarios. Through domain decom position, PSG can generalize without retraining to more complex, realistic velocity fields with structural patterns distinct from those represented by the prior learned from training datasets and larger spatial domains than the training models. Overall, PSG offers a flexible framework for integrating learned priors with physical constraints, with potential for extension to other nonlinear inverse problems.

0.16

Generative Learning on Manifolds for Probabilistic Seismic Performance Assessment and Structural Identifiability

cs.LG physics.geo-phphysics.data-anstat.ML ·2026-10-21 ·Dimitris G Giovanis, Ioannis G Kevrekidis, Roger G Ghanem
similarity 0.64
Abstract

Seismic performance assessment relies on computationally expensive nonlinear simulations, limiting uncertainty quantification and inference of structural properties from observed responses. We develop a manifold-based generative framework that learns the joint distribution of uncertain structural parameters and seismic-response trajectories from limited high-fidelity simulations. Combining Diffusion Maps, score-based Diffusion Modeling, and Geometric Harmonics, the framework enables both forward probabilistic prediction and inverse inference. Applied to a nine-story steel moment-resisting frame, the results reveal which structural properties are identifiable from seismic performance and how uncertainty in these properties influences response. In particular, the learned representation captures post-capping degradation characteristics more effectively than individual strength parameters. Inverse inference identifies distinct structural configurations that produce similar seismic performance, with representative solutions independently validated using nonlinear simulations. These findings demonstrate how generative learning can support uncertainty-aware seismic assessment while revealing structural non-identifiability and alternative mechanisms underlying observed performance

0.19

FluidGen: Physics-Aware Fluid Video Generation via Motion-Guided Post-Training

cs.CV cs.GR ·2026-10-19 ·Yang Zheng, Zizhang Li, Boyang Deng, Jan Ackermann, Lei Shu +4 more
code/data similarity 0.63
Abstract · Project page: https://y-zheng18.github.io/FluidGen/

Video generation models produce visually compelling motion but systematically fail on fluid phenomena, including smoke, fire, and explosion debris, where outputs lack coherent vortical structure and collapse to bland dynamics that violate the physics of real fluids. Classical solvers achieve high physical fidelity but require detailed 3D scenes and carefully tuned parameters, making them impractical for in-the-wild imagery and video generation. We address this gap by injecting a data-driven fluid prior into a pre-trained video model, trained on a mixture of high-fidelity Houdini simulation data with paired velocity-field ground truth and curated in-the-wild fluid video data for appearance diversity. The core of our approach is a dual stream architecture that predicts per-frame velocity fields alongside RGB, supervised by simulation ground truth. This auxiliary signal regularizes generation toward physically consistent motion and exposes an interpretable physical quantity that we further leverage as a reward for velocity-aware direct preference optimization. Our model produces substantially more realistic fluid dynamics sequences than strong video baselines and optimization-based methods. Project page: https://y-zheng18.github.io/FluidGen/

0.24