paper-with-me

홈 › Papers

Propagating the prior from shallow to deep with a pre-trained velocity-model Generative Transformer network

2024-08-19 · Randy Harsuko, Shijun Cheng, Tariq Alkhalifah

Building subsurface velocity models is essential to our goals in utilizing seismic data for Earth discovery and exploration, as well as monitoring. With the dawn of machine learning, these velocity models (or, more precisely, their distribution) can be stored accurately and efficiently in a generative model. These stored velocity model distributions can be utilized to regularize or quantify uncertainties in inverse problems, like full waveform inversion. However, most generators, like normalizing flows or diffusion models, treat the image (velocity model) uniformly, disregarding spatial dependencies and resolution changes with respect to the observation locations. To address this weakness, we introduce VelocityGPT, a novel implementation that utilizes Transformer decoders trained autoregressively to generate a velocity model from shallow subsurface to deep. Owing to the fact that seismic data are often recorded on the Earth's surface, a top-down generator can utilize the inverted information in the shallow as guidance (prior) to generating the deep. To facilitate the implementation, we use an additional network to compress the velocity model. We also inject prior information, like well or structure (represented by a migration image) to generate the velocity model. Using synthetic data, we demonstrate the effectiveness of VelocityGPT as a promising approach in generative model applications for seismic velocity model building.

📄 PDF Abstract BibTeX arXiv:2408.09767

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Diffusion priors enhanced velocity model building from time-lag images using a neural operator

2025-12-29 · Xiao Ma, Mohammad Hasyim Taufik, Tariq Alkhalifah arxiv

Velocity model building serves as a crucial component for achieving high precision subsurface imaging. However, conventional velocity model building methods are often computationally expensive and time consuming. In rece…

Learning sparse structures for physics-inspired compressed sensing

2020-11-25 · Clément Dorffer, Thomas Paviet-Salomon, Gilles Le Chenadec, Angélique Drémeau

In underwater acoustics, shallow water environments act as modal dispersive waveguides when considering low-frequency sources. In this context, propagating signals can be described as a sum of few modal components, each …

compressed sensing

Mirror Flow Matching with Heavy-Tailed Priors for Generative Modeling on Convex Domains

2025-10-10 · Yunrui Guan, Krishnakumar Balasubramanian, Shiqian Ma arxiv

We study generative modeling on convex domains using flow matching and mirror maps, and identify two fundamental challenges. First, standard log-barrier mirror maps induce heavy-tailed dual distributions, leading to ill-…

Analysis of learning a flow-based generative model from limited sample complexity

2023-10-05 · Hugo Cui, Florent Krzakala, Eric Vanden-Eijnden, Lenka Zdeborová

We study the problem of training a flow-based generative model, parametrized by a two-layer autoencoder, to sample from a high-dimensional Gaussian mixture. We provide a sharp end-to-end analysis of the problem. First, w…

DenoisingForm

Flow Matching with Uncertainty Quantification and Guidance

2026-02-10 · Juyeop Han, Lukas Lao Beyer, Sertac Karaman arxiv

Despite the remarkable success of sampling-based generative models such as flow matching, they can still produce samples of inconsistent or degraded quality. To assess sample reliability and generate higher-quality outpu…

Image Generation