paper-with-me

홈 › Papers

Development of Deep Transformer-Based Models for Long-Term Prediction of Transient Production of Oil Wells

2021-10-12 · Ildar Abdrakhmanov, Evgenii Kanin, Sergei Boronin, Evgeny Burnaev, Andrei Osiptsov

We propose a novel approach to data-driven modeling of a transient production of oil wells. We apply the transformer-based neural networks trained on the multivariate time series composed of various parameters of oil wells measured during their exploitation. By tuning the machine learning models for a single well (ignoring the effect of neighboring wells) on the open-source field datasets, we demonstrate that transformer outperforms recurrent neural networks with LSTM/GRU cells in the forecasting of the bottomhole pressure dynamics. We apply the transfer learning procedure to the transformer-based surrogate model, which includes the initial training on the dataset from a certain well and additional tuning of the model's weights on the dataset from a target well. Transfer learning approach helps to improve the prediction capability of the model. Next, we generalize the single-well model based on the transformer architecture for multiple wells to simulate complex transient oilfield-level patterns. In other words, we create the global model which deals with the dataset, comprised of the production history from multiple wells, and allows for capturing the well interference resulting in more accurate prediction of the bottomhole pressure or flow rate evolutions for each well under consideration. The developed instruments for a single-well and oilfield-scale modelling can be used to optimize the production process by selecting the operating regime and submersible equipment to increase the hydrocarbon recovery. In addition, the models can be helpful to perform well-testing avoiding costly shut-in operations.

📄 PDF Abstract BibTeX arXiv:2110.06059

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series AnalysisTransfer Learning

Similar Papers 제목 키워드 기반

FLDmamba: Integrating Fourier and Laplace Transform Decomposition with Mamba for Enhanced Time Series Prediction

2025-07-17 · Qianru Zhang, Chenglei Yu, Haixin Wang, Yudong Yan 외 arxiv

Time series prediction, a crucial task across various domains, faces significant challenges due to the inherent complexities of time series data, including non-stationarity, multi-scale periodicity, and transient dynamic…

Time Series Prediction

Dynamics of Transient Structure in In-Context Linear Regression Transformers

2025-01-29 · Liam Carroll, Jesse Hoogland, Matthew Farrugia-Roberts, Daniel Murfet

Modern deep neural networks display striking examples of rich internal computational structure. Uncovering principles governing the development of such structure is a priority for the science of deep learning. In this pa…

DiversityModel Selectionregression

Dynamics-Informed Deep Learning for Predicting Extreme Events

2026-03-11 · Eirini Katsidoniotaki, Themistoklis P. Sapsis arxiv

Predicting extreme events in high-dimensional chaotic dynamical systems remains a fundamental challenge, as such events are rare, intermittent, and arise from transient dynamical mechanisms that are difficult to infer fr…

TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformers

2023-07-05 · Alan John Varghese, Aniruddha Bora, Mengjia Xu, George Em Karniadakis

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph genera…

Anomaly DetectionComputational EfficiencyDynamic graph embeddingGraph Embedding+5

xMTrans: Temporal Attentive Cross-Modality Fusion Transformer for Long-Term Traffic Prediction

2024-05-08 · Huy Quang Ung, Hao Niu, Minh-Son Dao, Shinya Wada 외

Traffic predictions play a crucial role in intelligent transportation systems. The rapid development of IoT devices allows us to collect different kinds of data with high correlations to traffic predictions, fostering th…

Traffic Prediction