paper-with-me

홈 › Papers

A Transformer variant for multi-step forecasting of water level and hydrometeorological sensitivity analysis based on explainable artificial intelligence technology

2024-05-22 · MingYu Liu, Nana Bao, Xingting Yan, Chenyang Li, Kai Peng

Understanding the combined influences of meteorological and hydrological factors on water level and flood events is essential, particularly in today's changing climate environments. Transformer, as one kind of the cutting-edge deep learning methods, offers an effective approach to model intricate nonlinear processes, enables the extraction of key features and water level predictions. EXplainable Artificial Intelligence (XAI) methods play important roles in enhancing the understandings of how different factors impact water level. In this study, we propose a Transformer variant by integrating sparse attention mechanism and introducing nonlinear output layer for the decoder module. The variant model is utilized for multi-step forecasting of water level, by considering meteorological and hydrological factors simultaneously. It is shown that the variant model outperforms traditional Transformer across different lead times with respect to various evaluation metrics. The sensitivity analyses based on XAI technology demonstrate the significant influence of meteorological factors on water level evolution, in which temperature is shown to be the most dominant meteorological factor. Therefore, incorporating both meteorological and hydrological factors is necessary for reliable hydrological prediction and flood prevention. In the meantime, XAI technology provides insights into certain predictions, which is beneficial for understanding the prediction results and evaluating the reasonability.

📄 PDF Abstract BibTeX arXiv:2405.13646

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Sensitivity

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Probabilistic Multi-Step-Ahead Short-Term Water Demand Forecasting with Lasso

2020-05-09 · Jens Kley-Holsteg, Florian Ziel

Water demand is a highly important variable for operational control and decision making. Hence, the development of accurate forecasts is a valuable field of research to further improve the efficiency of water utilities. …

Decision MakingDemand ForecastingTime Series Analysis

Implementing a new fully stepwise decomposition-based sampling technique for the hybrid water level forecasting model in real-world application

2023-09-19 · Ziqian Zhang, Nana Bao, Xingting Yan, Aokai Zhu 외

Various time variant non-stationary signals need to be pre-processed properly in hydrological time series forecasting in real world, for example, predictions of water level. Decomposition method is a good candidate and w…

Time SeriesTime Series Forecasting

Generative AI-driven forecasting of oil production

2024-09-24 · Yash Gandhi, Kexin Zheng, Birendra Jha, Ken-ichi Nomura 외

Forecasting oil production from oilfields with multiple wells is an important problem in petroleum and geothermal energy extraction, as well as energy storage technologies. The accuracy of oil forecasts is a critical det…

Decision MakingTime SeriesTime Series Forecasting

PFformer: A Position-Free Transformer Variant for Extreme-Adaptive Multivariate Time Series Forecasting

2025-02-27 · Yanhong Li, David C. Anastasiu

Multivariate time series (MTS) forecasting is vital in fields like weather, energy, and finance. However, despite deep learning advancements, traditional Transformer-based models often diminish the effect of crucial inte…

Multivariate Time Series ForecastingPositionTime SeriesTime Series Forecasting

CTP: A hybrid CNN-Transformer-PINN model for ocean front forecasting

2025-05-16 · Yishuo Wang, Feng Zhou, Muping Zhou, Qicheng Meng 외

This paper proposes CTP, a novel deep learning framework that integrates convolutional neural network(CNN), Transformer architectures, and physics-informed neural network(PINN) for ocean front prediction. Ocean fronts, a…