paper-with-me

홈 › Papers

PTCT: Patches with 3D-Temporal Convolutional Transformer Network for Precipitation Nowcasting

2021-12-02 · Ziao Yang, Xiangrui Yang, QiFeng Lin

Precipitation nowcasting is to predict the future rainfall intensity over a short period of time, which mainly relies on the prediction of radar echo sequences. Though convolutional neural network (CNN) and recurrent neural network (RNN) are widely used to generate radar echo frames, they suffer from inductive bias (i.e., translation invariance and locality) and seriality, respectively. Recently, Transformer-based methods also gain much attention due to the great potential of Transformer structure, whereas short-term dependencies and autoregressive characteristic are ignored. In this paper, we propose a variant of Transformer named patches with 3D-temporal convolutional Transformer network (PTCT), where original frames are split into multiple patches to remove the constraint of inductive bias and 3D-temporal convolution is employed to capture short-term dependencies efficiently. After training, the inference of PTCT is performed in an autoregressive way to ensure the quality of generated radar echo frames. To validate our algorithm, we conduct experiments on two radar echo dataset: Radar Echo Guangzhou and HKO-7. The experimental results show that PTCT achieves state-of-the-art (SOTA) performance compared with existing methods.

📄 PDF Abstract BibTeX arXiv:2112.01085

Code (1)

yangguobei/TCTN-pytorch 공식 구현 pytorch

Tasks

Inductive Bias

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting

2015-06-13 · NeurIPS 2015 12 · Xingjian Shi, Zhourong Chen, Hao Wang, Dit-yan Yeung 외

The goal of precipitation nowcasting is to predict the future rainfall intensity in a local region over a relatively short period of time. Very few previous studies have examined this crucial and challenging weather fore…

BIG-bench Machine LearningVideo PredictionWeather Forecasting

PA-Net: Precipitation-Adaptive Mixture-of-Experts for Long-Tail Rainfall Nowcasting

2026-03-14 · Xinyu Xiao, Sen Lei, Eryun Liu, Shiming Xiang 외 arxiv

Precipitation nowcasting is vital for flood warning, agricultural management, and emergency response, yet two bottlenecks persist: the prohibitive cost of modeling million-scale spatiotemporal tokens from multi-variate a…

Short-term Precipitation Forecasting in The Netherlands: An Application of Convolutional LSTM neural networks to weather radar data

2023-12-02 · Petros Demetrakopoulos

This work addresses the challenge of short-term precipitation forecasting by applying Convolutional Long Short-Term Memory (ConvLSTM) neural networks to weather radar data from the Royal Netherlands Meteorological Instit…

Precipitation ForecastingTemporal Sequences

Precipitation Nowcasting Using Diffusion Transformer with Causal Attention

2024-10-17 · Chaorong Li, XuDong Ling, YiLan Xue, Wenjie Luo 외

Short-term precipitation forecasting remains challenging due to the difficulty in capturing long-term spatiotemporal dependencies. Current deep learning methods fall short in establishing effective dependencies between c…

Precipitation Forecasting

Dense-Cast: A lightweight ensemble of deep learning architectures for precipitation nowcasting

2026-08-06 · Gourav Jyoti Kalita, Hidam Kumarjit Singh arxiv

Proper short-term forecasting of precipitation is crucial in disaster management and preparedness. Nonetheless, the variability and nonlinearity of precipitation make short-term forecasting challenging for meteorologists…