paper-with-me

홈 › Papers

Upscaling Global Hourly GPP with Temporal Fusion Transformer (TFT)

2023-06-23 · Rumi Nakagawa, Mary Chau, John Calzaretta, Trevor Keenan, Puya Vahabi, Alberto Todeschini, Maoya Bassiouni, Yanghui Kang

Reliable estimates of Gross Primary Productivity (GPP), crucial for evaluating climate change initiatives, are currently only available from sparsely distributed eddy covariance tower sites. This limitation hampers access to reliable GPP quantification at regional to global scales. Prior machine learning studies on upscaling \textit{in situ} GPP to global wall-to-wall maps at sub-daily time steps faced limitations such as lack of input features at higher temporal resolutions and significant missing values. This research explored a novel upscaling solution using Temporal Fusion Transformer (TFT) without relying on past GPP time series. Model development was supplemented by Random Forest Regressor (RFR) and XGBoost, followed by the hybrid model of TFT and tree algorithms. The best preforming model yielded to model performance of 0.704 NSE and 3.54 RMSE. Another contribution of the study was the breakdown analysis of encoder feature importance based on time and flux tower sites. Such analysis enhanced the interpretability of the multi-head attention layer as well as the visual understanding of temporal dynamics of influential features.

📄 PDF Abstract BibTeX arXiv:2306.13815

Code (0)

등록된 구현이 없습니다.

Tasks

Feature ImportanceMissing ValuesTime Series

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

FLUXtrapolation: A benchmark on extrapolating ecosystem fluxes

2026-05-19 · Anya Fries, Jacob A Nelson, Martin Jung, Markus Reichstein 외 arxiv

We introduce FLUXtrapolation, a benchmark for extrapolating ecosystem fluxes under progressively harder distribution shifts. Ecosystem fluxes are central to understanding the carbon, water, and energy cycles, yet they ca…

Domain Generalization

Conditional Diffusion Models for Global Precipitation Map Inpainting

2025-07-28 · Daiko Kishikawa, Yuka Muto, Shunji Kotsuki arxiv

Incomplete satellite-based precipitation presents a significant challenge in global monitoring. For example, the Global Satellite Mapping of Precipitation (GSMaP) from JAXA suffers from substantial missing regions due to…

Video Inpainting

Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution

2023-12-11 · CVPR 2024 1 · Shangchen Zhou, Peiqing Yang, Jianyi Wang, Yihang Luo 외

Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resol…

DecoderSuper-ResolutionVideo Super-Resolution

CNCast: Leveraging 3D Swin Transformer and DiT for Enhanced Regional Weather Forecasting

2025-03-16 · Hongli Liang, YuanTing Zhang, Qingye Meng, Shuangshuang He 외

This study introduces a cutting-edge regional weather forecasting model based on the SwinTransformer 3D architecture. This model is specifically designed to deliver precise hourly weather predictions ranging from 1 hour …

3D ArchitectureWeather Forecasting

Merging Satellite Measurements of Rainfall Using Multi-scale Imagery Technique

2013-04-11 · Seyed Hamed Alemohammad, Dara Entekhabi

Several passive microwave satellites orbit the Earth and measure rainfall. These measurements have the advantage of almost full global coverage when compared to surface rain gauges. However, these satellites have low tem…