paper-with-me

홈 › Papers

TopoFormer: Integrating Transformers and ConvLSTMs for Coastal Topography Prediction

2025-01-11 · Santosh Munian, Oktay Karakuş, William Russell, Gwyn Nelson

This paper presents \textit{TopoFormer}, a novel hybrid deep learning architecture that integrates transformer-based encoders with convolutional long short-term memory (ConvLSTM) layers for the precise prediction of topographic beach profiles referenced to elevation datums, with a particular focus on Mean Low Water Springs (MLWS) and Mean Low Water Neaps (MLWN). Accurate topographic estimation down to MLWS is critical for coastal management, navigation safety, and environmental monitoring. Leveraging a comprehensive dataset from the Wales Coastal Monitoring Centre (WCMC), consisting of over 2000 surveys across 36 coastal survey units, TopoFormer addresses key challenges in topographic prediction, including temporal variability and data gaps in survey measurements. The architecture uniquely combines multi-head attention mechanisms and ConvLSTM layers to capture both long-range dependencies and localized temporal patterns inherent in beach profiles data. TopoFormer's predictive performance was rigorously evaluated against state-of-the-art models, including DenseNet, 1D/2D CNNs, and LSTMs. While all models demonstrated strong performance, \textit{TopoFormer} achieved the lowest mean absolute error (MAE), as low as 2 cm, and provided superior accuracy in both in-distribution (ID) and out-of-distribution (OOD) evaluations.

📄 PDF Abstract BibTeX arXiv:2501.06494

Code (0)

등록된 구현이 없습니다.

Tasks

Survey

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Multi-Head Attention 설명 없음
Tanh Activation 설명 없음

Similar Papers 제목 키워드 기반

Inferring Underwater Topography with FINN

2024-08-20 · Coşku Can Horuz, Matthias Karlbauer, Timothy Praditia, Sergey Oladyshkin 외

Spatiotemporal partial differential equations (PDEs) find extensive application across various scientific and engineering fields. While numerous models have emerged from both physics and machine learning (ML) communities…

Topoformer: brain-like topographic organization in Transformer language models through spatial querying and reweighting

2025-10-21 · Taha Binhuraib, Greta Tuckute, Nicholas Blauch arxiv

Spatial functional organization is a hallmark of biological brains: neurons are arranged topographically according to their response properties, at multiple scales. In contrast, representations within most machine learni…

Learning to forecast vegetation greenness at fine resolution over Africa with ConvLSTMs

2022-10-24 · Claire Robin, Christian Requena-Mesa, Vitus Benson, Lazaro Alonso 외

Forecasting the state of vegetation in response to climate and weather events is a major challenge. Its implementation will prove crucial in predicting crop yield, forest damage, or more generally the impact on ecosystem…

HumanitarianVideo Prediction

TopoFormer: Topology Meets Attention for Graph Learning

2026-07-30 · Md Joshem Uddin, Astrit Tola, Cuneyt Gurcan Akcora, Baris Coskunuzer arxiv

We introduce Topoformer, a lightweight and scalable framework for graph representation learning that encodes topological structure into attention-friendly sequences. At the core of our method is Topo-Scan, a novel module…

Molecular Property PredictionGraph Representation LearningGraph ClassificationGraph Learning

T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving

2024-11-28 · CVPR 2025 1 · Changsheng Lv, Mengshi Qi, Liang Liu, Huadong Ma

Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph e…

Autonomous Drivingcounterfactual