paper-with-me

Papers

TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts

2024-03-05 · Hyunwook Lee, Sungahn Ko

Accurate traffic forecasting is challenging due to the complex dependency on road networks, various types of roads, and the abrupt speed change due to the events. Recent works mainly focus on dynamic spatial modeling with adaptive graph embedding or graph attention having less consideration for temporal characteristics and in-situ modeling. In this paper, we propose a novel deep learning model named TESTAM, which individually models recurring and non-recurring traffic patterns by a mixture-of-experts model with three experts on temporal modeling, spatio-temporal modeling with static graph, and dynamic spatio-temporal dependency modeling with dynamic graph. By introducing different experts and properly routing them, TESTAM could better model various circumstances, including spatially isolated nodes, highly related nodes, and recurring and non-recurring events. For the proper routing, we reformulate a gating problem into a classification problem with pseudo labels. Experimental results on three public traffic network datasets, METR-LA, PEMS-BAY, and EXPY-TKY, demonstrate that TESTAM achieves a better indication and modeling of recurring and non-recurring traffic. We published the official code at https://github.com/HyunWookL/TESTAM

📄 PDF Abstract BibTeX arXiv:2403.02600

Code (1)

hyunwookl/testam 공식 구현 pytorch

Tasks

Graph AttentionGraph EmbeddingMixture-of-Experts

Methods 이 논문이 사용한 방법론

Focus 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Less is More: Strategic Expert Selection Outperforms Ensemble Complexity in Traffic Forecasting

2025-10-08 · Walid Guettala, Yufan Zhao, László Gulyás arxiv

Traffic forecasting is fundamental to intelligent transportation systems, enabling congestion mitigation and emission reduction in increasingly complex urban environments. While recent graph neural network approaches hav…

Computational EfficiencyGraph Neural Network

Spatiotemporal-Enhanced Network for Click-Through Rate Prediction in Location-based Services

2022-09-20 · Shaochuan Lin, Yicong Yu, Xiyu Ji, Taotao Zhou 외

In Location-Based Services(LBS), user behavior naturally has a strong dependence on the spatiotemporal information, i.e., in different geographical locations and at different times, user click behavior will change signif…

AttributeClick-Through Rate Prediction

Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring

2024-10-17 · Kristina Telegraph, Christos Kyrkou

This work presents advancements in multi-class vehicle detection using UAV cameras through the development of spatiotemporal object detection models. The study introduces a Spatio-Temporal Vehicle Detection Dataset (STVD…

Objectobject-detectionObject Detectionvehicle detection

Flow Neural Network and Flow-Structured Data Representation

2021-01-01 · Xiangle Cheng, Yuchen He, Feifei Long, Shihan Xiao 외

Traffic flows are the most fundamental components in a communication networking system. An accurate understanding of these flows is crucial for many downstream network applications. However, the high nonlinearity, random…

Local Temporal Feature Enhanced Transformer with ROI-rank Based Masking for Diagnosis of ADHD

2025-04-12 · Byunggun Kim, Younghun Kwon

In modern society, Attention-Deficit/Hyperactivity Disorder (ADHD) is one of the common mental diseases discovered not only in children but also in adults. In this context, we propose a ADHD diagnosis transformer model t…