paper-with-me

홈 › Papers

Semantic-Enhanced Representation Learning for Road Networks with Temporal Dynamics

2024-03-18 · Yile Chen, Xiucheng Li, Gao Cong, Zhifeng Bao, Cheng Long

In this study, we introduce a novel framework called Toast for learning general-purpose representations of road networks, along with its advanced counterpart DyToast, designed to enhance the integration of temporal dynamics to boost the performance of various time-sensitive downstream tasks. Specifically, we propose to encode two pivotal semantic characteristics intrinsic to road networks: traffic patterns and traveling semantics. To achieve this, we refine the skip-gram module by incorporating auxiliary objectives aimed at predicting the traffic context associated with a target road segment. Moreover, we leverage trajectory data and design pre-training strategies based on Transformer to distill traveling semantics on road networks. DyToast further augments this framework by employing unified trigonometric functions characterized by their beneficial properties, enabling the capture of temporal evolution and dynamic nature of road networks more effectively. With these proposed techniques, we can obtain representations that encode multi-faceted aspects of knowledge within road networks, applicable across both road segment-based applications and trajectory-based applications. Extensive experiments on two real-world datasets across three tasks demonstrate that our proposed framework consistently outperforms the state-of-the-art baselines by a significant margin.

📄 PDF Abstract BibTeX arXiv:2403.11495

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Dual-branch Spatial-Temporal Self-supervised Representation for Enhanced Road Network Learning

2025-11-10 · Qinghong Guo, Yu Wang, Ji Cao, Tongya Zheng 외 arxiv

Road network representation learning (RNRL) has attracted increasing attention from both researchers and practitioners as various spatiotemporal tasks are emerging. Recent advanced methods leverage Graph Neural Networks …

Representation LearningContrastive LearningZero-Shot Learning

Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semantics

2022-11-17 · Jiawei Jiang, Dayan Pan, Houxing Ren, Xiaohan Jiang 외

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be ap…

Contrastive LearningGraph AttentionManagementRepresentation Learning+1

Time-Resolved EEG Decoding of Semantic Processing Reveals Altered Neural Dynamics in Depression and Suicidality

2025-07-30 · Woojae Jeong, Aditya Kommineni, Kleanthis Avramidis, Colin McDaniel 외 arxiv

Depression and suicidality affect cognitive and emotional processes, yet objective, task-evoked neural readouts of mental health remain limited. We investigated the spatiotemporal dynamics of affective semantic processin…

Eeg Decoding

Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation

2025-12-27 · Junshu Dai, Yu Wang, Tongya Zheng, Wei Ji 외 arxiv

The precise prediction of human mobility has produced significant socioeconomic impacts, such as location recommendations and evacuation suggestions. However, existing methods suffer from limited generalization capabilit…

Rethinking RGB-Event Semantic Segmentation with a Novel Bidirectional Motion-enhanced Event Representation

2025-05-02 · Zhen Yao, Xiaowen Ying, Mooi Choo Chuah

Event cameras capture motion dynamics, offering a unique modality with great potential in various computer vision tasks. However, RGB-Event fusion faces three intrinsic misalignments: (i) temporal, (ii) spatial, and (iii…

Semantic Segmentation