paper-with-me

홈 › Papers

Revisiting Mobility Modeling with Graph: A Graph Transformer Model for Next Point-of-Interest Recommendation

2023-10-02 · Xiaohang Xu, Toyotaro Suzumura, Jiawei Yong, Masatoshi Hanai, Chuang Yang, Hiroki Kanezashi, Renhe Jiang, Shintaro Fukushima

Next Point-of-Interest (POI) recommendation plays a crucial role in urban mobility applications. Recently, POI recommendation models based on Graph Neural Networks (GNN) have been extensively studied and achieved, however, the effective incorporation of both spatial and temporal information into such GNN-based models remains challenging. Extracting distinct fine-grained features unique to each piece of information is difficult since temporal information often includes spatial information, as users tend to visit nearby POIs. To address the challenge, we propose \textbf{\underline{Mob}}ility \textbf{\underline{G}}raph \textbf{\underline{T}}ransformer (MobGT) that enables us to fully leverage graphs to capture both the spatial and temporal features in users' mobility patterns. MobGT combines individual spatial and temporal graph encoders to capture unique features and global user-location relations. Additionally, it incorporates a mobility encoder based on Graph Transformer to extract higher-order information between POIs. To address the long-tailed problem in spatial-temporal data, MobGT introduces a novel loss function, Tail Loss. Experimental results demonstrate that MobGT outperforms state-of-the-art models on various datasets and metrics, achieving 24\% improvement on average. Our codes are available at \url{https://github.com/Yukayo/MobGT}.

📄 PDF Abstract BibTeX arXiv:2310.01224

Code (1)

yukayo/mobgt 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
LapEigen 설명 없음
Laplacian PE Laplacian eigenvectors represent a natural generalization of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Pre-trained Transformer Uncovers Meaningful Patterns in Human Mobility Data

2024-06-06 · Alameen Najjar

We empirically demonstrate that a transformer pre-trained on country-scale unlabeled human mobility data learns embeddings capable, through fine-tuning, of developing a deep understanding of the target geography and its …

Attribute

Graph Network Modeling Techniques for Visualizing Human Mobility Patterns

2025-04-04 · Sinjini Mitra, Anuj Srivastava, Avipsa Roy, Pavan Turaga

Human mobility analysis at urban-scale requires models to represent the complex nature of human movements, which in turn are affected by accessibility to nearby points of interest, underlying socioeconomic factors of a p…

Graph Matching

A Short Survey of Human Mobility Prediction in Epidemic Modeling from Transformers to LLMs

2024-04-25 · Christian N. Mayemba, D'Jeff K. Nkashama, Jean Marie Tshimula, Maximilien V. Dialufuma 외

This paper provides a comprehensive survey of recent advancements in leveraging machine learning techniques, particularly Transformer models, for predicting human mobility patterns during epidemics. Understanding how peo…

Can Demographic Factors Improve Text Classification? Revisiting Demographic Adaptation in the Age of Transformers

2022-10-13 · Chia-Chien Hung, Anne Lauscher, Dirk Hovy, Simone Paolo Ponzetto 외

Demographic factors (e.g., gender or age) shape our language. Previous work showed that incorporating demographic factors can consistently improve performance for various NLP tasks with traditional NLP models. In this wo…

Language ModelingLanguage ModellingMulti-Task Learningtext-classification+1

Human Mobility Modeling with Limited Information via Large Language Models

2024-09-26 · Yifan Liu, Xishun Liao, Haoxuan Ma, Brian Yueshuai He 외

Understanding human mobility patterns has traditionally been a complex challenge in transportation modeling. Due to the difficulties in obtaining high-quality training datasets across diverse locations, conventional acti…

Language ModelingLanguage ModellingLarge Language Model