paper-with-me

Papers

Hierarchical Transformer with Spatio-Temporal Context Aggregation for Next Point-of-Interest Recommendation

2022-09-04 · Jiayi Xie, Zhenzhong Chen

Next point-of-interest (POI) recommendation is a critical task in location-based social networks, yet remains challenging due to a high degree of variation and personalization exhibited in user movements. In this work, we explore the latent hierarchical structure composed of multi-granularity short-term structural patterns in user check-in sequences. We propose a Spatio-Temporal context AggRegated Hierarchical Transformer (STAR-HiT) for next POI recommendation, which employs stacked hierarchical encoders to recursively encode the spatio-temporal context and explicitly locate subsequences of different granularities. More specifically, in each encoder, the global attention layer captures the spatio-temporal context of the sequence, while the local attention layer performed within each subsequence enhances subsequence modeling using the local context. The sequence partition layer infers positions and lengths of subsequences from the global context adaptively, such that semantics in subsequences can be well preserved. Finally, the subsequence aggregation layer fuses representations within each subsequence to form the corresponding subsequence representation, thereby generating a new sequence of higher-level granularity. The stacking of encoders captures the latent hierarchical structure of the check-in sequence, which is used to predict the next visiting POI. Extensive experiments on three public datasets demonstrate that the proposed model achieves superior performance whilst providing explanations for recommendations. Codes are available at https://github.com/JennyXieJiayi/STAR-HiT.

📄 PDF Abstract BibTeX arXiv:2209.01559

Code (1)

JennyXieJiayi/STAR-HiT 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Video-FocalNets: Spatio-Temporal Focal Modulation for Video Action Recognition

2023-07-13 · ICCV 2023 1 · Syed Talal Wasim, Muhammad Uzair Khattak, Muzammal Naseer, Salman Khan 외

Recent video recognition models utilize Transformer models for long-range spatio-temporal context modeling. Video transformer designs are based on self-attention that can model global context at a high computational cost…

Action RecognitionTemporal Action LocalizationVideo Recognition

Hierarchical Graph Convolutional Skeleton Transformer for Action Recognition

2021-09-07 · Ruwen Bai, Min Li, Bo Meng, Fengfa Li 외

Graph convolutional networks (GCNs) have emerged as dominant methods for skeleton-based action recognition. However, they still suffer from two problems, namely, neighborhood constraints and entangled spatiotemporal feat…

Action RecognitionDisentanglementSkeleton Based Action Recognition

Target Adaptive Context Aggregation for Video Scene Graph Generation

2021-08-18 · ICCV 2021 10 · Yao Teng, LiMin Wang, Zhifeng Li, Gangshan Wu

This paper deals with a challenging task of video scene graph generation (VidSGG), which could serve as a structured video representation for high-level understanding tasks. We present a new {\em detect-to-track} paradig…

Graph GenerationRelationRelation PredictionScene Graph Generation+1

STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation

2026-07-03 · Syed Ariff Syed Hesham, Yun Liu, Guolei Sun, Jing Yang 외 arxiv

Video reasoning segmentation demands pixel-accurate object tracking across hundreds of frames under complex natural language queries, producing dense spatiotemporal tokens whose quadratic self-attention cost makes long-v…

Natural Language QueriesObject Tracking

ADFormer: Aggregation Differential Transformer for Passenger Demand Forecasting

2025-06-03 · Haichen Wang, Liu Yang, Xinyuan Zhang, Haomin Yu 외

Passenger demand forecasting helps optimize vehicle scheduling, thereby improving urban efficiency. Recently, attention-based methods have been used to adequately capture the dynamic nature of spatio-temporal data. Howev…

Demand ForecastingDenoisingScheduling