paper-with-me

Papers

Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendation

2022-07-12 · Yuhao Yang, Chao Huang, Lianghao Xia, Yuxuan Liang, Yanwei Yu, Chenliang Li

Learning dynamic user preference has become an increasingly important component for many online platforms (e.g., video-sharing sites, e-commerce systems) to make sequential recommendations. Previous works have made many efforts to model item-item transitions over user interaction sequences, based on various architectures, e.g., recurrent neural networks and self-attention mechanism. Recently emerged graph neural networks also serve as useful backbone models to capture item dependencies in sequential recommendation scenarios. Despite their effectiveness, existing methods have far focused on item sequence representation with singular type of interactions, and thus are limited to capture dynamic heterogeneous relational structures between users and items (e.g., page view, add-to-favorite, purchase). To tackle this challenge, we design a Multi-Behavior Hypergraph-enhanced Transformer framework (MBHT) to capture both short-term and long-term cross-type behavior dependencies. Specifically, a multi-scale Transformer is equipped with low-rank self-attention to jointly encode behavior-aware sequential patterns from fine-grained and coarse-grained levels. Additionally, we incorporate the global multi-behavior dependency into the hypergraph neural architecture to capture the hierarchical long-range item correlations in a customized manner. Experimental results demonstrate the superiority of our MBHT over various state-of-the-art recommendation solutions across different settings. Further ablation studies validate the effectiveness of our model design and benefits of the new MBHT framework. Our implementation code is released at: https://github.com/yuh-yang/MBHT-KDD22.

📄 PDF Abstract BibTeX arXiv:2207.05584

Code (1)

yuh-yang/mbht-kdd22 공식 구현 pytorch

Tasks

Multibehavior RecommendationSequential Recommendation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Multi-Modal Hypergraph Enhanced LLM Learning for Recommendation

2025-04-13 · Xu Guo, Tong Zhang, Yuanzhi Wang, Chenxu Wang 외

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correl…

Contrastive LearningMultimodal RecommendationRecommendation Systems

Hybrid-supervised Hypergraph-enhanced Transformer for Micro-gesture Based Emotion Recognition

2025-07-20 · Zhaoqiang Xia, Hexiang Huang, Haoyu Chen, Xiaoyi Feng 외 arxiv

Micro-gestures are unconsciously performed body gestures that can convey the emotion states of humans and start to attract more research attention in the fields of human behavior understanding and affective computing as …

Self-Supervised LearningEmotion Recognition

Multi-Grained Preference Enhanced Transformer for Multi-Behavior Sequential Recommendation

2024-11-19 · Chuan He, Yongchao Liu, Qiang Li, Weiqiang Wang 외

Sequential recommendation (SR) aims to predict the next purchasing item according to users' dynamic preference learned from their historical user-item interactions. To improve the performance of recommendation, learning …

Recommendation SystemsSequential Recommendation

Dynamic Hypergraph-Enhanced Prediction of Sequential Medical Visits

2024-08-08 · Wangying Yang, Zitao Zheng, Zhizhong Wu, Bo Zhang 외

This study introduces a pioneering Dynamic Hypergraph Networks (DHCE) model designed to predict future medical diagnoses from electronic health records with enhanced accuracy. The DHCE model innovates by identifying and …

Language ModelingLanguage ModellingPredictionSequential Diagnosis

HEC-GCN: Hypergraph Enhanced Cascading Graph Convolution Network for Multi-Behavior Recommendation

2024-12-19 · Yabo Yin, Xiaofei Zhu, Wenshan Wang, Yihao Zhang 외

Multi-behavior recommendation (MBR) has garnered growing attention recently due to its ability to mitigate the sparsity issue by inferring user preferences from various auxiliary behaviors to improve predictions for the …