paper-with-me

Papers

Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top-$N$ Recommendation

2021-06-12 · Hui Wang, Kun Zhou, Wayne Xin Zhao, Jingyuan Wang, Ji-Rong Wen

Due to the flexibility in modelling data heterogeneity, heterogeneous information network (HIN) has been adopted to characterize complex and heterogeneous auxiliary data in top-$N$ recommender systems, called \emph{HIN-based recommendation}. HIN characterizes complex, heterogeneous data relations, containing a variety of information that may not be related to the recommendation task. Therefore, it is challenging to effectively leverage useful information from HINs for improving the recommendation performance. To address the above issue, we propose a Curriculum pre-training based HEterogeneous Subgraph Transformer (called \emph{CHEST}) with new \emph{data characterization}, \emph{representation model} and \emph{learning algorithm}. Specifically, we consider extracting useful information from HIN to compose the interaction-specific heterogeneous subgraph, containing both sufficient and relevant context information for recommendation. Then we capture the rich semantics (\eg graph structure and path semantics) within the subgraph via a heterogeneous subgraph Transformer, where we encode the subgraph with multi-slot sequence representations. Besides, we design a curriculum pre-training strategy to provide an elementary-to-advanced learning process, by which we smoothly transfer basic semantics in HIN for modeling user-item interaction relation. Extensive experiments conducted on three real-world datasets demonstrate the superiority of our proposed method over a number of competitive baselines, especially when only limited training data is available.

📄 PDF Abstract BibTeX arXiv:2106.06722

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Heterogeneous Subgraph Transformer for Fake News Detection

2024-04-19 · Yuchen Zhang, Xiaoxiao Ma, Jia Wu, Jian Yang 외

Fake news is pervasive on social media, inflicting substantial harm on public discourse and societal well-being. We investigate the explicit structural information and textual features of news pieces by constructing a he…

Fake News DetectionLanguage ModelingLanguage ModellingSentence

SUGER: A Subgraph-based Graph Convolutional Network Method for Bundle Recommendation

2022-05-05 · Zhenning Zhang, Boxin Du, Hanghang Tong

Bundle recommendation is an emerging research direction in the recommender system with the focus on recommending customized bundles of items for users. Although Graph Neural Networks (GNNs) have been applied in this prob…

Graph Neural NetworkRecommendation Systems

Source-Aware Embedding Training on Heterogeneous Information Networks

2023-07-10 · Tsai Hor Chan, Chi Ho Wong, Jiajun Shen, Guosheng Yin

Heterogeneous information networks (HINs) have been extensively applied to real-world tasks, such as recommendation systems, social networks, and citation networks. While existing HIN representation learning methods can …

Graph EmbeddingNetwork EmbeddingRecommendation SystemsRepresentation Learning

Inductive Relation Prediction Using Analogy Subgraph Embeddings

2021-09-29 · ICLR 2022 4 · Jiarui Jin, Yangkun Wang, Kounianhua Du, Weinan Zhang 외

Prevailing methods for relation prediction in heterogeneous graphs aim at learning latent representations (i.e., embeddings) of observed nodes and relations, and thus are limited to the transductive setting where the rel…

Inductive BiasInductive Relation PredictionKnowledge Graph CompletionPrediction+2

Curriculum Guided Personalized Subgraph Federated Learning

2025-08-30 · Minku Kang, Hogun Park arxiv

Subgraph Federated Learning (FL) aims to train Graph Neural Networks (GNNs) across distributed private subgraphs, but it suffers from severe data heterogeneity. To mitigate data heterogeneity, weighted model aggregation …

Federated Learning