paper-with-me

홈 › Papers

AGHINT: Attribute-Guided Representation Learning on Heterogeneous Information Networks with Transformer

2024-04-16 · Jinhui Yuan, Shan Lu, Peibo Duan, Jieyue He

Recently, heterogeneous graph neural networks (HGNNs) have achieved impressive success in representation learning by capturing long-range dependencies and heterogeneity at the node level. However, few existing studies have delved into the utilization of node attributes in heterogeneous information networks (HINs). In this paper, we investigate the impact of inter-node attribute disparities on HGNNs performance within the benchmark task, i.e., node classification, and empirically find that typical models exhibit significant performance decline when classifying nodes whose attributes markedly differ from their neighbors. To alleviate this issue, we propose a novel Attribute-Guided heterogeneous Information Networks representation learning model with Transformer (AGHINT), which allows a more effective aggregation of neighbor node information under the guidance of attributes. Specifically, AGHINT transcends the constraints of the original graph structure by directly integrating higher-order similar neighbor features into the learning process and modifies the message-passing mechanism between nodes based on their attribute disparities. Extensive experimental results on three real-world heterogeneous graph benchmarks with target node attributes demonstrate that AGHINT outperforms the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2404.10443

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Metapaths guided Neighbors aggregated Network for?Heterogeneous Graph Reasoning

2021-03-11 · Bang Lin, Xiuchong Wang, Yu Dong, Chengfu Huo 외

Most real-world datasets are inherently heterogeneous graphs, which involve a diversity of node and relation types. Heterogeneous graph embedding is to learn the structure and semantic information from the graph, and the…

DiversityGraph EmbeddingGraph Neural NetworkLink Prediction+2

Heterogeneous Graph Neural Network via Attribute Completion

2021-06-03 · WWW 2021 6 · Di JinCuiying HuoChundong LiangLiang Yang

Heterogeneous information networks (HINs), also called heterogeneous graphs, are composed of multiple types of nodes and edges, and contain comprehensive information and rich semantics. Graph neural networks (GNNs), as p…

AttributeGraph LearningGraph Neural Network

HeGAE-AC: heterogeneous graph auto-encoder for attribute completion

2024-03-05 · Knowledge-Based Systems 2024 3 · Yejia Chen, Ye Liu

Heterogeneous Graphs (HGs) are widely used to model complex real-world networks that involve multiple types of nodes and relations. Many heterogeneous graph neural networks (HGNNs) based methods have been developed to le…

AttributeGraph Representation LearningRepresentation Learning

Variational Graph Autoencoder for Heterogeneous Information Networks with Missing and Inaccurate Attributes

2023-11-14 · Yige Zhao, Jianxiang Yu, Yao Cheng, Chengcheng Yu 외

Heterogeneous Information Networks (HINs), which consist of various types of nodes and edges, have recently demonstrated excellent performance in graph mining. However, most existing heterogeneous graph neural networks (…

AttributeDecoderGraph Mining

When Heterophily Meets Heterogeneous Graphs: Latent Graphs Guided Unsupervised Representation Learning

2024-09-01 · Zhixiang Shen, Zhao Kang

Unsupervised heterogeneous graph representation learning (UHGRL) has gained increasing attention due to its significance in handling practical graphs without labels. However, heterophily has been largely ignored, despite…

Graph Representation LearningRepresentation Learning