HighwayGraph: Modelling Long-distance Node Relations for Improving General Graph Neural Network
Graph Neural Networks (GNNs) are efficient approaches to process graph-structured data. Modelling long-distance node relations is essential for GNN training and applications. However, conventional GNNs suffer from bad performance in modelling long-distance node relations due to limited-layer information propagation. Existing studies focus on building deep GNN architectures, which face the over-smoothing issue and cannot model node relations in particularly long distance. To address this issue, we propose to model long-distance node relations by simply relying on shallow GNN architectures with two solutions: (1) Implicitly modelling by learning to predict node pair relations (2) Explicitly modelling by adding edges between nodes that potentially have the same label. To combine our two solutions, we propose a model-agnostic training framework named HighwayGraph, which overcomes the challenge of insufficient labeled nodes by sampling node pairs from the training set and adopting the self-training method. Extensive experimental results show that our HighwayGraph achieves consistent and significant improvements over four representative GNNs on three benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationGraph Neural NetworkNode ClassificationSimilar Papers 제목 키워드 기반
Modelling Long-distance Node Relations for KBQA with Global Dynamic Graph
The structural information of Knowledge Bases (KBs) has proven effective to Question Answering (QA). Previous studies rely on deep graph neural networks (GNNs) to capture rich structural information, which may not model …
Question AnsweringVocal Bursts Type PredictionLearning Graph Neural Networks with Positive and Unlabeled Nodes
Graph neural networks (GNNs) are important tools for transductive learning tasks, such as node classification in graphs, due to their expressive power in capturing complex interdependency between nodes. To enable graph n…
Graph Neural NetworkNode ClassificationTransductive LearningDynamic Graph Message Passing Networks
Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although CNNs have excelled in many vision tasks, they are still limited in capturing long-range structured relationships as…
Image Classificationobject-detectionObject DetectionScene Understanding+1Graph Neural Networks with Feature and Structure Aware Random Walk
Graph Neural Networks (GNNs) have received increasing attention for representation learning in various machine learning tasks. However, most existing GNNs applying neighborhood aggregation usually perform poorly on the g…
Node ClassificationRepresentation LearningA Scalable Framework for Table of Contents Extraction from Complex ESG Annual Reports
Table of contents (ToC) extraction centres on structuring documents in a hierarchical manner. In this paper, we propose a new dataset, ESGDoc, comprising 1,093 ESG annual reports from 563 companies spanning from 2001 to …