Hierarchical Graph Neural Networks
Over the recent years, Graph Neural Networks have become increasingly popular in network analytic and beyond. With that, their architecture noticeable diverges from the classical multi-layered hierarchical organization of the traditional neural networks. At the same time, many conventional approaches in network science efficiently utilize the hierarchical approaches to account for the hierarchical organization of the networks, and recent works emphasize their critical importance. This paper aims to connect the dots between the traditional Neural Network and the Graph Neural Network architectures as well as the network science approaches, harnessing the power of the hierarchical network organization. A Hierarchical Graph Neural Network architecture is proposed, supplementing the original input network layer with the hierarchy of auxiliary network layers and organizing the computational scheme updating the node features through both - horizontal network connections within each layer as well as the vertical connection between the layers. It enables simultaneous learning of the individual node features along with the aggregated network features at variable resolution and uses them to improve the convergence and stability of the individual node feature learning. The proposed Hierarchical Graph Neural network architecture is successfully evaluated on the network embedding and modeling as well as network classification, node labeling, and community tasks and demonstrates increased efficiency in those.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkNetwork EmbeddingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-Supervised Hierarchical Graph Classification
Node classification and graph classification are two graph learning problems that predict the class label of a node and the class label of a graph respectively. A node of a graph usually represents a real-world entity, e…
ClassificationGraph ClassificationGraph LearningNode ClassificationQuestion Generation from Paragraphs: A Tale of Two Hierarchical Models
Automatic question generation from paragraphs is an important and challenging problem, particularly due to the long context from paragraphs. In this paper, we propose and study two hierarchical models for the task of que…
Question GenerationQuestion-GenerationSentenceVocal Bursts Valence PredictionHierarchical Graph Network for Multi-hop Question Answering
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop question answering. To aggregate clues from scattered texts across multiple paragraphs, a hierarchical graph is created by constructing nodes on di…
Multi-hop Question AnsweringQuestion AnsweringContrastive Hierarchical Discourse Graph for Scientific Document Summarization
The extended structural context has made scientific paper summarization a challenging task. This paper proposes CHANGES, a contrastive hierarchical graph neural network for extractive scientific paper summarization. CHAN…
Contrastive LearningDocument SummarizationGraph Neural NetworkScientific Document Summarization+1Unsupervised Hierarchical Graph Representation Learning by Mutual Information Maximization
Graph representation learning based on graph neural networks (GNNs) can greatly improve the performance of downstream tasks, such as node and graph classification. However, the general GNN models do not aggregate node in…
General ClassificationGraph ClassificationGraph Representation LearningRepresentation Learning