Graph-Based Neural Network Models with Multiple Self-Supervised Auxiliary Tasks
Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation learning by training networks simultaneously on related tasks, leading to significant performance improvements. In this paper, we propose three novel self-supervised auxiliary tasks to train graph-based neural network models in a multi-task fashion. Since Graph Convolutional Networks are among the most promising approaches for capturing relationships among structured data points, we use them as a building block to achieve competitive results on standard semi-supervised graph classification tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Auxiliary LearningGraph ClassificationMulti-Task LearningRepresentation LearningSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptive Transfer Learning on Graph Neural Networks
Graph neural networks (GNNs) is widely used to learn a powerful representation of graph-structured data. Recent work demonstrates that transferring knowledge from self-supervised tasks to downstream tasks could further i…
Meta-LearningMulti-Task LearningTransfer LearningSelf-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs
Graph neural networks have shown superior performance in a wide range of applications providing a powerful representation of graph-structured data. Recent works show that the representation can be further improved by aux…
Auxiliary LearningLink PredictionMeta-LearningNode Classification+1Self-supervised Auxiliary Learning for Graph Neural Networks via Meta-Learning
In recent years, graph neural networks (GNNs) have been widely adopted in the representation learning of graph-structured data and provided state-of-the-art performance in various applications such as link prediction, no…
Auxiliary LearningGraph Neural NetworkLink PredictionMeta-Learning+3Improving Few-Shot Learning with Auxiliary Self-Supervised Pretext Tasks
Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised lea…
Few-Shot LearningRepresentation LearningSelf-Supervised LearningAutomatic Self-supervised Learning for Social Recommendations
In recent years, researchers have attempted to exploit social relations to improve the performance in recommendation systems. Generally, most existing social recommendation methods heavily depends on substantial domain k…
Meta-LearningRecommendation SystemsRepresentation LearningSelf-Supervised Learning