Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labels

2019-02-28 · Ke Sun, Zhouchen Lin, Zhanxing Zhu

Graph Convolutional Networks(GCNs) play a crucial role in graph learning tasks, however, learning graph embedding with few supervised signals is still a difficult problem. In this paper, we propose a novel training algorithm for Graph Convolutional Network, called Multi-Stage Self-Supervised(M3S) Training Algorithm, combined with self-supervised learning approach, focusing on improving the generalization performance of GCNs on graphs with few labeled nodes. Firstly, a Multi-Stage Training Framework is provided as the basis of M3S training method. Then we leverage DeepCluster technique, a popular form of self-supervised learning, and design corresponding aligning mechanism on the embedding space to refine the Multi-Stage Training Framework, resulting in M3S Training Algorithm. Finally, extensive experimental results verify the superior performance of our algorithm on graphs with few labeled nodes under different label rates compared with other state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:1902.11038

Code (1)

Junseok0207/M3S_Pytorch pytorch

Tasks

Graph Embedding Graph Learning Self-Supervised Learning

Methods 이 논문이 사용한 방법론

k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…

DeepCluster DeepCluster is a self-supervision approach for learning image representations. DeepCluster iteratively groups the features with a standard clustering algorithm, k-means, and…

Context-Aware Self-Supervised Learning of Whole Slide Images

2023-06-07 · Milan Aryal, Nasim Yahyasoltani

Presenting whole slide images (WSIs) as graph will enable a more efficient and accurate learning framework for cancer diagnosis. Due to the fact that a single WSI consists of billions of pixels and there is a lack of vas…

Self-Supervised Learning whole slide images

A Multi-Stage Attentive Transfer Learning Framework for Improving COVID-19 Diagnosis

2021-01-14 · Yi Liu, Shuiwang Ji

Computed tomography (CT) imaging is a promising approach to diagnosing the COVID-19. Machine learning methods can be employed to train models from labeled CT images and predict whether a case is positive or negative. How…

Computed Tomography (CT)COVID-19 Diagnosis Representation Learning Self-Supervised Learning+1

Multi-task Self-distillation for Graph-based Semi-Supervised Learning

2021-12-02 · Yating Ren, Junzhong Ji, Lingfeng Niu, Minglong Lei

Graph convolutional networks have made great progress in graph-based semi-supervised learning. Existing methods mainly assume that nodes connected by graph edges are prone to have similar attributes and labels, so that t…

Node Classification

Contrastive and Multi-Task Learning on Noisy Brain Signals with Nonlinear Dynamical Signatures

2026-01-13 · Sucheta Ghosh, Felix Dietrich, Zahra Monfared arxiv

We introduce a two-stage multitask learning framework for analyzing Electroencephalography (EEG) signals that integrates denoising, dynamical modeling, and representation learning. In the first stage, a denoising autoenc…

Self-Supervised Learning Representation Learning Multi-Task Learning Eeg Decoding

Graph-Based Neural Network Models with Multiple Self-Supervised Auxiliary Tasks

2020-11-14 · Franco Manessi, Alessandro Rozza

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improv…

Auxiliary Learning Graph Classification Multi-Task Learning Representation Learning+1