When Contrastive Learning Meets Active Learning: A Novel Graph Active Learning Paradigm with Self-Supervision
This paper studies active learning (AL) on graphs, whose purpose is to discover the most informative nodes to maximize the performance of graph neural networks (GNNs). Previously, most graph AL methods focus on learning node representations from a carefully selected labeled dataset with large amount of unlabeled data neglected. Motivated by the success of contrastive learning (CL), we propose a novel paradigm that seamlessly integrates graph AL with CL. While being able to leverage the power of abundant unlabeled data in a self-supervised manner, nodes selected by AL further provide semantic information that can better guide representation learning. Besides, previous work measures the informativeness of nodes without considering the neighborhood propagation scheme of GNNs, so that noisy nodes may be selected. We argue that due to the smoothing nature of GNNs, the central nodes from homophilous subgraphs should benefit the model training most. To this end, we present a minimax selection scheme that explicitly harnesses neighborhood information and discover homophilous subgraphs to facilitate active selection. Comprehensive, confounding-free experiments on five public datasets demonstrate the superiority of our method over state-of-the-arts.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningContrastive LearningGraph Representation LearningInformativenessRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning
Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural…
Contrastive LearningKnowledge-Aware RecommendationKnowledge GraphsRepresentation Learning+1ActiveMatch: End-to-end Semi-supervised Active Representation Learning
Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled sample…
Active LearningContrastive LearningRepresentation LearningACTIVE:Augmentation-Free Graph Contrastive Learning for Partial Multi-View Clustering
In this paper, we propose an augmentation-free graph contrastive learning framework, namely ACTIVE, to solve the problem of partial multi-view clustering. Notably, we suppose that the representations of similar samples (…
ClusteringContrastive LearningRelationOptical Diffraction Tomography Meets Fluorescence Localization Microscopy
We show that structural information can be extracted from single molecule localization microscopy (SMLM) data. More precisely, we reinterpret SMLM data as the measures of a phaseless optical diffraction tomography system…
PositionGRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization
Recently, neural topic models (NTMs) have been incorporated into pre-trained language models (PLMs), to capture the global semantic information for text summarization. However, in these methods, there remain limitations …
Contrastive LearningExtractive SummarizationLanguage ModelingLanguage Modelling+2