paper-with-me

Papers

When Contrastive Learning Meets Active Learning: A Novel Graph Active Learning Paradigm with Self-Supervision

2020-10-30 · Yanqiao Zhu, Weizhi Xu, Qiang Liu, Shu Wu

This paper studies active learning (AL) on graphs, whose purpose is to discover the most informative nodes to maximize the performance of graph neural networks (GNNs). Previously, most graph AL methods focus on learning node representations from a carefully selected labeled dataset with large amount of unlabeled data neglected. Motivated by the success of contrastive learning (CL), we propose a novel paradigm that seamlessly integrates graph AL with CL. While being able to leverage the power of abundant unlabeled data in a self-supervised manner, nodes selected by AL further provide semantic information that can better guide representation learning. Besides, previous work measures the informativeness of nodes without considering the neighborhood propagation scheme of GNNs, so that noisy nodes may be selected. We argue that due to the smoothing nature of GNNs, the central nodes from homophilous subgraphs should benefit the model training most. To this end, we present a minimax selection scheme that explicitly harnesses neighborhood information and discover homophilous subgraphs to facilitate active selection. Comprehensive, confounding-free experiments on five public datasets demonstrate the superiority of our method over state-of-the-arts.

📄 PDF Abstract BibTeX arXiv:2010.16091

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningContrastive LearningGraph Representation LearningInformativenessRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Improving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning

2022-08-22 · Ding Zou, Wei Wei, Ziyang Wang, Xian-Ling Mao 외

Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural…

Contrastive LearningKnowledge-Aware RecommendationKnowledge GraphsRepresentation Learning+1

ActiveMatch: End-to-end Semi-supervised Active Representation Learning

2021-10-06 · Xinkai Yuan, Zilinghan Li, Gaoang Wang

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled sample…

Active LearningContrastive LearningRepresentation Learning

ACTIVE:Augmentation-Free Graph Contrastive Learning for Partial Multi-View Clustering

2022-03-01 · Yiming Wang, Dongxia Chang, Zhiqiang Fu, Jie Wen 외

In this paper, we propose an augmentation-free graph contrastive learning framework, namely ACTIVE, to solve the problem of partial multi-view clustering. Notably, we suppose that the representations of similar samples (…

ClusteringContrastive LearningRelation

Optical Diffraction Tomography Meets Fluorescence Localization Microscopy

2023-07-18 · Thanh-an Pham, Emmanuel Soubies, Ferréol Soulez, Michael Unser

We show that structural information can be extracted from single molecule localization microscopy (SMLM) data. More precisely, we reinterpret SMLM data as the measures of a phaseless optical diffraction tomography system…

Position

GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization

2022-08-21 · COLING 2022 10 · Qianqian Xie, Jimin Huang, Tulika Saha, Sophia Ananiadou

Recently, neural topic models (NTMs) have been incorporated into pre-trained language models (PLMs), to capture the global semantic information for text summarization. However, in these methods, there remain limitations …

Contrastive LearningExtractive SummarizationLanguage ModelingLanguage Modelling+2