Mutual Teaching for Graph Convolutional Networks
Graph convolutional networks produce good predictions of unlabeled samples due to its transductive label propagation. Since samples have different predicted confidences, we take high-confidence predictions as pseudo labels to expand the label set so that more samples are selected for updating models. We propose a new training method named as mutual teaching, i.e., we train dual models and let them teach each other during each batch. First, each network feeds forward all samples and selects samples with high-confidence predictions. Second, each model is updated by samples selected by its peer network. We view the high-confidence predictions as useful knowledge, and the useful knowledge of one network teaches the peer network with model updating in each batch. In mutual teaching, the pseudo-label set of a network is from its peer network. Since we use the new strategy of network training, performance improves significantly. Extensive experimental results demonstrate that our method achieves superior performance over state-of-the-art methods under very low label rates.
Code (1)
Tasks
Node ClassificationPseudo LabelSimilar Papers 제목 키워드 기반
Nonparametric Teaching for Graph Property Learners
Inferring properties of graph-structured data, e.g., the solubility of molecules, essentially involves learning the implicit mapping from graphs to their properties. This learning process is often costly for graph proper…
Robust Mutual Learning for Semi-supervised Semantic Segmentation
Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppr…
Pseudo LabelSemantic SegmentationSemi-Supervised Semantic SegmentationUnsupervised Image Segmentation using Mutual Mean-Teaching
Unsupervised image segmentation aims at assigning the pixels with similar feature into a same cluster without annotation, which is an important task in computer vision. Due to lack of prior knowledge, most of existing mo…
Image SegmentationSegmentationSemantic SegmentationUnsupervised Image SegmentationCurriculum Graph Co-Teaching for Multi-Target Domain Adaptation
In this paper we address multi-target domain adaptation (MTDA), where given one labeled source dataset and multiple unlabeled target datasets that differ in data distributions, the task is to learn a robust predictor for…
Blended-target Domain AdaptationDomain AdaptationMulti-target Domain AdaptationGraph Convolutional Reinforcement Learning
Learning to cooperate is crucially important in multi-agent environments. The key is to understand the mutual interplay between agents. However, multi-agent environments are highly dynamic, where agents keep moving and t…
Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1