Negative sampling in semi-supervised learning
We introduce Negative Sampling in Semi-Supervised Learning (NS3L), a simple, fast, easy to tune algorithm for semi-supervised learning (SSL). NS3L is motivated by the success of negative sampling/contrastive estimation. We demonstrate that adding the NS3L loss to state-of-the-art SSL algorithms, such as the Virtual Adversarial Training (VAT), significantly improves upon vanilla VAT and its variant, VAT with Entropy Minimization. By adding the NS3L loss to MixMatch, the current state-of-the-art approach on semi-supervised tasks, we observe significant improvements over vanilla MixMatch. We conduct extensive experiments on the CIFAR10, CIFAR100, SVHN and STL10 benchmark datasets.
Code (1)
Similar Papers 제목 키워드 기반
Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification
Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-ba…
ClassificationClusteringContrastive LearningSemi-Supervised Text Classification+2Coherence Modeling Improves Implicit Discourse Relation Recognition
The research described in this paper examines how to learn linguistic knowledge associated with discourse relations from unlabeled corpora. We introduce an unsupervised learning method on text coherence that could produc…
Implicit Discourse Relation ClassificationRelationTransfer LearningPixel Contrastive-Consistent Semi-Supervised Semantic Segmentation
We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-s…
Computational EfficiencySegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationAre Negative Samples Necessary in Entity Alignment? An Approach with High Performance, Scalability and Robustness
Entity alignment (EA) aims to find the equivalent entities in different KGs, which is a crucial step in integrating multiple KGs. However, most existing EA methods have poor scalability and are unable to cope with large-…
Entity AlignmentGraph SamplingGuided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level …
3D Semantic SegmentationContrastive LearningPseudo LabelSemantic Segmentation