paper-with-me

Papers

MixPUL: Consistency-based Augmentation for Positive and Unlabeled Learning

2020-04-20 · Tong Wei, Feng Shi, Hai Wang, Wei-Wei Tu. Yu-Feng Li

Learning from positive and unlabeled data (PU learning) is prevalent in practical applications where only a couple of examples are positively labeled. Previous PU learning studies typically rely on existing samples such that the data distribution is not extensively explored. In this work, we propose a simple yet effective data augmentation method, coined~\algo, based on \emph{consistency regularization} which provides a new perspective of using PU data. In particular, the proposed~\algo~incorporates supervised and unsupervised consistency training to generate augmented data. To facilitate supervised consistency, reliable negative examples are mined from unlabeled data due to the absence of negative samples. Unsupervised consistency is further encouraged between unlabeled datapoints. In addition,~\algo~reduces margin loss between positive and unlabeled pairs, which explicitly optimizes AUC and yields faster convergence. Finally, we conduct a series of studies to demonstrate the effectiveness of consistency regularization. We examined three kinds of reliable negative mining methods. We show that~\algo~achieves an averaged improvement of classification error from 16.49 to 13.09 on the CIFAR-10 dataset across different positive data amount.

📄 PDF Abstract BibTeX arXiv:2004.09388

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Positive-Unlabeled Learning with Adversarial Data Augmentation for Knowledge Graph Completion

2022-05-02 · Zhenwei Tang, Shichao Pei, Zhao Zhang, Yongchun Zhu 외

Most real-world knowledge graphs (KG) are far from complete and comprehensive. This problem has motivated efforts in predicting the most plausible missing facts to complete a given KG, i.e., knowledge graph completion (K…

Data AugmentationKnowledge Graph CompletionKnowledge GraphsWorld Knowledge

Efficient Semi-supervised Consistency Training for Natural Language Understanding

2022-07-01 · NAACL (ACL) 2022 7 · George Leung, Joshua Tan

Manually labeled training data is expensive, noisy, and often scarce, such as when developing new features or localizing existing features for a new region. In cases where labeled data is limited but unlabeled data is ab…

Data Augmentationdomain classificationNatural Language UnderstandingTranslation

Boosting Semi-Supervised 2D Human Pose Estimation by Revisiting Data Augmentation and Consistency Training

2024-02-18 · Huayi Zhou, Mukun Luo, Fei Jiang, Yue Ding 외

The 2D human pose estimation (HPE) is a basic visual problem. However, its supervised learning requires massive keypoint labels, which is labor-intensive to collect. Thus, we aim at boosting a pose estimator by excavatin…

2D Human Pose EstimationData AugmentationPose Estimation

Split-PU: Hardness-aware Training Strategy for Positive-Unlabeled Learning

2022-11-30 · Chengming Xu, Chen Liu, Siqian Yang, Yabiao Wang 외

Positive-Unlabeled (PU) learning aims to learn a model with rare positive samples and abundant unlabeled samples. Compared with classical binary classification, the task of PU learning is much more challenging due to the…

Binary Classification

Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data

2020-10-22 · EMNLP 2021 11 · David Lowell, Brian E. Howard, Zachary C. Lipton, Byron C. Wallace

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noise…

Data Augmentationtext-classificationText ClassificationTranslation