paper-with-me

홈 › Papers

One-Bit Active Query With Contrastive Pairs

2022-01-01 · CVPR 2022 1 · Yuhang Zhang, Xiaopeng Zhang, Lingxi Xie, Jie Li, Robert C. Qiu, Hengtong Hu, Qi Tian

How to achieve better results with fewer labeling costs remains a challenging task. In this paper, we present a new active learning framework, which for the first time incorporates contrastive learning into recently proposed one-bit supervision. Here one-bit supervision denotes a simple Yes or No query about the correctness of the model's prediction, and is more efficient than previous active learning methods requiring assigning accurate labels to the queried samples. We claim that such one-bit information is intrinsically in accordance with the goal of contrastive loss that pulls positive pairs together and pushes negative samples away. Towards this goal, we design an uncertainty metric to actively select samples for query. These samples are then fed into different branches according to the queried results. The Yes query is treated as positive pairs of the queried category for contrastive pulling, while the No query is treated as hard negative pairs for contrastive repelling. Additionally, we design a negative loss that penalizes the negative samples away from the incorrect predicted class, which can be treated as optimizing hard negatives for the corresponding category. Our method, termed as ObCP, produces a more powerful active learning framework, and experiments on several benchmarks demonstrate its superiority.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningContrastive Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Momentum Contrastive Pre-training for Question Answering

2022-12-12 · Minda Hu, Muzhi Li, Yasheng Wang, Irwin King

Existing pre-training methods for extractive Question Answering (QA) generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-trained models to simple keyword matching. In…

BenchmarkingContrastive LearningExtractive Question-AnsweringNatural Questions+1

Oracle-guided Contrastive Clustering

2022-11-01 · Mengdie Wang, Liyuan Shang, Suyun Zhao, Yiming Wang 외

Deep clustering aims to learn a clustering representation through deep architectures. Most of the existing methods usually conduct clustering with the unique goal of maximizing clustering performance, that ignores the pe…

Active LearningClusteringContrastive LearningDeep Clustering

EqCo: Equivalent Rules for Self-supervised Contrastive Learning

2020-10-05 · Benjin Zhu, Junqiang Huang, Zeming Li, Xiangyu Zhang 외

In this paper, we propose EqCo (Equivalent Rules for Contrastive Learning) to make self-supervised learning irrelevant to the number of negative samples in the contrastive learning framework. Inspired by the InfoMax prin…

Contrastive LearningLinear evaluationSelf-Supervised Learning

Contrastive Fine-tuning Improves Robustness for Neural Rankers

2021-05-27 · Findings (ACL) 2021 8 · Xiaofei Ma, Cicero Nogueira dos santos, Andrew O. Arnold

The performance of state-of-the-art neural rankers can deteriorate substantially when exposed to noisy inputs or applied to a new domain. In this paper, we present a novel method for fine-tuning neural rankers that can s…

Data AugmentationPassage Ranking

Mitigating Sampling Bias and Improving Robustness in Active Learning

2021-09-13 · Ranganath Krishnan, Alok Sinha, Nilesh Ahuja, Mahesh Subedar 외

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leverag…

Active Learning