paper-with-me

홈 › Papers

Bidirectional Uncertainty-Based Active Learning for Open Set Annotation

2024-02-23 · Chen-Chen Zong, Ye-Wen Wang, Kun-Peng Ning, Hai-Bo Ye, Sheng-Jun Huang

Active learning (AL) in open set scenarios presents a novel challenge of identifying the most valuable examples in an unlabeled data pool that comprises data from both known and unknown classes. Traditional methods prioritize selecting informative examples with low confidence, with the risk of mistakenly selecting unknown-class examples with similarly low confidence. Recent methods favor the most probable known-class examples, with the risk of picking simple already mastered examples. In this paper, we attempt to query examples that are both likely from known classes and highly informative, and propose a Bidirectional Uncertainty-based Active Learning (BUAL) framework. Specifically, we achieve this by first pushing the unknown class examples toward regions with high-confidence predictions, i.e., the proposed Random Label Negative Learning method. Then, we propose a Bidirectional Uncertainty sampling strategy by jointly estimating uncertainty posed by both positive and negative learning to perform consistent and stable sampling. BUAL successfully extends existing uncertainty-based AL methods to complex open-set scenarios. Extensive experiments on multiple datasets with varying openness demonstrate that BUAL achieves state-of-the-art performance. The code is available at https://github.com/chenchenzong/BUAL.

📄 PDF Abstract BibTeX arXiv:2402.15198

Code (1)

chenchenzong/bual 공식 구현 pytorch

Tasks

Active Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Inconsistency-Based Data-Centric Active Open-Set Annotation

2024-01-10 · Ruiyu Mao, Ouyang Xu, Yunhui Guo

Active learning is a commonly used approach that reduces the labeling effort required to train deep neural networks. However, the effectiveness of current active learning methods is limited by their closed-world assumpti…

Active Learningvalid

OpenTag: Open Attribute Value Extraction from Product Profiles [Deep Learning, Active Learning, Named Entity Recognition]

2018-06-01 · Guineng Zheng, Subhabrata Mukherjee, Xin Luna Dong, Fei-Fei Li

Extraction of missing attribute values is to find values describing an attribute of interest from a free text input. Most past related work on extraction of missing attribute values work with a closed world assumption wi…

Active LearningAttributeAttribute Value ExtractionMissing Values+3

Rethinking Epistemic and Aleatoric Uncertainty for Active Open-Set Annotation: An Energy-Based Approach

2025-02-27 · CVPR 2025 1 · Chen-Chen Zong, Sheng-Jun Huang

Active learning (AL), which iteratively queries the most informative examples from a large pool of unlabeled candidates for model training, faces significant challenges in the presence of open-set classes. Existing metho…

Active Learning

An Active Learning Based Approach For Effective Video Annotation And Retrieval

2015-04-27 · Moitreya Chatterjee, Anton Leuski

Conventional multimedia annotation/retrieval systems such as Normalized Continuous Relevance Model (NormCRM) [16] require a fully labeled training data for a good performance. Active Learning, by determining an order for…

Active LearningClusteringDiversityRetrieval

Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates

2021-01-20 · EACL 2021 2 · Artem Shelmanov, Dmitri Puzyrev, Lyubov Kupriyanova, Denis Belyakov 외

Annotating training data for sequence tagging of texts is usually very time-consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to sign…

Active LearningTransfer Learning