paper-with-me

홈 › Papers

Nearest Neighbor Classifier with Margin Penalty for Active Learning

2022-03-17 · Yuan Cao, Zhiqiao Gao, Jie Hu, MingChuan Yang, Jinpeng Chen

As deep learning becomes the mainstream in the field of natural language processing, the need for suitable active learning method are becoming unprecedented urgent. Active Learning (AL) methods based on nearest neighbor classifier are proposed and demonstrated superior results. However, existing nearest neighbor classifier are not suitable for classifying mutual exclusive classes because inter-class discrepancy cannot be assured by nearest neighbor classifiers. As a result, informative samples in the margin area can not be discovered and AL performance are damaged. To this end, we propose a novel Nearest neighbor Classifier with Margin penalty for Active Learning(NCMAL). Firstly, mandatory margin penalty are added between classes, therefore both inter-class discrepancy and intra-class compactness are both assured. Secondly, a novel sample selection strategy are proposed to discover informative samples within the margin area. To demonstrate the effectiveness of the methods, we conduct extensive experiments on for datasets with other state-of-the-art methods. The experimental results demonstrate that our method achieves better results with fewer annotated samples than all baseline methods.

📄 PDF Abstract BibTeX arXiv:2203.09174

Code (1)

GhostAnderson/Nearest-Neighbor-Classifier-with-Margin-Penalty-for-Active-Learning 공식 구현 pytorch

Tasks

Active Learning

Similar Papers 제목 키워드 기반

Active Nearest-Neighbor Learning in Metric Spaces

2016-05-22 · NeurIPS 2016 12 · Aryeh Kontorovich, Sivan Sabato, Ruth Urner

We propose a pool-based non-parametric active learning algorithm for general metric spaces, called MArgin Regularized Metric Active Nearest Neighbor (MARMANN), which outputs a nearest-neighbor classifier. We give predict…

Active LearningModel Selection

A Two-Stage Active Learning Algorithm for $k$-Nearest Neighbors

2022-11-19 · Nick Rittler, Kamalika Chaudhuri

$k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design ac…

Active LearningVocal Bursts Valence Prediction

A Bayes consistent 1-NN classifier

2014-07-01 · Aryeh Kontorovich, Roi Weiss

We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor…

Maximum Margin Multiclass Nearest Neighbors

2014-01-30 · Aryeh Kontorovich, Roi Weiss

We develop a general framework for margin-based multicategory classification in metric spaces. The basic work-horse is a margin-regularized version of the nearest-neighbor classifier. We prove generalization bounds that …

Generalization Bounds

Distributed Adaptive Nearest Neighbor Classifier: Algorithm and Theory

2021-05-20 · Ruiqi Liu, Ganggang Xu, Zuofeng Shang

When data is of an extraordinarily large size or physically stored in different locations, the distributed nearest neighbor (NN) classifier is an attractive tool for classification. We propose a novel distributed adaptiv…