Active Learning for Cost-Sensitive Classification
We design an active learning algorithm for cost-sensitive multiclass classification: problems where different errors have different costs. Our algorithm, COAL, makes predictions by regressing to each label's cost and predicting the smallest. On a new example, it uses a set of regressors that perform well on past data to estimate possible costs for each label. It queries only the labels that could be the best, ignoring the sure losers. We prove COAL can be efficiently implemented for any regression family that admits squared loss optimization; it also enjoys strong guarantees with respect to predictive performance and labeling effort. We empirically compare COAL to passive learning and several active learning baselines, showing significant improvements in labeling effort and test cost on real-world datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningClassificationGeneral ClassificationregressionSimilar Papers 제목 키워드 기반
Cost-Sensitive Active Learning for Incomplete Data
Practical data often suffer from missing attribute values and lack of class labels. A reasonable machine learning scenario involves obtaining certain values and labels at cost on request. In this article, we propose the …
Active LearningAttributeImputationNonparametric active learning for cost-sensitive classification
Cost-sensitive learning is a common type of machine learning problem where different errors of prediction incur different costs. In this paper, we design a generic nonparametric active learning algorithm for cost-sensiti…
Active LearningClassificationPredictionPrivacy-preserving Active Learning on Sensitive Data for User Intent Classification
Active learning holds promise of significantly reducing data annotation costs while maintaining reasonable model performance. However, it requires sending data to annotators for labeling. This presents a possible privacy…
Active LearningBinary ClassificationGeneral Classificationintent-classification+2Cost-Sensitive Reference Pair Encoding for Multi-Label Learning
Label space expansion for multi-label classification (MLC) is a methodology that encodes the original label vectors to higher dimensional codes before training and decodes the predicted codes back to the label vectors du…
Active LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label LearningSoft Methodology for Cost-and-error Sensitive Classification
Many real-world data mining applications need varying cost for different types of classification errors and thus call for cost-sensitive classification algorithms. Existing algorithms for cost-sensitive classification ar…
ClassificationGeneral Classification