Learning From Less Data: Diversified Subset Selection and Active Learning in Image Classification Tasks
Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data subset selection and active learning techniques have been proposed as possible solutions to these challenges respectively. A special class of subset selection functions naturally model notions of diversity, coverage and representation and they can be used to eliminate redundancy and thus lend themselves well for training data subset selection. They can also help improve the efficiency of active learning in further reducing human labeling efforts by selecting a subset of the examples obtained using the conventional uncertainty sampling based techniques. In this work we empirically demonstrate the effectiveness of two diversity models, namely the Facility-Location and Disparity-Min models for training-data subset selection and reducing labeling effort. We do this for a variety of computer vision tasks including Gender Recognition, Scene Recognition and Object Recognition. Our results show that subset selection done in the right way can add 2-3% in accuracy on existing baselines, particularly in the case of less training data. This allows the training of complex machine learning models (like Convolutional Neural Networks) with much less training data while incurring minimal performance loss.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningBIG-bench Machine LearningDiversityGeneral Classificationimage-classificationImage ClassificationObject RecognitionScene RecognitionSimilar Papers 제목 키워드 기반
Learning From Less Data: A Unified Data Subset Selection and Active Learning Framework for Computer Vision
Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry. Their data curation poses the challenges of expensive human labeling, inadequate computing resources and larger ex…
Active LearningBIG-bench Machine LearningDiversityFace Recognition+4Machine Learning meets Stochastic Geometry: Determinantal Subset Selection for Wireless Networks
In wireless networks, many problems can be formulated as subset selection problems where the goal is to select a subset from the ground set with the objective of maximizing some objective function. These problems are typ…
BIG-bench Machine LearningSchedulingActive Learning in Bayesian Neural Networks with Balanced Entropy Learning Principle
Acquiring labeled data is challenging in many machine learning applications with limited budgets. Active learning gives a procedure to select the most informative data points and improve data efficiency by reducing the c…
Active LearningGrain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization
Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However, recent deep learning models have moved …
Active LearningKnowledge GraphsDiversified Batch Selection for Training Acceleration
The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption. To save cost, a prevalent research line, known as online batch selection, explore…
Diversity