Learning a Deep ConvNet for Multi-label Classification with Partial Labels
Deep ConvNets have shown great performance for single-label image classification (e.g. ImageNet), but it is necessary to move beyond the single-label classification task because pictures of everyday life are inherently multi-label. Multi-label classification is a more difficult task than single-label classification because both the input images and output label spaces are more complex. Furthermore, collecting clean multi-label annotations is more difficult to scale-up than single-label annotations. To reduce the annotation cost, we propose to train a model with partial labels i.e. only some labels are known per image. We first empirically compare different labeling strategies to show the potential for using partial labels on multi-label datasets. Then to learn with partial labels, we introduce a new classification loss that exploits the proportion of known labels per example. Our approach allows the use of the same training settings as when learning with all the annotations. We further explore several curriculum learning based strategies to predict missing labels. Experiments are performed on three large-scale multi-label datasets: MS COCO, NUS-WIDE and Open Images.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral Classificationimage-classificationImage ClassificationMissing LabelsMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-label Image Recognition with Partial LabelsSimilar Papers 제목 키워드 기반
Human-annotated label noise and their impact on ConvNets for remote sensing image scene classification
Convolutional neural networks (ConvNets) have been successfully applied to satellite image scene classification. Human-labeled training datasets are essential for ConvNets to perform accurate classification. Errors in hu…
Scene ClassificationOn the Importance of Label Quality for Semantic Segmentation
Convolutional networks (ConvNets) have become the dominant approach to semantic image segmentation. Producing accurate, pixel--level labels required for this task is a tedious and time consuming process; however, produci…
Image SegmentationSemantic SegmentationvalidDeep Label Distribution Learning with Label Ambiguity
Convolutional Neural Networks (ConvNets) have achieved excellent recognition performance in various visual recognition tasks. A large labeled training set is one of the most important factors for its success. However, it…
Age EstimationClassificationGeneral ClassificationHead Pose Estimation+4Bridging the Gap between Model Explanations in Partially Annotated Multi-label Classification
Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task i…
ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONDo Convnets Learn Correspondence?
Convolutional neural nets (convnets) trained from massive labeled datasets have substantially improved the state-of-the-art in image classification and object detection. However, visual understanding requires establishin…
General Classificationimage-classificationImage ClassificationKeypoint Detection+2