Weakly Supervised Representation Learning with Coarse Labels
With the development of computational power and techniques for data collection, deep learning demonstrates a superior performance over most existing algorithms on visual benchmark data sets. Many efforts have been devoted to studying the mechanism of deep learning. One important observation is that deep learning can learn the discriminative patterns from raw materials directly in a task-dependent manner. Therefore, the representations obtained by deep learning outperform hand-crafted features significantly. However, for some real-world applications, it is too expensive to collect the task-specific labels, such as visual search in online shopping. Compared to the limited availability of these task-specific labels, their coarse-class labels are much more affordable, but representations learned from them can be suboptimal for the target task. To mitigate this challenge, we propose an algorithm to learn the fine-grained patterns for the target task, when only its coarse-class labels are available. More importantly, we provide a theoretical guarantee for this. Extensive experiments on real-world data sets demonstrate that the proposed method can significantly improve the performance of learned representations on the target task, when only coarse-class information is available for training. Code is available at \url{https://github.com/idstcv/CoIns}.
Code (1)
Tasks
Deep LearningLearning with coarse labelsRepresentation LearningSimilar Papers 제목 키워드 기반
Weakly supervised clustering: Learning fine-grained signals from coarse labels
Consider a classification problem where we do not have access to labels for individual training examples, but only have average labels over subpopulations. We give practical examples of this setup and show how such a cla…
ClassificationClusteringGeneral ClassificationLeveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation
Semantic segmentation is a challenging task in the absence of densely labelled data. Only relying on class activation maps (CAM) with image-level labels provides deficient segmentation supervision. Prior works thus consi…
Auxiliary Learningimage-classificationImage ClassificationMulti-Label Image Classification+7A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labels
Fully-supervised salient object detection (SOD) methods have made great progress, but such methods often rely on a large number of pixel-level annotations, which are time-consuming and labour-intensive. In this paper, we…
object-detectionObject DetectionRGB Salient Object DetectionSaliency Detection+2Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actions
Action understanding has evolved into the era of fine granularity, as most human behaviors in real life have only minor differences. To detect these fine-grained actions accurately in a label-efficient way, we tackle the…
Action DetectionAction UnderstandingFine-Grained Action DetectionWeakly Supervised Action LocalizationA Weakly Supervised Fine Label Classifier Enhanced by Coarse Supervision
Objects are usually organized in a hierarchical structure in which each coarse category (e.g., big cat) corresponds to a superclass of several fine categories (e.g., cheetah, leopard). The objects grouped within the same…
ClassificationGeneral Classificationimage-classificationImage Classification