Webly Supervised Learning Meets Zero-Shot Learning: A Hybrid Approach for Fine-Grained Classification
Fine-grained image classification, which targets at distinguishing subtle distinctions among various subordinate categories, remains a very difficult task due to the high annotation cost of enormous fine-grained categories. To cope with the scarcity of well-labeled training images, existing works mainly follow two research directions: 1) utilize freely available web images without human annotation; 2) only annotate some fine-grained categories and transfer the knowledge to other fine-grained categories, which falls into the scope of zero-shot learning (ZSL). However, the above two directions have their own drawbacks. For the first direction, the labels of web images are very noisy and the data distribution between web images and test images are considerably different. For the second direction, the performance gap between ZSL and traditional supervised learning is still very large. The drawbacks of the above two directions motivate us to design a new framework which can jointly leverage both web data and auxiliary labeled categories to predict the test categories that are not associated with any well-labeled training images. Comprehensive experiments on three benchmark datasets demonstrate the effectiveness of our proposed framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Fine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationZero-Shot LearningSimilar Papers 제목 키워드 기반
MoPro: Webly Supervised Learning with Momentum Prototypes
We propose a webly-supervised representation learning method that does not suffer from the annotation unscalability of supervised learning, nor the computation unscalability of self-supervised learning. Most existing wor…
Contrastive Learningimage-classificationImage ClassificationRepresentation Learning+1Unified Contrastive Learning in Image-Text-Label Space
Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result i…
Contrastive Learningimage-classificationImage ClassificationTransfer Learning+1Webly Supervised Fine-Grained Recognition: Benchmark Datasets and An Approach
Learning from the web can ease the extreme dependence of deep learning on large-scale manually labeled datasets. Especially for fine-grained recognition, which targets at distinguishing subordinate categories, it will si…
BenchmarkingLearning Visual N-Grams from Web Data
Real-world image recognition systems need to recognize tens of thousands of classes that constitute a plethora of visual concepts. The traditional approach of annotating thousands of images per class for training is infe…
Language ModelingLanguage ModellingRepresentation LearningRetrieval+1VL-Taboo: An Analysis of Attribute-based Zero-shot Capabilities of Vision-Language Models
Vision-language models trained on large, randomly collected data had significant impact in many areas since they appeared. But as they show great performance in various fields, such as image-text-retrieval, their inner w…
AttributeImage-text RetrievalRetrievalText Retrieval+1