Label-Embedding for Image Classification
Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce. We propose to view attribute-based image classification as a label-embedding problem: each class is embedded in the space of attribute vectors. We introduce a function that measures the compatibility between an image and a label embedding. The parameters of this function are learned on a training set of labeled samples to ensure that, given an image, the correct classes rank higher than the incorrect ones. Results on the Animals With Attributes and Caltech-UCSD-Birds datasets show that the proposed framework outperforms the standard Direct Attribute Prediction baseline in a zero-shot learning scenario. Label embedding enjoys a built-in ability to leverage alternative sources of information instead of or in addition to attributes, such as e.g. class hierarchies or textual descriptions. Moreover, label embedding encompasses the whole range of learning settings from zero-shot learning to regular learning with a large number of labeled examples.
Code (2)
Tasks
AttributeClassificationGeneral Classificationimage-classificationImage ClassificationMulti-label zero-shot learningZero-Shot Action RecognitionZero-Shot LearningSimilar Papers 제목 키워드 기반
Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classification
Multi-label image and video classification are fundamental yet challenging tasks in computer vision. The main challenges lie in capturing spatial or temporal dependencies between labels and discovering the locations of d…
ClassificationGeneral ClassificationGraph Embeddingimage-classification+5Zero-Shot Recognition through Image-Guided Semantic Classification
We present a new embedding-based framework for zero-shot learning (ZSL). Most embedding-based methods aim to learn the correspondence between an image classifier (visual representation) and its class prototype (semantic …
ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Evaluation of Output Embeddings for Fine-Grained Image Classification
Image classification has advanced significantly in recent years with the availability of large-scale image sets. However, fine-grained classification remains a major challenge due to the annotation cost of large numbers …
ClassificationFew-Shot Image ClassificationFine-Grained Image ClassificationGeneral Classification+5Learning Image Conditioned Label Space for Multilabel Classification
This work addresses the task of multilabel image classification. Inspired by the great success from deep convolutional neural networks (CNNs) for single-label visual-semantic embedding, we exploit extending these models …
ClassificationGeneral Classificationimage-classificationImage ClassificationMulti-Instance Visual-Semantic Embedding
Visual-semantic embedding models have been recently proposed and shown to be effective for image classification and zero-shot learning, by mapping images into a continuous semantic label space. Although several approache…
General Classificationimage-classificationImage ClassificationZero-Shot Learning