Attribute-Based Classification for Zero-Shot Visual Object Categorization
We study the problem of object recognition for categories for which we have no training examples, a task also called zero-data or zero-shot learning. This situation has hardly been studied in computer vision research, even though it occurs frequently; the world contains tens of thousands of different object classes, and image collections have been formed and suitably annotated for only a few of them. To tackle the problem, we introduce attribute-based classification: Objects are identified based on a high-level description that is phrased in terms of semantic attributes, such as the object’s color or shape. Because the identification of each such property transcends the specific learning task at hand, the attribute classifiers can be prelearned independently, for example, from existing image data sets unrelated to the current task. Afterward, new classes can be detected based on their attribute representation, without the need for a new training phase. In this paper, we also introduce a new data set, Animals with Attributes, of over 30,000 images of 50 animal classes, annotated with 85 semantic attributes. Extensive experiments on this and two more data sets show that attribute-based classification indeed is able to categorize images without access to any training images of the target classes.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeClassificationObjectObject CategorizationObject RecognitionZero-Shot LearningSimilar Papers 제목 키워드 기반
PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts
Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unpre…
Classificationimage-classificationImage ClassificationLanguage Modelling+4Towards Visual Explainable Active Learning for Zero-Shot Classification
Zero-shot classification is a promising paradigm to solve an applicable problem when the training classes and test classes are disjoint. Achieving this usually needs experts to externalize their domain knowledge by manua…
Active LearningAttributeClassificationzero-shot-classification+1Attribute Prototype Network for Any-Shot Learning
Any-shot image classification allows to recognize novel classes with only a few or even zero samples. For the task of zero-shot learning, visual attributes have been shown to play an important role, while in the few-shot…
AttributeFew-Shot Image ClassificationGZSL Video Classificationimage-classification+3Zero-Shot Activity Recognition with Verb Attribute Induction
In this paper, we investigate large-scale zero-shot activity recognition by modeling the visual and linguistic attributes of action verbs. For example, the verb "salute" has several properties, such as being a light move…
Activity RecognitionAttributeSuper-class guided Transformer for Zero-Shot Attribute Classification
Attribute classification is crucial for identifying specific characteristics within image regions. Vision-Language Models (VLMs) have been effective in zero-shot tasks by leveraging their general knowledge from large-sca…
AttributeClassificationGeneral KnowledgeMulti-Label Classification+2