Simple and effective localized attribute representations for zero-shot learning
Zero-shot learning (ZSL) aims to discriminate images from unseen classes by exploiting relations to seen classes via their semantic descriptions. Some recent papers have shown the importance of localized features together with fine-tuning the feature extractor to obtain discriminative and transferable features. However, these methods require complex attention or part detection modules to perform explicit localization in the visual space. In contrast, in this paper we propose localizing representations in the semantic/attribute space, with a simple but effective pipeline where localization is implicit. Focusing on attribute representations, we show that our method obtains state-of-the-art performance on CUB and SUN datasets, and also achieves competitive results on AWA2 dataset, outperforming generally more complex methods with explicit localization in the visual space. Our method can be implemented easily, which can be used as a new baseline for zero shot-learning. In addition, our localized representations are highly interpretable as attribute-specific heatmaps.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeZero-Shot LearningSimilar Papers 제목 키워드 기반
Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approach
Vision-Language Models (VLMs) like CLIP achieve cross-modal semantic alignment through contrastive learning, exhibiting robust zero-shot generalization. Traditional prompt engineering, however, predominantly relies on co…
AttributeContrastive LearningPrompt EngineeringTest-time Adaptation+1Zero-Shot Learning by Generating Pseudo Feature Representations
Zero-shot learning (ZSL) is a challenging task aiming at recognizing novel classes without any training instances. In this paper we present a simple but high-performance ZSL approach by generating pseudo feature represen…
AttributeNovel ConceptsRetrievalZero-Shot LearningLAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual-Text Alignment
Zero-shot recognition aims to classify an image by selecting the most compatible label description from a set of candidate classes without any task-specific supervision. In fine-grained settings, however, the relevant ev…
Towards Zero-shot Sign Language Recognition
This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, r…
AttributeDescriptiveSign Language RecognitionTransfer Learning+1Zero-Shot Activity Recognition with Verb Attribute Induction
In this paper, we investigate large-scale zero-shot activity recognition by modeling the visual and linguistic attributes of action verbs. For example, the verb "salute" has several properties, such as being a light move…
Activity RecognitionAttribute