Zero-Shot Image Classification Using Coupled Dictionary Embedding
Zero-shot learning (ZSL) is a framework to classify images belonging to unseen classes based on solely semantic information about these unseen classes. In this paper, we propose a new ZSL algorithm using coupled dictionary learning. The core idea is that the visual features and the semantic attributes of an image can share the same sparse representation in an intermediate space. We use images from seen classes and semantic attributes from seen and unseen classes to learn two dictionaries that can represent sparsely the visual and semantic feature vectors of an image. In the ZSL testing stage and in the absence of labeled data, images from unseen classes can be mapped into the attribute space by finding the joint sparse representation using solely the visual data. The image is then classified in the attribute space given semantic descriptions of unseen classes. We also provide an attribute-aware formulation to tackle domain shift and hubness problems in ZSL. Extensive experiments are provided to demonstrate the superior performance of our approach against the state of the art ZSL algorithms on benchmark ZSL datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeClassificationDictionary LearningGeneral Classificationimage-classificationImage ClassificationZero-Shot Image ClassificationZero-Shot LearningSimilar Papers 제목 키워드 기반
Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to Luxembourgish
In NLP, zero-shot classification (ZSC) is the task of assigning labels to textual data without any labeled examples for the target classes. A common method for ZSC is to fine-tune a language model on a Natural Language I…
Language ModellingNatural Language InferenceTopic Classificationzero-shot-classification+1Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfer
Knowledge transfer between tasks can improve the performance of learned models, but requires an accurate estimate of the inter-task relationships to identify the relevant knowledge to transfer. These inter-task relations…
BIG-bench Machine LearningDictionary LearningLifelong learningTransfer Learning+1CICA: Content-Injected Contrastive Alignment for Zero-Shot Document Image Classification
Zero-shot learning has been extensively investigated in the broader field of visual recognition, attracting significant interest recently. However, the current work on zero-shot learning in document image classification …
Document Classificationdocument-image-classificationDocument Image ClassificationGeneralized Zero-Shot Learning+3Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition
Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL app…
Dictionary LearningZero-Shot LearningThe Benefits of Label-Description Training for Zero-Shot Text Classification
Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose …
Classificationdomain classificationtext-classificationText Classification+3