Latent Embeddings for Zero-shot Classification
We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model by incorporating latent variables. Instead of learning a single bilinear map, it learns a collection of maps with the selection, of which map to use, being a latent variable for the current image-class pair. We train the model with a ranking based objective function which penalizes incorrect rankings of the true class for a given image. We empirically demonstrate that our model improves the state-of-the-art for various class embeddings consistently on three challenging publicly available datasets for the zero-shot setting. Moreover, our method leads to visually highly interpretable results with clear clusters of different fine-grained object properties that correspond to different latent variable maps.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral Classificationzero-shot-classificationZero-Shot LearningSimilar Papers 제목 키워드 기반
Latent Embedding Feedback and Discriminative Features for Zero-Shot Classification
Zero-shot learning strives to classify unseen categories for which no data is available during training. In the generalized variant, the test samples can further belong to seen or unseen categories. The state-of-the-art …
Action ClassificationClassificationDecoderGeneral Classification+3Deep Learning Approaches for Blood Disease Diagnosis Across Hematopoietic Lineages
We present a foundation modeling framework that leverages deep learning to uncover latent genetic signatures across the hematopoietic hierarchy. Our approach trains a fully connected autoencoder on multipotent progenitor…
Binary ClassificationClassificationDeep LearningMulti-class ClassificationImproving Audio Classification by Transitioning from Zero- to Few-Shot
State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated …
Contrastive LearningAudio ClassificationCross-Linked Variational Autoencoders for Generalized Zero-Shot Learning
Most approaches in generalized zero-shot learning rely on cross-modal mapping between an image feature space and a class embedding space or on generating artificial image features. However, learning a shared cross-modal …
Few-Shot LearningGeneralized Zero-Shot LearningZero-Shot LearningGeneralized Zero- and Few-Shot Learning via Aligned Variational Autoencoders
Many approaches in generalized zero-shot learning rely on cross-modal mapping between the image feature space and the class embedding space. As labeled images are expensive, one direction is to augment the dataset by gen…
Few-Shot LearningGeneralized Few-Shot LearningGeneralized Zero-Shot LearningZero-Shot Learning+1