paper-with-me

홈 › Papers

Semantic Autoencoder for Zero-Shot Learning

2017-04-26 · CVPR 2017 7 · Elyor Kodirov, Tao Xiang, Shaogang Gong

Existing zero-shot learning (ZSL) models typically learn a projection function from a feature space to a semantic embedding space (e.g.~attribute space). However, such a projection function is only concerned with predicting the training seen class semantic representation (e.g.~attribute prediction) or classification. When applied to test data, which in the context of ZSL contains different (unseen) classes without training data, a ZSL model typically suffers from the project domain shift problem. In this work, we present a novel solution to ZSL based on learning a Semantic AutoEncoder (SAE). Taking the encoder-decoder paradigm, an encoder aims to project a visual feature vector into the semantic space as in the existing ZSL models. However, the decoder exerts an additional constraint, that is, the projection/code must be able to reconstruct the original visual feature. We show that with this additional reconstruction constraint, the learned projection function from the seen classes is able to generalise better to the new unseen classes. Importantly, the encoder and decoder are linear and symmetric which enable us to develop an extremely efficient learning algorithm. Extensive experiments on six benchmark datasets demonstrate that the proposed SAE outperforms significantly the existing ZSL models with the additional benefit of lower computational cost. Furthermore, when the SAE is applied to supervised clustering problem, it also beats the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:1704.08345

Code (4)

CristianoPatricio/zsl-methods tf
hoseong-kim/sae-pytorch pytorch
inars/developing_mc_for_zsl
mvp18/Popular-ZSL-Algorithms

Tasks

AttributeClusteringDecoderZero-Shot Learning

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Class label autoencoder for zero-shot learning

2018-01-25 · Guangfeng Lin, Caixia Fan, Wanjun Chen, Yajun Chen 외

Existing zero-shot learning (ZSL) methods usually learn a projection function between a feature space and a semantic embedding space(text or attribute space) in the training seen classes or testing unseen classes. Howeve…

AttributeDecoderDiversityzero-shot-classification+1

SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoders

2024-07-18 · Sheng-Wei Li, Zi-Xiang Wei, Wei-Jie Chen, Yi-Hsin Yu 외

Existing zero-shot skeleton-based action recognition methods utilize projection networks to learn a shared latent space of skeleton features and semantic embeddings. The inherent imbalance in action recognition datasets,…

Action RecognitionDisentanglementGeneralized Zero Shot skeletal action recognitionSkeleton Based Action Recognition+2

Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders

2020-09-18 · Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera

We present a novel generalized zero-shot algorithm to recognize perceived emotions from gestures. Our task is to map gestures to novel emotion categories not encountered in training. We introduce an adversarial, autoenco…

Generalized Zero-Shot LearningRepresentation LearningZero-Shot Learning

An Integral Projection-based Semantic Autoencoder for Zero-Shot Learning

2023-06-26 · William Heyden, Habib Ullah, M. Salman Siddiqui, Fadi Al Machot

Zero-shot Learning (ZSL) classification categorizes or predicts classes (labels) that are not included in the training set (unseen classes). Recent works proposed different semantic autoencoder (SAE) models where the enc…

DecoderZero-Shot Learning

Discriminative Embedding Autoencoder with a Regressor Feedback for Zero-Shot Learning

2019-07-18 · Ying Shi, Wei Wei, Zhiming Zheng

Zero-shot learning (ZSL) aims to recognize the novel object categories using the semantic representation of categories, and the key idea is to explore the knowledge of how the novel class is semantically related to the f…

DecoderGeneralized Zero-Shot LearningObject RecognitionZero-Shot Learning