paper-with-me

홈 › Papers

Learning Clusterable Visual Features for Zero-Shot Recognition

2020-10-07 · Jingyi Xu, Zhixin Shu, Dimitris Samaras

In zero-shot learning (ZSL), conditional generators have been widely used to generate additional training features. These features can then be used to train the classifiers for testing data. However, some testing data are considered "hard" as they lie close to the decision boundaries and are prone to misclassification, leading to performance degradation for ZSL. In this paper, we propose to learn clusterable features for ZSL problems. Using a Conditional Variational Autoencoder (CVAE) as the feature generator, we project the original features to a new feature space supervised by an auxiliary classification loss. To further increase clusterability, we fine-tune the features using Gaussian similarity loss. The clusterable visual features are not only more suitable for CVAE reconstruction but are also more separable which improves classification accuracy. Moreover, we introduce Gaussian noise to enlarge the intra-class variance of the generated features, which helps to improve the classifier's robustness. Our experiments on SUN,CUB, and AWA2 datasets show consistent improvement over previous state-of-the-art ZSL results by a large margin. In addition to its effectiveness on zero-shot classification, experiments show that our method to increase feature clusterability benefits few-shot learning algorithms as well.

📄 PDF Abstract BibTeX arXiv:2010.03245

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationFew-Shot LearningGeneral Classificationzero-shot-classificationZero-Shot Learning

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음
cVAE 설명 없음

Similar Papers 제목 키워드 기반

PEVA-Net: Prompt-Enhanced View Aggregation Network for Zero/Few-Shot Multi-View 3D Shape Recognition

2024-04-30 · Dongyun Lin, Yi Cheng, Shangbo Mao, Aiyuan Guo 외

Large vision-language models have impressively promote the performance of 2D visual recognition under zero/few-shot scenarios. In this paper, we focus on exploiting the large vision-language model, i.e., CLIP, to address…

3D Shape RecognitionFew-Shot LearningLanguage ModellingZero-Shot Learning

Learning the Redundancy-free Features for Generalized Zero-Shot Object Recognition

2020-06-16 · CVPR 2020 6 · Zongyan Han, Zhen-Yong Fu, Jian Yang

Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different …

Generalized Zero-Shot LearningObjectObject RecognitionZero-Shot Learning

Zero-Shot Skeleton-based Action Recognition with Dual Visual-Text Alignment

2024-09-22 · Jidong Kuang, Hongsong Wang, Chaolei Han, Jie Gui

Zero-shot action recognition, which addresses the issue of scalability and generalization in action recognition and allows the models to adapt to new and unseen actions dynamically, is an important research topic in comp…

Action RecognitionMetric LearningSkeleton Based Action RecognitionZero-Shot Action Recognition+1

Zero-Shot Activity Recognition with Videos

2020-01-22 · Evin Pinar Ornek

In this paper, we examined the zero-shot activity recognition task with the usage of videos. We introduce an auto-encoder based model to construct a multimodal joint embedding space between the visual and textual manifol…

Action RecognitionActivity RecognitionWord EmbeddingsZero-Shot Learning

Multi-Modal Zero-Shot Sign Language Recognition

2021-09-02 · Razieh Rastgoo, Kourosh Kiani, Sergio Escalera, Mohammad Sabokrou

Zero-Shot Learning (ZSL) has rapidly advanced in recent years. Towards overcoming the annotation bottleneck in the Sign Language Recognition (SLR), we explore the idea of Zero-Shot Sign Language Recognition (ZS-SLR) with…

Hand DetectionSign Language RecognitionZero-Shot Learning