Dual Progressive Prototype Network for Generalized Zero-Shot Learning

2021-11-03 · NeurIPS 2021 12 · Chaoqun Wang, Shaobo Min, Xuejin Chen, Xiaoyan Sun, Houqiang Li

Generalized Zero-Shot Learning (GZSL) aims to recognize new categories with auxiliary semantic information,e.g., category attributes. In this paper, we handle the critical issue of domain shift problem, i.e., confusion between seen and unseen categories, by progressively improving cross-domain transferability and category discriminability of visual representations. Our approach, named Dual Progressive Prototype Network (DPPN), constructs two types of prototypes that record prototypical visual patterns for attributes and categories, respectively. With attribute prototypes, DPPN alternately searches attribute-related local regions and updates corresponding attribute prototypes to progressively explore accurate attribute-region correspondence. This enables DPPN to produce visual representations with accurate attribute localization ability, which benefits the semantic-visual alignment and representation transferability. Besides, along with progressive attribute localization, DPPN further projects category prototypes into multiple spaces to progressively repel visual representations from different categories, which boosts category discriminability. Both attribute and category prototypes are collaboratively learned in a unified framework, which makes visual representations of DPPN transferable and distinctive. Experiments on four benchmarks prove that DPPN effectively alleviates the domain shift problem in GZSL.

📄 PDF Abstract BibTeX arXiv:2111.02073

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeGeneralized Zero-Shot Learning Zero-Shot Learning

Progressive Semantic-Visual Mutual Adaption for Generalized Zero-Shot Learning

2023-03-27 · CVPR 2023 1 · Man Liu, Feng Li, Chunjie Zhang, Yunchao Wei 외

Generalized Zero-Shot Learning (GZSL) identifies unseen categories by knowledge transferred from the seen domain, relying on the intrinsic interactions between visual and semantic information. Prior works mainly localize…

Attribute Decoder Generalized Zero-Shot Learning Zero-Shot Learning

Episode-based Prototype Generating Network for Zero-Shot Learning

2019-09-08 · CVPR 2020 6 · Yunlong Yu, Zhong Ji, Zhongfei Zhang, Jungong Han

We introduce a simple yet effective episode-based training framework for zero-shot learning (ZSL), where the learning system requires to recognize unseen classes given only the corresponding class semantics. During train…

zero-shot-classification Zero-Shot Learning

Generalized Zero-Shot Learning with Deep Calibration Network

2018-12-01 · NeurIPS 2018 12 · Shichen Liu, Mingsheng Long, Jian-Min Wang, Michael. I. Jordan

A technical challenge of deep learning is recognizing target classes without seen data. Zero-shot learning leverages semantic representations such as attributes or class prototypes to bridge source and target classes. Ex…

Generalized Zero-Shot Learning Zero-Shot Learning

Progressive Ensemble Networks for Zero-Shot Recognition

2018-05-18 · CVPR 2019 6 · Meng Ye, Yuhong Guo

Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. …

Diversity Generalized Zero-Shot Learning image-classification Image Classification+1

Bias-Awareness for Zero-Shot Learning the Seen and Unseen

2020-08-25 · William Thong, Cees G. M. Snoek

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We pro…