paper-with-me

Papers

En-Compactness: Self-Distillation Embedding & Contrastive Generation for Generalized Zero-Shot Learning

2022-01-01 · CVPR 2022 1 · Xia Kong, Zuodong Gao, Xiaofan Li, Ming Hong, Jun Liu, Chengjie Wang, Yuan Xie, Yanyun Qu

Generalized zero-shot learning (GZSL) requires a classifier trained on seen classes that can recognize objects from both seen and unseen classes. Due to the absence of unseen training samples, the classifier tends to bias towards seen classes. To mitigate this problem, feature generation based models are proposed to synthesize visual features for unseen classes. However, these features are generated in the visual feature space which lacks of discriminative ability. Therefore, some methods turn to find a better embedding space for the classifier training. They emphasize the inter-class relationships of seen classes, leading the embedding space overfitted to seen classes and unfriendly to unseen classes. Instead, in this paper, we propose an Intra-Class Compactness Enhancement method (ICCE) for GZSL. Our ICCE promotes intra-class compactness with inter-class separability on both seen and unseen classes in the embedding space and visual feature space. By promoting the intra-class relationships but the inter-class structures, we can distinguish different classes with better generalization. Specifically, we propose a Self-Distillation Embedding (SDE) module and a Semantic-Visual Contrastive Generation (SVCG) module. The former promotes intra-class compactness in the embedding space, while the latter accomplishes it in the visual feature space. The experiments demonstrate that our ICCE outperforms the state-of-the-art methods on four datasets and achieves competitive results on the remaining dataset.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Generalized Zero-Shot LearningZero-Shot Learning

Similar Papers 제목 키워드 기반

DiffusionTalker: Efficient and Compact Speech-Driven 3D Talking Head via Personalizer-Guided Distillation

2025-03-23 · Peng Chen, Xiaobao Wei, Ming Lu, Hui Chen 외

Real-time speech-driven 3D facial animation has been attractive in academia and industry. Traditional methods mainly focus on learning a deterministic mapping from speech to animation. Recent approaches start to consider…

3D Face Animation

Deep Clustering with Diffused Sampling and Hardness-aware Self-distillation

2024-01-25 · Hai-Xin Zhang, Dong Huang

Deep clustering has gained significant attention due to its capability in learning clustering-friendly representations without labeled data. However, previous deep clustering methods tend to treat all samples equally, wh…

ClusteringContrastive LearningDeep ClusteringKnowledge Distillation+2

MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation

2023-03-21 · Vitaliy Kinakh, Mariia Drozdova, Slava Voloshynovskiy

We present a new method of self-supervised learning and knowledge distillation based on the multi-views and multi-representations (MV-MR). The MV-MR is based on the maximization of dependence between learnable embeddings…

ClusteringContrastive LearningKnowledge DistillationLinear evaluation+3

ICD-Face: Intra-class Compactness Distillation for Face Recognition

2023-01-01 · ICCV 2023 1 · Zhipeng Yu, Jiaheng Liu, Haoyu Qin, Yichao Wu 외

Knowledge distillation is an effective model compression method to improve the performance of a lightweight student model by transferring the knowledge of a well-performed teacher model, which has been widely adopted…

Face RecognitionKnowledge DistillationModel Compression

Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations

2024-04-23 · Theo Lepage, Reda Dehak

Self-Supervised Learning (SSL) frameworks became the standard for learning robust class representations by benefiting from large unlabeled datasets. For Speaker Verification (SV), most SSL systems rely on contrastive-bas…

Self-Supervised LearningSpeaker Verification