paper-with-me

Papers

Instance Adaptive Prototypical Contrastive Embedding for Generalized Zero Shot Learning

2023-09-13 · Riti Paul, Sahil Vora, Baoxin Li

Generalized zero-shot learning(GZSL) aims to classify samples from seen and unseen labels, assuming unseen labels are not accessible during training. Recent advancements in GZSL have been expedited by incorporating contrastive-learning-based (instance-based) embedding in generative networks and leveraging the semantic relationship between data points. However, existing embedding architectures suffer from two limitations: (1) limited discriminability of synthetic features' embedding without considering fine-grained cluster structures; (2) inflexible optimization due to restricted scaling mechanisms on existing contrastive embedding networks, leading to overlapped representations in the embedding space. To enhance the quality of representations in the embedding space, as mentioned in (1), we propose a margin-based prototypical contrastive learning embedding network that reaps the benefits of prototype-data (cluster quality enhancement) and implicit data-data (fine-grained representations) interaction while providing substantial cluster supervision to the embedding network and the generator. To tackle (2), we propose an instance adaptive contrastive loss that leads to generalized representations for unseen labels with increased inter-class margin. Through comprehensive experimental evaluation, we show that our method can outperform the current state-of-the-art on three benchmark datasets. Our approach also consistently achieves the best unseen performance in the GZSL setting.

📄 PDF Abstract BibTeX arXiv:2309.06987

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningGeneralized Zero-Shot LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Prototypical Contrastive Learning of Unsupervised Representations

2020-05-11 · ICLR 2021 1 · Junnan Li, Pan Zhou, Caiming Xiong, Steven C. H. Hoi

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level …

ClusteringContrastive LearningRepresentation LearningSelf-Supervised Image Classification+2

Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation

2022-10-18 · Shentong Mo, Zhun Sun, Chao Li

Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize…

Contrastive LearningDiversitySelf-Supervised Learning

Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embedding

2022-11-07 · Jiali Zeng, Yongjing Yin, Yufan Jiang, Shuangzhi Wu 외

Contrastive learning has become a new paradigm for unsupervised sentence embeddings. Previous studies focus on instance-wise contrastive learning, attempting to construct positive pairs with textual data augmentation. In…

ClusteringContrastive LearningData AugmentationSemantic Textual Similarity+4

Prototypical Contrastive Learning and Adaptive Interest Selection for Candidate Generation in Recommendations

2022-11-23 · Ningning Li, Qunwei Li, Xichen Ding, Shaohu Chen 외

Deep Candidate Generation plays an important role in large-scale recommender systems. It takes user history behaviors as inputs and learns user and item latent embeddings for candidate generation. In the literature, conv…

Contrastive LearningRecommendation Systems

Prototypical Representation Learning for Low-resource Knowledge Extraction: Summary and Perspective

2022-01-17 · ICLR Track Blog 2022 5 · Anonymous

Recent years have witnessed the success of prototypical representation in widespread low-resource tasks, since "Prototypical Networks for Few-shot Learning (NeurIPS 2017)" proposed to represent each class as a prototype …

Contrastive LearningFew-Shot LearningRelation ExtractionRepresentation Learning