Neighborhood Contrastive Learning for Novel Class Discovery
In this paper, we address Novel Class Discovery (NCD), the task of unveiling new classes in a set of unlabeled samples given a labeled dataset with known classes. We exploit the peculiarities of NCD to build a new framework, named Neighborhood Contrastive Learning (NCL), to learn discriminative representations that are important to clustering performance. Our contribution is twofold. First, we find that a feature extractor trained on the labeled set generates representations in which a generic query sample and its neighbors are likely to share the same class. We exploit this observation to retrieve and aggregate pseudo-positive pairs with contrastive learning, thus encouraging the model to learn more discriminative representations. Second, we notice that most of the instances are easily discriminated by the network, contributing less to the contrastive loss. To overcome this issue, we propose to generate hard negatives by mixing labeled and unlabeled samples in the feature space. We experimentally demonstrate that these two ingredients significantly contribute to clustering performance and lead our model to outperform state-of-the-art methods by a large margin (e.g., clustering accuracy +13% on CIFAR-100 and +8% on ImageNet).
Code (1)
Tasks
ClusteringContrastive LearningNovel Class DiscoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neighborhood Commonality-aware Evolution Network for Continuous Generalized Category Discovery
Continuous Generalized Category Discovery (C-GCD) aims to continually discover novel classes from unlabelled image sets while maintaining performance on old classes. In this paper, we propose a novel learning framework, …
Contrastive LearningIncremental LearningKnowledge DistillationRepresentation LearningGraphVL: Graph-Enhanced Semantic Modeling via Vision-Language Models for Generalized Class Discovery
Generalized Category Discovery (GCD) aims to cluster unlabeled images into known and novel categories using labeled images from known classes. To address the challenge of transferring features from known to unknown class…
Language ModelingLanguage ModellingVirtual Category-Guided Continual Generalized Category Discovery
Continual Generalized Category Discovery (C-GCD) aims to incrementally identify novel categories from sequential unlabeled data while preserving recognition of known classes, which is an essential capability for open-wor…
Contrastive LearningUnveiling Contrastive Learning's Capability of Neighborhood Aggregation for Collaborative Filtering
Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-super…
Collaborative FilteringContrastive LearningData AugmentationMisconceptions+1MetaGCD: Learning to Continually Learn in Generalized Category Discovery
In this paper, we consider a real-world scenario where a model that is trained on pre-defined classes continually encounters unlabeled data that contains both known and novel classes. The goal is to continually discover …
Incremental LearningMeta-LearningNovel Class Discovery