Contrastive Mean-Shift Learning for Generalized Category Discovery
We address the problem of generalized category discovery (GCD) that aims to partition a partially labeled collection of images; only a small part of the collection is labeled and the total number of target classes is unknown. To address this generalized image clustering problem, we revisit the mean-shift algorithm, i.e., a classic, powerful technique for mode seeking, and incorporate it into a contrastive learning framework. The proposed method, dubbed Contrastive Mean-Shift (CMS) learning, trains an image encoder to produce representations with better clustering properties by an iterative process of mean shift and contrastive update. Experiments demonstrate that our method, both in settings with and without the total number of clusters being known, achieves state-of-the-art performance on six public GCD benchmarks without bells and whistles.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringContrastive LearningImage ClusteringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Fresh Look at Generalized Category Discovery through Non-negative Matrix Factorization
Generalized Category Discovery (GCD) aims to classify both base and novel images using labeled base data. However, current approaches inadequately address the intrinsic optimization of the co-occurrence matrix $\bar{A}$ …
Contrastive LearningGeneralized Category Discovery
In this paper, we consider a highly general image recognition setting wherein, given a labelled and unlabelled set of images, the task is to categorize all images in the unlabelled set. Here, the unlabelled images may co…
Fine-Grained Visual RecognitionOpen-World Semi-Supervised LearningRepresentation LearningXCon: Learning with Experts for Fine-grained Category Discovery
We address the problem of generalized category discovery (GCD) in this paper, i.e. clustering the unlabeled images leveraging the information from a set of seen classes, where the unlabeled images could contain both seen…
ClusteringContrastive LearningNovel ConceptsGLEAN: Generalized Category Discovery with Diverse and Quality-Enhanced LLM Feedback
Generalized Category Discovery (GCD) is a practical and challenging open-world task that aims to recognize both known and novel categories in unlabeled data using limited labeled data from known categories. Due to the la…
Generalized Category Discovery under Domain Shift: A Frequency Domain Perspective
Generalized Category Discovery (GCD) aims to leverage labeled samples from known categories to cluster unlabeled data that may include both known and unknown categories. While existing methods have achieved impressive re…