paper-with-me

홈 › Papers

Beyond Known Clusters: Probe New Prototypes for Efficient Generalized Class Discovery

2024-04-13 · Ye Wang, Yaxiong Wang, Yujiao Wu, Bingchen Zhao, Xueming Qian

Generalized Class Discovery (GCD) aims to dynamically assign labels to unlabelled data partially based on knowledge learned from labelled data, where the unlabelled data may come from known or novel classes. The prevailing approach generally involves clustering across all data and learning conceptions by prototypical contrastive learning. However, existing methods largely hinge on the performance of clustering algorithms and are thus subject to their inherent limitations. Firstly, the estimated cluster number is often smaller than the ground truth, making the existing methods suffer from the lack of prototypes for comprehensive conception learning. To address this issue, we propose an adaptive probing mechanism that introduces learnable potential prototypes to expand cluster prototypes (centers). As there is no ground truth for the potential prototype, we develop a self-supervised prototype learning framework to optimize the potential prototype in an end-to-end fashion. Secondly, clustering is computationally intensive, and the conventional strategy of clustering both labelled and unlabelled instances exacerbates this issue. To counteract this inefficiency, we opt to cluster only the unlabelled instances and subsequently expand the cluster prototypes with our introduced potential prototypes to fast explore novel classes. Despite the simplicity of our proposed method, extensive empirical analysis on a wide range of datasets confirms that our method consistently delivers state-of-the-art results. Specifically, our method surpasses the nearest competitor by a significant margin of 9.7% within the Stanford Cars dataset and 12x clustering efficiency within the Herbarium 19 dataset. We will make the code and checkpoints publicly available at https://github.com/xjtuYW/PNP.git.

📄 PDF Abstract BibTeX arXiv:2404.08995

Code (1)

xjtuyw/pnp 공식 구현 pytorch

Tasks

ClusteringContrastive Learning

Methods 이 논문이 사용한 방법론

OPT OPT is a suite of decoder-only pre-trained transformers ranging from 125M to 175B parameters. The model uses an AdamW optimizer and weight decay of 0.1. It follows a linear…

Similar Papers 제목 키워드 기반

Transfer and Alignment Network for Generalized Category Discovery

2023-12-27 · Wenbin An, Feng Tian, Wenkai Shi, Yan Chen 외

Generalized Category Discovery is a crucial real-world task. Despite the improved performance on known categories, current methods perform poorly on novel categories. We attribute the poor performance to two reasons: bia…

AttributeRepresentation LearningTransfer Learning

Federated Hierarchical Clustering with Automatic Selection of Optimal Cluster Numbers

2026-03-13 · Yue Zhang, Chuanlong Qiu, Xinfa Liao, Yiqun Zhang arxiv

Federated Clustering (FC) is an emerging and promising solution in exploring data distribution patterns from distributed and privacy-protected data in an unsupervised manner. Existing FC methods implicitly rely on the as…

Federated Learning

Reconstructing Galaxy Cluster Mass Maps using Score-based Generative Modeling

2024-10-03 · Alan Hsu, Matthew Ho, Joyce Lin, Carleen Markey 외

We present a novel approach to reconstruct gas and dark matter projected density maps of galaxy clusters using score-based generative modeling. Our diffusion model takes in mock SZ and X-ray images as conditional observa…

Unity

Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detection

2022-07-22 · Zhiwei Yang, Peng Wu, Jing Liu, Xiaotao Liu

Existing methods for anomaly detection based on memory-augmented autoencoder (AE) have the following drawbacks: (1) Establishing a memory bank requires additional memory space. (2) The fixed number of prototypes from sub…

Anomaly DetectionDiversity

Visual and Semantic Prototypes-Jointly Guided CNN for Generalized Zero-shot Learning

2019-08-12 · Chuanxing Geng, Lue Tao, Songcan Chen

In the process of exploring the world, the curiosity constantly drives humans to cognize new things. Supposing you are a zoologist, for a presented animal image, you can recognize it immediately if you know its class. Ot…

Generalized Zero-Shot LearningOpen Set LearningZero-Shot Learning