paper-with-me

홈 › Papers

Scaling Up Deep Clustering Methods Beyond ImageNet-1K

2024-06-03 · Nikolas Adaloglou, Felix Michels, Kaspar Senft, Diana Petrusheva, Markus Kollmann

Deep image clustering methods are typically evaluated on small-scale balanced classification datasets while feature-based $k$-means has been applied on proprietary billion-scale datasets. In this work, we explore the performance of feature-based deep clustering approaches on large-scale benchmarks whilst disentangling the impact of the following data-related factors: i) class imbalance, ii) class granularity, iii) easy-to-recognize classes, and iv) the ability to capture multiple classes. Consequently, we develop multiple new benchmarks based on ImageNet21K. Our experimental analysis reveals that feature-based $k$-means is often unfairly evaluated on balanced datasets. However, deep clustering methods outperform $k$-means across most large-scale benchmarks. Interestingly, $k$-means underperforms on easy-to-classify benchmarks by large margins. The performance gap, however, diminishes on the highest data regimes such as ImageNet21K. Finally, we find that non-primary cluster predictions capture meaningful classes (i.e. coarser classes).

📄 PDF Abstract BibTeX arXiv:2406.01203

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDeep ClusteringImage Clustering

Similar Papers 제목 키워드 기반

Beyond neural scaling laws: beating power law scaling via data pruning

2022-06-29 · Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli 외

Widely observed neural scaling laws, in which error falls off as a power of the training set size, model size, or both, have driven substantial performance improvements in deep learning. However, these improvements throu…

Benchmarking

Objective-Based Hierarchical Clustering of Deep Embedding Vectors

2020-12-15 · Stanislav Naumov, Grigory Yaroslavtsev, Dmitrii Avdiukhin

We initiate a comprehensive experimental study of objective-based hierarchical clustering methods on massive datasets consisting of deep embedding vectors from computer vision and NLP applications. This includes a large …

ClusteringPlaying the Game of 2048SentenceSentence Embedding+2

Scalable Clustering: Large Scale Unsupervised Learning of Gaussian Mixture Models with Outliers

2023-02-28 · Yijia Zhou, Kyle A. Gallivan, Adrian Barbu

Clustering is a widely used technique with a long and rich history in a variety of areas. However, most existing algorithms do not scale well to large datasets, or are missing theoretical guarantees of convergence. This …

Clustering

Cluster and Predict Latents Patches for Improved Masked Image Modeling

2025-02-12 · Timothée Darcet, Federico Baldassarre, Maxime Oquab, Julien Mairal 외

Masked Image Modeling (MIM) offers a promising approach to self-supervised representation learning, however existing MIM models still lag behind the state-of-the-art. In this paper, we systematically analyze target repre…

Representation Learning

Beyond Uniform Scaling: Exploring Depth Heterogeneity in Neural Architectures

2024-02-19 · Akash Guna R. T, Arnav Chavan, Deepak Gupta

Conventional scaling of neural networks typically involves designing a base network and growing different dimensions like width, depth, etc. of the same by some predefined scaling factors. We introduce an automated scali…