Information based Deep Clustering: An experimental study
Recently, two methods have shown outstanding performance for clustering images and jointly learning the feature representation. The first, called Information Maximiz-ing Self-Augmented Training (IMSAT), maximizes the mutual information between input and clusters while using a regularization term based on virtual adversarial examples. The second, named Invariant Information Clustering (IIC), maximizes the mutual information between the clustering of a sample and its geometrically transformed version. These methods use mutual information in distinct ways and leverage different kinds of transformations. This work proposes a comprehensive analysis of transformation and losses for deep clustering, where we compare numerous combinations of these two components and evaluate how they interact with one another. Results suggest that mutual information between a sample and its transformed representation leads to state-of-the-art performance for deep clustering, especially when used jointly with geometrical and adversarial transformations.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDeep ClusteringSimilar Papers 제목 키워드 기반
Acoustic Scene Clustering Using Joint Optimization of Deep Embedding Learning and Clustering Iteration
Recent efforts have been made on acoustic scene classification in the audio signal processing community. In contrast, few studies have been conducted on acoustic scene clustering, which is a newly emerging problem. Acous…
Acoustic Scene ClassificationAudio Signal ProcessingClusteringScene ClassificationA new keyphrases extraction method based on suffix tree data structure for arabic documents clustering
Document Clustering is a branch of a larger area of scientific study known as data mining .which is an unsupervised classification using to find a structure in a collection of unlabeled data. The useful information in th…
ClusteringDeep Fair Discriminative Clustering
Deep clustering has the potential to learn a strong representation and hence better clustering performance compared to traditional clustering methods such as $k$-means and spectral clustering. However, this strong repres…
ClusteringDeep ClusteringFairnessRepresentation LearningClustering with Deep Learning: Taxonomy and New Methods
Clustering methods based on deep neural networks have proven promising for clustering real-world data because of their high representational power. In this paper, we propose a systematic taxonomy of clustering methods th…
ClusteringDeep LearningDeep Graph-Level Clustering Using Pseudo-Label-Guided Mutual Information Maximization Network
In this work, we study the problem of partitioning a set of graphs into different groups such that the graphs in the same group are similar while the graphs in different groups are dissimilar. This problem was rarely stu…
ClusteringGraph ClassificationNode ClusteringPseudo Label+1