Deep clustering using adversarial net based clustering loss
Deep clustering is a recent deep learning technique which combines deep learning with traditional unsupervised clustering. At the heart of deep clustering is a loss function which penalizes samples for being an outlier from their ground truth cluster centers in the latent space. The probabilistic variant of deep clustering reformulates the loss using KL divergence. Often, the main constraint of deep clustering is the necessity of a closed form loss function to make backpropagation tractable. Inspired by deep clustering and adversarial net, we reformulate deep clustering as an adversarial net over traditional closed form KL divergence. Training deep clustering becomes a task of minimizing the encoder and maximizing the discriminator. At optimality, this method theoretically approaches the JS divergence between the distribution assumption of the encoder and the discriminator. We demonstrated the performance of our proposed method on several well cited datasets such as SVHN, USPS, MNIST and CIFAR10, achieving on-par or better performance with some of the state-of-the-art deep clustering methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDeep ClusteringSimilar Papers 제목 키워드 기반
End-to-End Adversarial-Attention Network for Multi-Modal Clustering
Multi-modal clustering aims to cluster data into different groups by exploring complementary information from multiple modalities or views. Little work learns the deep fused representations and simutaneously discovers th…
ClusteringAdversarial Deep Embedded Clustering: on a better trade-off between Feature Randomness and Feature Drift
Clustering using deep autoencoders has been thoroughly investigated in recent years. Current approaches rely on simultaneously learning embedded features and clustering the data points in the latent space. Although numer…
ClusteringDeep ClusteringImage ClusteringDual Adversarial Auto-Encoders for Clustering
As a powerful approach for exploratory data analysis, unsupervised clustering is a fundamental task in computer vision and pattern recognition. Many clustering algorithms have been developed, but most of them perform uns…
ClusteringVariational InferenceDeep Adversarial Inconsistent Cognitive Sampling for Multi-view Progressive Subspace Clustering
Deep multi-view clustering methods have achieved remarkable performance. However, all of them failed to consider the difficulty labels (uncertainty of ground-truth for training samples) over multi-view samples, which may…
Binary ClassificationClusteringBalanced Self-Paced Learning for Generative Adversarial Clustering Network
Clustering is an important problem in various machine learning applications, but still a challenging task when dealing with complex real data. The existing clustering algorithms utilize either shallow models with insuffi…
ClusteringDeep ClusteringImage ClusteringImage Retrieval+1