Convolutional Clustering for Unsupervised Learning
The task of labeling data for training deep neural networks is daunting and tedious, requiring millions of labels to achieve the current state-of-the-art results. Such reliance on large amounts of labeled data can be relaxed by exploiting hierarchical features via unsupervised learning techniques. In this work, we propose to train a deep convolutional network based on an enhanced version of the k-means clustering algorithm, which reduces the number of correlated parameters in the form of similar filters, and thus increases test categorization accuracy. We call our algorithm convolutional k-means clustering. We further show that learning the connection between the layers of a deep convolutional neural network improves its ability to be trained on a smaller amount of labeled data. Our experiments show that the proposed algorithm outperforms other techniques that learn filters unsupervised. Specifically, we obtained a test accuracy of 74.1% on STL-10 and a test error of 0.5% on MNIST.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringImage ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ensemble clustering for histopathological images segmentation using convolutional autoencoders
Unsupervised deep learning using autoencoders has shown excellent results in image analysis and computer vision. However, only few studies have been presented in the field of digital pathology, where proper labelling o…
ClusteringUnsupervised Prostate Cancer Detection on H&E using Convolutional Adversarial Autoencoders
We propose an unsupervised method using self-clustering convolutional adversarial autoencoders to classify prostate tissue as tumor or non-tumor without any labeled training data. The clustering method is integrated into…
ClusteringGraph Convolutional Network Based Semi-Supervised Learning on Multi-Speaker Meeting Data
Unsupervised clustering on speakers is becoming increasingly important for its potential uses in semi-supervised learning. In reality, we are often presented with enormous amounts of unlabeled data from multi-party meeti…
ClusteringSpeaker RecognitionSelf-Taught Convolutional Neural Networks for Short Text Clustering
Short text clustering is a challenging problem due to its sparseness of text representation. Here we propose a flexible Self-Taught Convolutional neural network framework for Short Text Clustering (dubbed STC^2), which c…
ClusteringDimensionality ReductionShort Text ClusteringText Clustering+1Unsupervised Variational Acoustic Clustering
We propose an unsupervised variational acoustic clustering model for clustering audio data in the time-frequency domain. The model leverages variational inference, extended to an autoencoder framework, with a Gaussian mi…
ClusteringVariational Inference