Improving Self-Organizing Maps with Unsupervised Feature Extraction
The Self-Organizing Map (SOM) is a brain-inspired neural model that is very promising for unsupervised learning, especially in embedded applications. However, it is unable to learn efficient prototypes when dealing with complex datasets. We propose in this work to improve the SOM performance by using extracted features instead of raw data. We conduct a comparative study on the SOM classification accuracy with unsupervised feature extraction using two different approaches: a machine learning approach with Sparse Convolutional Auto-Encoders using gradient-based learning, and a neuroscience approach with Spiking Neural Networks using Spike Timing Dependant Plasticity learning. The SOM is trained on the extracted features, then very few labeled samples are used to label the neurons with their corresponding class. We investigate the impact of the feature maps, the SOM size and the labeled subset size on the classification accuracy using the different feature extraction methods. We improve the SOM classification by +6.09\% and reach state-of-the-art performance on unsupervised image classification.
Code (1)
Tasks
ClassificationGeneral Classificationimage-classificationImage ClassificationUnsupervised Image ClassificationUnsupervised MNISTMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Outlier Detection using Self-Organizing Maps for Automated Blood Cell Analysis
The quality of datasets plays a crucial role in the successful training and deployment of deep learning models. Especially in the medical field, where system performance may impact the health of patients, clean datasets …
Outlier DetectionOut-of-Distribution DetectionQuantizationUnsupervised Parallel Extraction based Texture for Efficient Image Representation
SOM is a type of unsupervised learning where the goal is to discover some underlying structure of the data. In this paper, a new extraction method based on the main idea of Concurrent Self-Organizing Maps (CSOM), represe…
Dendritic Self-Organizing Maps for Continual Learning
Current deep learning architectures show remarkable performance when trained in large-scale, controlled datasets. However, the predictive ability of these architectures significantly decreases when learning new classes i…
Continual LearningSplit-CIFAR-10Split-MNISTSOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series
Continuous monitoring with an ever-increasing number of sensors has become ubiquitous across many application domains. However, acquired time series are typically high-dimensional and difficult to interpret. Expressive d…
Contrastive LearningDimensionality ReductionTime SeriesTime Series AnalysisNon-Euclidean Self-Organizing Maps
Self-Organizing Maps (SOMs, Kohonen networks) belong to neural network models of the unsupervised class. In this paper, we present the generalized setup for non-Euclidean SOMs. Most data analysts take it for granted to u…
ClusteringDimensionality Reduction