Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps
Learning a new task from a handful of examples remains an open challenge in machine learning. Despite the recent progress in few-shot learning, most methods rely on supervised pretraining or meta-learning on labeled meta-training data and cannot be applied to the case where the pretraining data is unlabeled. In this study, we present an unsupervised few-shot learning method via deep Laplacian eigenmaps. Our method learns representation from unlabeled data by grouping similar samples together and can be intuitively interpreted by random walks on augmented training data. We analytically show how deep Laplacian eigenmaps avoid collapsed representation in unsupervised learning without explicit comparison between positive and negative samples. The proposed method significantly closes the performance gap between supervised and unsupervised few-shot learning. Our method also achieves comparable performance to current state-of-the-art self-supervised learning methods under linear evaluation protocol.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningLinear evaluationMeta-LearningSelf-Supervised LearningUnsupervised Few-Shot Image ClassificationUnsupervised Few-Shot LearningSimilar Papers 제목 키워드 기반
Bisecting for selecting: using a Laplacian eigenmaps clustering approach to create the new European football Super League
We use European football performance data to select teams to form the proposed European football Super League, using only unsupervised techniques. We first used random forest regression to select important variables pred…
ClusteringregressionHypergraph Laplacian Eigenmaps and Face Recognition Problems
Face recognition is a very important topic in data science and biometric security research areas. It has multiple applications in military, finance, and retail, to name a few. In this paper, the novel hypergraph Laplacia…
ClassificationFace RecognitionLaplacian Eigenmaps from Sparse, Noisy Similarity Measurements
Manifold learning and dimensionality reduction techniques are ubiquitous in science and engineering, but can be computationally expensive procedures when applied to large data sets or when similarities are expensive to c…
Dimensionality ReductionA clustering tool for nucleotide sequences using Laplacian Eigenmaps and Gaussian Mixture Models
We propose a new procedure for clustering nucleotide sequences based on the "Laplacian Eigenmaps" and Gaussian Mixture modelling. This proposal is then applied to a set of 100 DNA sequences from the mitochondrially encod…
ClusteringGLEE: Geometric Laplacian Eigenmap Embedding
Graph embedding seeks to build a low-dimensional representation of a graph G. This low-dimensional representation is then used for various downstream tasks. One popular approach is Laplacian Eigenmaps, which constructs a…
Graph EmbeddingGraph ReconstructionLink Prediction