A Survey on Self-Supervised Representation Learning
Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations can then be used in downstream tasks like classification or object detection. The quality of these representations is close to supervised learning, while no labeled images are needed. This survey paper provides a comprehensive review of these methods in a unified notation, points out similarities and differences of these methods, and proposes a taxonomy which sets these methods in relation to each other. Furthermore, our survey summarizes the most-recent experimental results reported in the literature in form of a meta-study. Our survey is intended as a starting point for researchers and practitioners who want to dive into the field of representation learning.
Code (2)
Tasks
object-detectionObject DetectionRepresentation LearningSurveySimilar Papers 제목 키워드 기반
Self-supervised Learning: Generative or Contrastive
Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alterna…
Graph LearningRepresentation LearningSelf-Supervised LearningSurveySelf-Supervised Representation Learning for Astronomical Images
Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning…
AstronomyContrastive LearningMorphology classificationPhotometric Redshift Estimation+3A Survey of Self-Supervised and Few-Shot Object Detection
Labeling data is often expensive and time-consuming, especially for tasks such as object detection and instance segmentation, which require dense labeling of the image. While few-shot object detection is about training a…
Few-Shot Object DetectionInstance SegmentationObjectobject-detection+3Diffusion Models and Representation Learning: A Survey
Diffusion Models are popular generative modeling methods in various vision tasks, attracting significant attention. They can be considered a unique instance of self-supervised learning methods due to their independence f…
DenoisingRepresentation LearningSelf-Supervised LearningSurveySelf-supervised Multi-view Clustering in Computer Vision: A Survey
Multi-view clustering (MVC) has had significant implications in cross-modal representation learning and data-driven decision-making in recent years. It accomplishes this by leveraging the consistency and complementary in…
ClusteringContrastive LearningDecision MakingRepresentation Learning+2