Evolutionary algorithms meet self-supervised learning: a comprehensive survey
The number of studies that combine Evolutionary Machine Learning and self-supervised learning has been growing steadily in recent years. Evolutionary Machine Learning has been shown to help automate the design of machine learning algorithms and to lead to more reliable solutions. Self-supervised learning, on the other hand, has produced good results in learning useful features when labelled data is limited. This suggests that the combination of these two areas can help both in shaping evolutionary processes and in automating the design of deep neural networks, while also reducing the need for labelled data. Still, there are no detailed reviews that explain how Evolutionary Machine Learning and self-supervised learning can be used together. To help with this, we provide an overview of studies that bring these areas together. Based on this growing interest and the range of existing works, we suggest a new sub-area of research, which we call Evolutionary Self-Supervised Learning and introduce a taxonomy for it. Finally, we point out some of the main challenges and suggest directions for future research to help Evolutionary Self-Supervised Learning grow and mature as a field.
Code (0)
등록된 구현이 없습니다.
Tasks
Evolutionary AlgorithmsSelf-Supervised LearningSurveySimilar Papers 제목 키워드 기반
Evolutionary Augmentation Policy Optimization for Self-supervised Learning
Self-supervised Learning (SSL) is a machine learning algorithm for pretraining Deep Neural Networks (DNNs) without requiring manually labeled data. The central idea of this learning technique is based on an auxiliary sta…
Data AugmentationSelf-Supervised LearningUnleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review
The advent of deep learning has brought a revolutionary transformation to image denoising techniques. However, the persistent challenge of acquiring noise-clean pairs for supervised methods in real-world scenarios remain…
DenoisingImage DenoisingTowards Self-adaptive Mutation in Evolutionary Multi-Objective Algorithms
Parameter control has succeeded in accelerating the convergence process of evolutionary algorithms. While empirical and theoretical studies have shed light on the behavior of algorithms for single-objective optimization,…
BenchmarkingEvolutionary AlgorithmsNatural Evolutionary Search meets Probabilistic Numerics
Zeroth-order local optimisation algorithms are essential for solving real-valued black-box optimisation problems. Among these, Natural Evolution Strategies (NES) represent a prominent class, particularly well-suited for …
Effective Mutation Rate Adaptation through Group Elite Selection
Evolutionary algorithms are sensitive to the mutation rate (MR); no single value of this parameter works well across domains. Self-adaptive MR approaches have been proposed but they tend to be brittle: Sometimes they dec…
Evolutionary Algorithmsimage-classificationImage Classification