Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues
Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To mitigate the above issue, evolutionary computation (EC) as a powerful heuristic search approach has shown significant merits in the automated design of DL models, so-called evolutionary deep learning (EDL). This paper aims to analyze EDL from the perspective of automated machine learning (AutoML). Specifically, we firstly illuminate EDL from machine learning and EC and regard EDL as an optimization problem. According to the DL pipeline, we systematically introduce EDL methods ranging from feature engineering, model generation, to model deployment with a new taxonomy (i.e., what and how to evolve/optimize), and focus on the discussions of solution representation and search paradigm in handling the optimization problem by EC. Finally, key applications, open issues and potentially promising lines of future research are suggested. This survey has reviewed recent developments of EDL and offers insightful guidelines for the development of EDL.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLFeature EngineeringHeuristic SearchSimilar Papers 제목 키워드 기반
A Comprehensive Survey on Bio-Inspired Algorithms: Taxonomy, Applications, and Future Directions
Bio-inspired algorithms (BIAs) utilize natural processes such as evolution, swarm behavior, foraging, and plant growth to solve complex, nonlinear, high-dimensional optimization problems. This survey categorizes BIAs int…
Quantum-inspired evolutionary algorithms: a survey and empirical study
Quantum-inspired evolutionary algorithms, one of the three main research areas related to the complex interaction between quantum computing and evolutionary algorithms, are receiving renewed attention. A quantum-inspired…
Evolutionary AlgorithmsSurveyEvolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications
Integrating Large Language Models (LLMs) and Evolutionary Computation (EC) represents a promising avenue for advancing artificial intelligence by combining powerful natural language understanding with optimization and se…
Evolutionary AlgorithmsNatural Language UnderstandingPrompt EngineeringSurveyReinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities
Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization probl…
AttributeEvolutionary Algorithmsreinforcement-learningReinforcement Learning+1A Survey on Evolutionary Neural Architecture Search
Deep Neural Networks (DNNs) have achieved great success in many applications. The architectures of DNNs play a crucial role in their performance, which is usually manually designed with rich expertise. However, such a de…
Image ClassificationNeural Architecture SearchSpeech RecognitionSurvey