A Novel Evolutionary Algorithm for Hierarchical Neural Architecture Search
In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the design process exploits this representation, in order to explore the search space. We also employ a curation system, which promotes the utilization of well performing sub-structures to subsequent generations. We apply our method to Fashion-MNIST and NAS-Bench101, achieving accuracies of $93.2\%$ and $94.8\%$ respectively in a relatively small number of generations.
Code (1)
Tasks
Neural Architecture SearchSimilar Papers 제목 키워드 기반
Efficient NAS with FaDE on Hierarchical Spaces
Neural architecture search (NAS) is a challenging problem. Hierarchical search spaces allow for cheap evaluations of neural network sub modules to serve as surrogate for architecture evaluations. Yet, sometimes the hiera…
Neural Architecture SearchHierarchical Representations for Efficient Architecture Search
We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical gen…
General Classificationimage-classificationImage ClassificationNeural Architecture SearchRegularized Evolutionary Algorithm for Dynamic Neural Topology Search
Designing neural networks for object recognition requires considerable architecture engineering. As a remedy, neuro-evolutionary network architecture search, which automatically searches for optimal network architectures…
Evolutionary AlgorithmsNeural Architecture SearchObject RecognitionAutostacker: A Compositional Evolutionary Learning System
We introduce an automatic machine learning (AutoML) modeling architecture called Autostacker, which combines an innovative hierarchical stacking architecture and an Evolutionary Algorithm (EA) to perform efficient parame…
AutoMLBIG-bench Machine LearningHyperparameter OptimizationRecord-Remix-Replay: Hierarchical GPU Kernel Optimization using Evolutionary Search
As high-performance computing and AI workloads become increasingly dependent on GPUs, maintaining high performance across rapidly evolving hardware generations has become a major challenge. Developers often spend months …