Regularized Evolutionary Algorithm for Dynamic Neural Topology Search
Designing neural networks for object recognition requires considerable architecture engineering. As a remedy, neuro-evolutionary network architecture search, which automatically searches for optimal network architectures using evolutionary algorithms, has recently become very popular. Although very effective, evolutionary algorithms rely heavily on having a large population of individuals (i.e., network architectures) and is therefore memory expensive. In this work, we propose a Regularized Evolutionary Algorithm with low memory footprint to evolve a dynamic image classifier. In details, we introduce novel custom operators that regularize the evolutionary process of a micro-population of 10 individuals. We conduct experiments on three different digits datasets (MNIST, USPS, SVHN) and show that our evolutionary method obtains competitive results with the current state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Evolutionary AlgorithmsNeural Architecture SearchObject RecognitionSimilar Papers 제목 키워드 기반
ECToNAS: Evolutionary Cross-Topology Neural Architecture Search
We present ECToNAS, a cost-efficient evolutionary cross-topology neural architecture search algorithm that does not require any pre-trained meta controllers. Our framework is able to select suitable network architectures…
Neural Architecture SearchNeuro-Evolutionary Approach to Physics-Aware Symbolic Regression
Symbolic regression is a technique that can automatically derive analytic models from data. Traditionally, symbolic regression has been implemented primarily through genetic programming that evolves populations of candid…
Evolutionary AlgorithmsregressionSymbolic RegressionEvolutionary Topology Search for Tensor Network Decomposition
Tensor network (TN) decomposition is a promising framework to represent extremely high-dimensional problems with few parameters. However, it is challenging to search the (near-)optimal topological structure for TN decomp…
Evolutionary AlgorithmsExact and Evolutionary Algorithms for Sequential Multi-Objective Transmission Topology Planning
We study day-ahead transmission topology control for high-voltage grid operation under $N-1$ security constraints. The operational task is to select, over a 24-hour horizon, a sequence of substation topologies obtained v…
Decision MakingA Novel Evolutionary Algorithm for Hierarchical Neural Architecture Search
In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical mod…
Neural Architecture Search