paper-with-me

Papers

Evolutionary NAS with Gene Expression Programming of Cellular Encoding

2020-05-27 · Clifford Broni-Bediako, Yuki Murata, Luiz Henrique Mormille, Masayasu Atsumi

The renaissance of neural architecture search (NAS) has seen classical methods such as genetic algorithms (GA) and genetic programming (GP) being exploited for convolutional neural network (CNN) architectures. While recent work have achieved promising performance on visual perception tasks, the direct encoding scheme of both GA and GP has functional complexity deficiency and does not scale well on large architectures like CNN. To address this, we present a new generative encoding scheme -- $symbolic\ linear\ generative\ encoding$ (SLGE) -- simple, yet powerful scheme which embeds local graph transformations in chromosomes of linear fixed-length string to develop CNN architectures of variant shapes and sizes via evolutionary process of gene expression programming. In experiments, the effectiveness of SLGE is shown in discovering architectures that improve the performance of the state-of-the-art handcrafted CNN architectures on CIFAR-10 and CIFAR-100 image classification tasks; and achieves a competitive classification error rate with the existing NAS methods using less GPU resources.

📄 PDF Abstract BibTeX arXiv:2005.13110

Code (1)

cliffbb/geppy_nn 공식 구현

Tasks

General ClassificationGPUimage-classificationImage ClassificationNeural Architecture Search

Methods 이 논문이 사용한 방법론

GA Genetic Algorithms are search algorithms that mimic Darwinian biological evolution in order to select and propagate better solutions.
Sigmoid Activation 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

A Novel Neural Network-Based Symbolic Regression Method: Neuro-Encoded Expression Programming

2019-04-06 · Aftab Anjum, Fengyang Sun, Lin Wang, Jeff Orchard

Neuro-encoded expression programming(NEEP) that aims to offer a novel continuous representation of combinatorial encoding for genetic programming methods is proposed in this paper. Genetic programming with linear represe…

Evolutionary AlgorithmsregressionSymbolic Regression

Cellular reprogramming dynamics follow a simple one-dimensional reaction coordinate

2015-05-14

Cellular reprogramming, the conversion of one cell type to another, has fundamentally transformed our conception of cell types. Cellular reprogramming induces global changes in gene expression involving hundreds of trans…

Time SeriesTime Series Analysis

Evolving winning strategies for Nim-like games

2021-08-21 · Mihai Oltean

An evolutionary approach for computing the winning strategy for Nim-like games is proposed in this paper. The winning strategy is computed by using the Multi Expression Programming (MEP) technique - a fast and efficient …

A Hybrid Precipitation Prediction Method based on Multicellular Gene Expression Programming

2019-04-01 · Hongya Li, Yuzhong Peng, Chuyan Deng, Yonghua Pan 외

Prompt and accurate precipitation forecast is very important for development management of regional water resource, flood disaster prevention and people's daily activity and production plan; however, non-linear and nonst…

DenoisingManagement

Evolving TSP heuristics using Multi Expression Programming

2015-09-08 · Mihai Oltean, D. Dumitrescu

Multi Expression Programming (MEP) is an evolutionary technique that may be used for solving computationally difficult problems. MEP uses a linear solution representation. Each MEP individual is a string encoding complex…

Traveling Salesman Problem