paper-with-me

홈 › Papers

RENAS: Reinforced Evolutionary Neural Architecture Search

2019-06-01 · CVPR 2019 6 · Yukang Chen, Gaofeng Meng, Qian Zhang, Shiming Xiang, Chang Huang, Lisen Mu, Xinggang Wang

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RENAS), which is an evolutionary method with reinforced mutation for NAS. Our method integrates reinforced mutation into an evolution algorithm for neural architecture exploration, in which a mutation controller is introduced to learn the effects of slight modifications and make mutation actions. The reinforced mutation controller guides the model population to evolve efficiently. Furthermore, as child models can inherit parameters from their parents during evolution, our method requires very limited computational resources. In experiments, we conduct the proposed search method on CIFAR-10 and obtain a powerful network architecture, RENASNet. This architecture achieves a competitive result on CIFAR-10. The explored network architecture is transferable to ImageNet and achieves a new state-of-the-art accuracy, i.e., 75.7% top-1 accuracy with 5.36M parameters on mobile ImageNet. We further test its performance on semantic segmentation with DeepLabv3 on the PASCAL VOC. RENASNet outperforms MobileNet-v1, MobileNet-v2 and NASNet. It achieves 75.83% mIOU without being pretrained on COCO.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Neural Architecture SearchSemantic Segmentation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Spatial Pyramid Pooling Spatial Pyramid Pooling (SPP) is a pooling layer that removes the fixed-size constraint of the network, i.e. a CNN does not require a fixed-size input image. Specifically, we…
ASPP Atrous Spatial Pyramid Pooling (ASPP) is a semantic segmentation module for resampling a given feature layer at multiple rates prior to…
Dilated Convolution 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Batch Normalization 설명 없음
DeepLabv3 설명 없음

Similar Papers 제목 키워드 기반

Reinforced Evolutionary Neural Architecture Search

2018-08-01 · Yukang Chen, Gaofeng Meng, Qian Zhang, Shiming Xiang 외

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search …

Neural Architecture SearchSemantic Segmentation

ReNAS: Relativistic Evaluation of Neural Architecture Search

2021-06-19 · CVPR 2021 1 · Yixing Xu, Yunhe Wang, Kai Han, Yehui Tang 외

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and eval…

Neural Architecture Search

ReNAS:Relativistic Evaluation of Neural Architecture Search

2019-09-30 · Yixing Xu, Yunhe Wang, Kai Han, Yehui Tang 외

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate…

Neural Architecture Search

XploreNAS: Explore Adversarially Robust & Hardware-efficient Neural Architectures for Non-ideal Xbars

2023-02-15 · Abhiroop Bhattacharjee, Abhishek Moitra, Priyadarshini Panda

Compute In-Memory platforms such as memristive crossbars are gaining focus as they facilitate acceleration of Deep Neural Networks (DNNs) with high area and compute-efficiencies. However, the intrinsic non-idealities ass…

Adversarial RobustnessNeural Architecture Search

Multi-Objective Reinforced Evolution in Mobile Neural Architecture Search

2019-01-04 · Xiangxiang Chu, Bo Zhang, Ruijun Xu, Hailong Ma

Fabricating neural models for a wide range of mobile devices demands for a specific design of networks due to highly constrained resources. Both evolution algorithms (EA) and reinforced learning methods (RL) have been de…

image-classificationImage ClassificationNeural Architecture SearchSuper-Resolution