Fast and Practical Neural Architecture Search

2019-10-01 · ICCV 2019 10 · Jiequan Cui, Pengguang Chen, Ruiyu Li, Shu Liu, Xiaoyong Shen, Jiaya Jia

In this paper, we propose a fast and practical neural architecture search (FPNAS) framework for automatic network design. FPNAS aims to discover extremely efficient networks with less than 300M FLOPs. Different from previous NAS methods, our approach searches for the whole network architecture to guarantee block diversity instead of stacking a set of similar blocks repeatedly. We model the search process as a bi-level optimization problem and propose an approximation solution. On CIFAR-10, our approach is capable of design networks with comparable performance to state-of-the-arts while using orders of magnitude less computational resource with only 20 GPU hours. Experimental results on ImageNet and ADE20K datasets further demonstrate transferability of the searched networks.

📄 PDF Abstract BibTeX

Code (1)

FPNAS/FPNASNet pytorch

Tasks

DiversityGPUNeural Architecture Search

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Optimizing Neural Network Architecture for Medical Image Segmentation Using Monte Carlo Tree Search

2026-02-25 · Liping Meng, Fan Nie, Yunyun Zhang, Chao Han arxiv

This paper proposes a novel medical image segmentation framework, MNAS-Unet, which combines Monte Carlo Tree Search (MCTS) and Neural Architecture Search (NAS). MNAS-Unet dynamically explores promising network architectu…

Neural Architecture Search Medical Image Segmentation

Towards Fast Adaptation of Neural Architectures with Meta Learning

2020-05-01 · ICLR 2020 1 · Dongze Lian, Yin Zheng, Yintao Xu, Yanxiong Lu 외

Recently, Neural Architecture Search (NAS) has been successfully applied to multiple artificial intelligence areas and shows better performance compared with hand-designed networks. However, the existing NAS methods only…

Few-Shot Learning Meta-Learning Neural Architecture Search

ISyNet: Convolutional Neural Networks design for AI accelerator

2021-09-04 · Alexey Letunovskiy, Vladimir Korviakov, Vladimir Polovnikov, Anastasiia Kargapoltseva 외

In recent years Deep Learning reached significant results in many practical problems, such as computer vision, natural language processing, speech recognition and many others. For many years the main goal of the research…

Image Classification Neural Architecture Search Object Detection speech-recognition

MicroNAS: Zero-Shot Neural Architecture Search for MCUs

2024-01-17 · Ye Qiao, Haocheng Xu, Yifan Zhang, Sitao Huang

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on …

Edge-computing Neural Architecture Search

ZenDet: Revisiting Efficient Object Detection Backbones from Zero-Shot Neural Architecture Search

2021-09-29 · Zhenhong Sun, Ming Lin, Zhiyu Tan, Xiuyu Sun 외

In object detection models, the detection backbone consumes more than half of the overall inference cost. Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Arch…

GPU Neural Architecture Search Object object-detection+1