Trends in Neural Architecture Search: Towards the Acceleration of Search
In modern deep learning research, finding optimal (or near optimal) neural network models is one of major research directions and it is widely studied in many applications. In this paper, the main research trends of neural architecture search (NAS) are classified as neuro-evolutionary algorithms, reinforcement learning based algorithms, and one-shot architecture search approaches. Furthermore, each research trend is introduced and finally all the major three trends are compared. Lastly, the future research directions of NAS research trends are discussed.
Code (0)
등록된 구현이 없습니다.
Tasks
Evolutionary AlgorithmsNeural Architecture Searchreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A survey on FPGA-based accelerator for ML models
This paper thoroughly surveys machine learning (ML) algorithms acceleration in hardware accelerators, focusing on Field-Programmable Gate Arrays (FPGAs). It reviews 287 out of 1138 papers from the past six years, sourced…
SurveyDRIFT: A Toolkit for Diachronic Analysis of Scientific Literature
In this work, we present to the NLP community, and to the wider research community as a whole, an application for the diachronic analysis of research corpora. We open source an easy-to-use tool coined: DRIFT, which allow…
Keyword ExtractionActivation Functions: Comparison of trends in Practice and Research for Deep Learning
Deep neural networks have been successfully used in diverse emerging domains to solve real world complex problems with may more deep learning(DL) architectures, being developed to date. To achieve these state-of-the-art …
Deep LearningDeep Learning on FPGAs: Past, Present, and Future
The rapid growth of data size and accessibility in recent years has instigated a shift of philosophy in algorithm design for artificial intelligence. Instead of engineering algorithms by hand, the ability to learn compos…
Deep LearningGPUPhilosophyspeech-recognition+1Does Form Follow Function? An Empirical Exploration of the Impact of Deep Neural Network Architecture Design on Hardware-Specific Acceleration
The fine-grained relationship between form and function with respect to deep neural network architecture design and hardware-specific acceleration is one area that is not well studied in the research literature, with for…
FormGPUNeural Architecture Search