Modeling Neural Architecture Search Methods for Deep Networks
There are many research works on the designing of architectures for the deep neural networks (DNN), which are named neural architecture search (NAS) methods. Although there are many automatic and manual techniques for NAS problems, there is no unifying model in which these NAS methods can be explored and compared. In this paper, we propose a general abstraction model for NAS methods. By using the proposed framework, it is possible to compare different design approaches for categorizing and identifying critical areas of interest in designing DNN architectures. Also, under this framework, different methods in the NAS area are summarized; hence a better view of their advantages and disadvantages is possible.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition
In this paper, we study differentiable neural architecture search (NAS) methods for natural language processing. In particular, we improve differentiable architecture search by removing the softmax-local constraint. Also…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+3Learning Architectures from an Extended Search Space for Language Modeling
Neural architecture search (NAS) has advanced significantly in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. In this paper, we extend the search space o…
ChunkingLanguage ModelingLanguage Modellingnamed-entity-recognition+4AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System
Recently, deep learning models have been widely spread in the industrial recommender systems and boosted the recommendation quality. Though having achieved remarkable success, the design of task-aware recommender systems…
Feature EngineeringNeural Architecture SearchRecommendation SystemsAccelerating Neural Architecture Search using Performance Prediction
Methods for neural network hyperparameter optimization and meta-modeling are computationally expensive due to the need to train a large number of model configurations. In this paper, we show that standard frequentist reg…
Hyperparameter OptimizationLanguage ModelingLanguage ModellingNeural Architecture Search+4Elastic Architecture Search for Efficient Language Models
As large pre-trained language models become increasingly critical to natural language understanding (NLU) tasks, their substantial computational and memory requirements have raised significant economic and environmental …
Natural Language UnderstandingNeural Architecture SearchKnowledge Distillation