Scalable Reinforcement Learning-based Neural Architecture Search
In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to return a single optimal architecture. We consider both the NAS-Bench-101 and NAS- Bench-301 settings, and compare against various known strong baselines, such as local search and random search. We conclude that our Reinforcement Learning agent displays strong scalability with regards to the size of the search space, but limited robustness to hyperparameter changes.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture Searchreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
BNAS:An Efficient Neural Architecture Search Approach Using Broad Scalable Architecture
In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the propos…
Neural Architecture Searchreinforcement-learningReinforcement LearningReinforcement Learning (RL)Podracer architectures for scalable Reinforcement Learning
Supporting state-of-the-art AI research requires balancing rapid prototyping, ease of use, and quick iteration, with the ability to deploy experiments at a scale traditionally associated with production systems.Deep lear…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Reinforcement Learning with Chromatic Networks for Compact Architecture Search
We present a neural architecture search algorithm to construct compact reinforcement learning (RL) policies, by combining ENAS and ES in a highly scalable and intuitive way. By defining the combinatorial search space of …
Combinatorial OptimizationNeural Architecture Searchreinforcement-learningReinforcement Learning+1TensorRL-QAS: Reinforcement learning with tensor networks for scalable quantum architecture search
Variational quantum algorithms hold the promise to address meaningful quantum problems already on noisy intermediate-scale quantum hardware, but they face the challenge of designing quantum circuits that both solve the t…
Reinforcement Learning (RL)Tensor NetworksExploring Shared Structures and Hierarchies for Multiple NLP Tasks
Designing shared neural architecture plays an important role in multi-task learning. The challenge is that finding an optimal sharing scheme heavily relies on the expert knowledge and is not scalable to a large number of…
General ClassificationMulti-Task LearningNeural Architecture Searchreinforcement-learning+4