paper-with-me

Papers

Efficient Decoupled Neural Architecture Search by Structure and Operation Sampling

2019-10-23 · Heung-Chang Lee, Do-Guk Kim, Bohyung Han

We propose a novel neural architecture search algorithm via reinforcement learning by decoupling structure and operation search processes. Our approach samples candidate models from the multinomial distribution on the policy vectors defined on the two search spaces independently. The proposed technique improves the efficiency of architecture search process significantly compared to the conventional methods based on reinforcement learning with the RNN controllers while achieving competitive accuracy and model size in target tasks. Our policy vectors are easily interpretable throughout the training procedure, which allows to analyze the search progress and the discovered architectures; the black-box characteristics of the RNN controllers hamper understanding training progress in terms of policy parameter updates. Our experiments demonstrate outstanding performance compared to the state-of-the-art methods with a fraction of search cost.

📄 PDF Abstract BibTeX arXiv:1910.10397

Code (1)

logue311/EDNAS 공식 구현 pytorch

Tasks

Neural Architecture Searchreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Whole-Body Bilateral Teleoperation with Multi-Stage Object Parameter Estimation for Wheeled Humanoid Locomanipulation

2025-08-13 · Donghoon Baek, Amartya Purushottam, Jason J. Choi, Joao Ramos arxiv

This paper presents an object-aware whole-body bilateral teleoperation framework for wheeled humanoid loco-manipulation. This framework combines whole-body bilateral teleoperation with an online multi-stage object inerti…

Shapley-NAS: Discovering Operation Contribution for Neural Architecture Search

2022-06-20 · CVPR 2022 1 · Han Xiao, Ziwei Wang, Zheng Zhu, Jie zhou 외

In this paper, we propose a Shapley value based method to evaluate operation contribution (Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) acquires the optimal architectures by opt…

Neural Architecture Search

Intra-layer Neural Architecture Search

2021-01-01 · Dong Kai Wang, Nam Sung Kim

We propose an efficient neural architecture search (NAS) algorithm with a flexible search space that encompasses layer operations down to individual weights. This work addresses NAS challenges in a search space of weight…

Multi-Task LearningNeural Architecture Search

Neural Architecture Search for Gliomas Segmentation on Multimodal Magnetic Resonance Imaging

2020-05-13 · Feifan Wang

Past few years have witnessed the artificial intelligence inspired evolution in various medical fields. The diagnosis and treatment of gliomas -- one of the most commonly seen brain tumors with low survival rate -- rely …

Brain Tumor SegmentationDecoderNeural Architecture SearchSegmentation+2

DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detection

2021-08-20 · ICCV 2021 10 · Limeng Qiao, Yuxuan Zhao, Zhiyuan Li, Xi Qiu 외

Few-shot object detection, which aims at detecting novel objects rapidly from extremely few annotated examples of previously unseen classes, has attracted significant research interest in the community. Most existing app…

ClassificationCross-Domain Few-Shot Object DetectionFew-Shot Object Detectionobject-detection+1