paper-with-me

홈 › Papers

Fine-Tuning DARTS for Image Classification

2020-06-16 · Muhammad Suhaib Tanveer, Muhammad Umar Karim Khan, Chong-Min Kyung

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous approximations. These approximations result in inferior performance. We propose to fine-tune DARTS using fixed operations as they are independent of these approximations. Our method offers a good trade-off between the number of parameters and classification accuracy. Our approach improves the top-1 accuracy on Fashion-MNIST, CompCars, and MIO-TCD datasets by 0.56%, 0.50%, and 0.39%, respectively compared to the state-of-the-art approaches. Our approach performs better than DARTS, improving the accuracy by 0.28%, 1.64%, 0.34%, 4.5%, and 3.27% compared to DARTS, on CIFAR-10, CIFAR-100, Fashion-MNIST, CompCars, and MIO-TCD datasets, respectively.

📄 PDF Abstract BibTeX arXiv:2006.09042

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationFine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationNeural Architecture Search

Methods 이 논문이 사용한 방법론

DARTS Differentiable Architecture Search (DART) is a method for efficient architecture search. The search space is made continuous so that the architecture can be optimized with…
Sigmoid Activation 설명 없음
Entropy Regularization 설명 없음
Tanh Activation 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Neural Architecture Search Neural Architecture Search (NAS) learns a modular architecture which can be transferred from a small dataset to a large dataset. The method does this by reducing the problem…

Similar Papers 제목 키워드 기반

DartsReNet: Exploring new RNN cells in ReNet architectures

2023-04-11 · Brian Moser, Federico Raue, Jörn Hees, Andreas Dengel

We present new Recurrent Neural Network (RNN) cells for image classification using a Neural Architecture Search (NAS) approach called DARTS. We are interested in the ReNet architecture, which is a RNN based approach pres…

image-classificationImage ClassificationNeural Architecture Search

DARTS for Inverse Problems: a Study on Stability

2021-10-19 · NeurIPS Workshop Deep_Invers 2021 12 · Jonas Geiping, Jovita Lukasik, Margret Keuper, Michael Moeller

Differentiable architecture search (DARTS) is a widely researched tool for neural architecture search, due to its promising results for image classification. The main benefit of DARTS is the effectiveness achieved throug…

image-classificationImage ClassificationNeural Architecture Search

$α$ DARTS Once More: Enhancing Differentiable Architecture Search by Masked Image Modeling

2022-11-18 · Bicheng Guo, Shuxuan Guo, Miaojing Shi, Peng Chen 외

Differentiable architecture search (DARTS) has been a mainstream direction in automatic machine learning. Since the discovery that original DARTS will inevitably converge to poor architectures, recent works alleviate thi…

Neural Architecture Search

MSR-DARTS: Minimum Stable Rank of Differentiable Architecture Search

2020-09-19 · Kengo Machida, Kuniaki Uto, Koichi Shinoda, Taiji Suzuki

In neural architecture search (NAS), differentiable architecture search (DARTS) has recently attracted much attention due to its high efficiency. It defines an over-parameterized network with mixed edges, each of which r…

GPUNeural Architecture Search

Understanding and Robustifying Differentiable Architecture Search

2019-09-20 · ICLR 2020 1 · Arber Zela, Thomas Elsken, Tonmoy Saikia, Yassine Marrakchi 외

Differentiable Architecture Search (DARTS) has attracted a lot of attention due to its simplicity and small search costs achieved by a continuous relaxation and an approximation of the resulting bi-level optimization pro…

Disparity Estimationimage-classificationImage ClassificationLanguage Modelling