Robust Neural Architecture Search
Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to enhance the robustness of NAS-generated models, however, they neglected the nature accuracy of NAS-generated models. In our paper, we propose a novel NAS method, Robust Neural Architecture Search (RNAS). To design a regularization term to balance accuracy and robustness, RNAS generates architectures with both high accuracy and good robustness. To reduce search cost, we further propose to use noise examples instead adversarial examples as input to search architectures. Extensive experiments show that RNAS achieves state-of-the-art (SOTA) performance on both image classification and adversarial attacks, which illustrates the proposed RNAS achieves a good tradeoff between robustness and accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationNeural Architecture SearchSimilar Papers 제목 키워드 기반
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?
Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representatio…
AutoMLNeural Architecture SearchAutomated Dominative Subspace Mining for Efficient Neural Architecture Search
Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large se…
Neural Architecture SearchBNAS v2: Learning Architectures for Binary Networks with Empirical Improvements
Backbone architectures of most binary networks are well-known floating point (FP) architectures such as the ResNet family. Questioning that the architectures designed for FP networks might not be the best for binary netw…
QuantizationSearch Space Adaptation for Differentiable Neural Architecture Search in Image Classification
As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. Mo…
image-classificationImage ClassificationNeural Architecture SearchNeural Architecture Search using Progressive Evolution
Vanilla neural architecture search using evolutionary algorithms (EA) involves evaluating each architecture by training it from scratch, which is extremely time-consuming. This can be reduced by using a supernet to estim…
Evolutionary AlgorithmsNeural Architecture Search