Self-supervised Neural Architecture Search
Neural Architecture Search (NAS) has been used recently to achieve improved performance in various tasks and most prominently in image classification. Yet, current search strategies rely on large labeled datasets, which limit their usage in the case where only a smaller fraction of the data is annotated. Self-supervised learning has shown great promise in training neural networks using unlabeled data. In this work, we propose a self-supervised neural architecture search (SSNAS) that allows finding novel network models without the need for labeled data. We show that such a search leads to comparable results to supervised training with a "fully labeled" NAS and that it can improve the performance of self-supervised learning. Moreover, we demonstrate the advantage of the proposed approach when the number of labels in the search is relatively small.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationNeural Architecture SearchSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision
The existing graph neural architecture search (GNAS) methods heavily rely on supervised labels during the search process, failing to handle ubiquitous scenarios where supervisions are not available. In this paper, we stu…
DisentanglementNeural Architecture SearchSelf Semi Supervised Neural Architecture Search for Semantic Segmentation
In this paper, we propose a Neural Architecture Search strategy based on self supervision and semi-supervised learning for the task of semantic segmentation. Our approach builds an optimized neural network (NN) model for…
Neural Architecture SearchSelf-Supervised LearningSemantic SegmentationContrastive Self-supervised Neural Architecture Search
This paper proposes a novel cell-based neural architecture search algorithm (NAS), which completely alleviates the expensive costs of data labeling inherited from supervised learning. Our algorithm capitalizes on the eff…
Neural Architecture SearchSelf-Supervised LearningPretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning
Neural architecture search (NAS) has fostered various fields of machine learning. Despite its prominent dedications, many have criticized the intrinsic limitations of high computational cost. We aim to ameliorate this by…
Metric LearningNeural Architecture SearchSelf-Supervised LearningSETTI: A Self-supervised Adversarial Malware Detection Architecture in an IoT Environment
In recent years, malware detection has become an active research topic in the area of Internet of Things (IoT) security. The principle is to exploit knowledge from large quantities of continuously generated malware. Exis…
Generative Adversarial NetworkMalware Detection