NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search

2020-01-28 · ICLR 2020 1 · Arber Zela, Julien Siems, Frank Hutter

One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to the many factors controlling the dynamics of the process. In order to allow a scientific study of these components, we introduce a general framework for one-shot NAS that can be instantiated to many recently-introduced variants and introduce a general benchmarking framework that draws on the recent large-scale tabular benchmark NAS-Bench-101 for cheap anytime evaluations of one-shot NAS methods. To showcase the framework, we compare several state-of-the-art one-shot NAS methods, examine how sensitive they are to their hyperparameters and how they can be improved by tuning their hyperparameters, and compare their performance to that of blackbox optimizers for NAS-Bench-101.

📄 PDF Abstract BibTeX arXiv:2001.10422

Code (1)

automl/nasbench-1shot1 공식 구현 pytorch

Tasks

Benchmarking Neural Architecture Search

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Time-Varying Network Driver Estimation (TNDE) Quantifies Stage-Specific Regulatory Effects From Single-Cell Snapshots

2025-11-25 · Jiaxin Li, Shanjun Mao arxiv

Identifying key driver genes governing biological processes such as development and disease progression remains a challenge. While existing methods can reconstruct cellular trajectories or infer static gene regulatory ne…

Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach

2019-08-31 · IJCNLP 2019 11 · Wenpeng Yin, Jamaal Hay, Dan Roth

Zero-shot text classification (0Shot-TC) is a challenging NLU problem to which little attention has been paid by the research community. 0Shot-TC aims to associate an appropriate label with a piece of text, irrespective …

Articles Benchmarking Classification General Classification+3

Benchmarking Spurious Bias in Few-Shot Image Classifiers

2024-09-04 · Guangtao Zheng, Wenqian Ye, Aidong Zhang

Few-shot image classifiers are designed to recognize and classify new data with minimal supervision and limited data but often show reliance on spurious correlations between classes and spurious attributes, known as spur…

Attribute Benchmarking Few-Shot Learning

Dissecting In-Context Learning of Translations in GPTs

2023-10-24 · Vikas Raunak, Hany Hassan Awadalla, Arul Menezes

Most of the recent work in leveraging Large Language Models (LLMs) such as GPT-3 for Machine Translation (MT) has focused on selecting the few-shot samples for prompting. In this work, we try to better understand the rol…

In-Context Learning Machine Translation Translation

NAS-Bench-Zero: A Large Scale Dataset for Understanding Zero-Shot Neural Architecture Search

2021-09-29 · Hanlin Chen, Ming Lin, Xiuyu Sun, Hao Li

Zero-shot Neural Architecture Search (ZS-NAS) is a recently developed low-cost NAS framework which identifies top-performer neural architectures from a large candidate pool without training their parameters. Despite its …