One-Shot Neural Architecture Search via Compressive Sensing
Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with competitive performance compared to those with hand-crafted designs. In this paper, we propose an iterative technique for NAS, inspired by algorithms for learning low-degree sparse Boolean functions. We validate our approach on the DARTs search space (Liu et al., 2018b) and NAS-Bench-201 (Yang et al., 2020). In addition, we provide theoretical analysis via upper bounds on the number of validation error measurements needed for reliable learning, and include ablation studies to further in-depth understanding of our technique.
Code (1)
Tasks
Compressive SensingMeta-LearningNeural Architecture SearchMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Parallel Compressive Imaging Architecture for One-Shot Acquisition
A limitation of many compressive imaging architectures lies in the sequential nature of the sensing process, which leads to long sensing times. In this paper we present a novel architecture that uses fewer detectors than…
Compressive SensingReinforcement Learning for Adaptive Video Compressive Sensing
We apply reinforcement learning to video compressive sensing to adapt the compression ratio. Specifically, video snapshot compressive imaging (SCI), which captures high-speed video using a low-speed camera is considered …
Compressive Sensingobject-detectionObject Detectionreinforcement-learning+3ICRICS: Iterative Compensation Recovery for Image Compressive Sensing
Closed-loop architecture is widely utilized in automatic control systems and attain distinguished performance. However, classical compressive sensing systems employ open-loop architecture with separated sampling and reco…
Compressive SensingOpenICS: Open Image Compressive Sensing Toolbox and Benchmark
We present OpenICS, an image compressive sensing toolbox that includes multiple image compressive sensing and reconstruction algorithms proposed in the past decade. Due to the lack of standardization in the implementatio…
BenchmarkingCompressive SensingUnsupervised Spatial-spectral Network Learning for Hyperspectral Compressive Snapshot Reconstruction
Hyperspectral compressive imaging takes advantage of compressive sensing theory to achieve coded aperture snapshot measurement without temporal scanning, and the entire three-dimensional spatial-spectral data is captured…
Compressive Sensing