FOX-NAS: Fast, On-device and Explainable Neural Architecture Search
Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of architecture. However, the previous methods take much time to generate performance predictors thus are inefficient. To this end, we propose FOX-NAS that consists of fast and explainable predictors based on simulated annealing and multivariate regression. Our method is quantization-friendly and can be efficiently deployed to the edge. The experiments on different hardware show that FOX-NAS models outperform some other popular neural network architectures. For example, FOX-NAS matches MobileNetV2 and EfficientNet-Lite0 accuracy with 240% and 40% less latency on the edge CPU. FOX-NAS is the 3rd place winner of the 2020 Low-Power Computer Vision Challenge (LPCVC), DSP classification track. See all evaluation results at https://lpcv.ai/competitions/2020. Search code and pre-trained models are released at https://github.com/great8nctu/FOX-NAS.
Code (1)
Tasks
CPUNeural Architecture SearchQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification
On-device Deep Neural Networks (DNNs) have recently gained more attention due to the increasing computing power of the mobile devices and the number of applications in Computer Vision (CV), Natural Language Processing (N…
Adversarial RobustnessGeneral ClassificationKnowledge DistillationModel Compression+2LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search
Text to speech (TTS) has been broadly used to synthesize natural and intelligible speech in different scenarios. Deploying TTS in various end devices such as mobile phones or embedded devices requires extremely small mem…
CPUModel CompressionNeural Architecture Searchtext-to-speech+1Explainable AI using expressive Boolean formulas
We propose and implement an interpretable machine learning classification model for Explainable AI (XAI) based on expressive Boolean formulas. Potential applications include credit scoring and diagnosis of medical condit…
BenchmarkingExplainable Artificial Intelligence (XAI)Interpretable Machine LearningModel Recovery at the Edge under Resource Constraints for Physical AI
Model Recovery (MR) enables safe, explainable decision making in mission-critical autonomous systems (MCAS) by learning governing dynamical equations, but its deployment on edge devices is hindered by the iterative natur…
Decision MakingAutoCoMet: Smart Neural Architecture Search via Co-Regulated Shaping Reinforcement
Designing suitable deep model architectures, for AI-driven on-device apps and features, at par with rapidly evolving mobile hardware and increasingly complex target scenarios is a difficult task. Though Neural Architectu…
AutoMLNeural Architecture Search