paper-with-me

홈 › Papers

MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs

2024-08-26 · Ye Qiao, Haocheng Xu, Yifan Zhang, Sitao Huang

Neural Architecture Search (NAS) has proven effective in discovering new Convolutional Neural Network (CNN) architectures, particularly for scenarios with well-defined accuracy optimization goals. However, previous approaches often involve time-consuming training on super networks or intensive architecture sampling and evaluations. Although various zero-cost proxies correlated with CNN model accuracy have been proposed for efficient architecture search without training, their lack of hardware consideration makes it challenging to target highly resource-constrained edge devices such as microcontroller units (MCUs). To address these challenges, we introduce MONAS, a novel hardware-aware zero-shot NAS framework specifically designed for MCUs in edge computing. MONAS incorporates hardware optimality considerations into the search process through our proposed MCU hardware latency estimation model. By combining this with specialized performance indicators (proxies), MONAS identifies optimal neural architectures without incurring heavy training and evaluation costs, optimizing for both hardware latency and accuracy under resource constraints. MONAS achieves up to a 1104x improvement in search efficiency over previous work targeting MCUs and can discover CNN models with over 3.23x faster inference on MCUs while maintaining similar accuracy compared to more general NAS approaches.

📄 PDF Abstract BibTeX arXiv:2408.15034

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computingNeural Architecture Search

Similar Papers 제목 키워드 기반

MicroNAS: Zero-Shot Neural Architecture Search for MCUs

2024-01-17 · Ye Qiao, Haocheng Xu, Yifan Zhang, Sitao Huang

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on …

Edge-computingNeural Architecture Search

Robust 3D Face Alignment with Multi-Path Neural Architecture Search

2024-06-12 · Zhichao Jiang, Hongsong Wang, Xi Teng, Baopu Li

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions …

3D Face AlignmentFace AlignmentFace ModelNeural Architecture Search

TinyVLM: Zero-Shot Object Detection on Microcontrollers via Vision-Language Distillation with Matryoshka Embeddings

2026-02-24 · Bibin Wilson arxiv

Zero-shot object detection enables recognising novel objects without task-specific training, but current approaches rely on large vision language models (VLMs) like CLIP that require hundreds of megabytes of memory - far…

Zero-Shot Object Detection

PrototypeNAS: Rapid Design of Deep Neural Networks for Microcontroller Units

2026-03-16 · Mark Deutel, Simon Geis, Axel Plinge arxiv

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To …

Neural Architecture SearchTime Series ClassificationImage ClassificationObject Detection

CamoNAS: Neural Architecture Search for Enhanced Camouflaged Object Detection

2026-07-02 · Dawei Ren, Yan Zhang, Hongying Tang, Qiaoling Zhou 외 arxiv

Camouflaged Object Detection (COD) aims to locate and segment objects that blend into their surroundings, presenting challenges due to weak edge cues and ill-defined boundaries. Traditional COD models rely on hand-design…

Neural Architecture SearchObject Detection