Colab NAS: Obtaining lightweight task-specific convolutional neural networks following Occam's razor
The current trend of applying transfer learning from convolutional neural networks (CNNs) trained on large datasets can be an overkill when the target application is a custom and delimited problem, with enough data to train a network from scratch. On the other hand, the training of custom and lighter CNNs requires expertise, in the from-scratch case, and or high-end resources, as in the case of hardware-aware neural architecture search (HW NAS), limiting access to the technology by non-habitual NN developers. For this reason, we present ColabNAS, an affordable HW NAS technique for producing lightweight task-specific CNNs. Its novel derivative-free search strategy, inspired by Occam's razor, allows to obtain state-of-the-art results on the Visual Wake Word dataset, a standard TinyML benchmark, in just 3.1 GPU hours using free online GPU services such as Google Colaboratory and Kaggle Kernel.
Code (1)
Tasks
GPUHardware Aware Neural Architecture SearchNeural Architecture SearchTransfer LearningSimilar Papers 제목 키워드 기반
Sketch2Colab: Sketch-Conditioned Multi-Human Animation via Controllable Flow Distillation
We present Sketch2Colab, which turns storyboard-style 2D sketches into coherent, object-aware 3D multi-human motion with fine-grained control over agents, joints, timing, and contacts. Diffusion-based motion generators o…
[Re] Variational Neural Cellular Automata
The main claim of the paper being reproduced is that the proposed Variational Neural Cellular Automata (VNCA) architecture, composed of a convolutional encoder and a Neural Cellular Automata (NCA)-based decoder, is able …
A workflow for segmenting soil and plant X-ray CT images with deep learning in Googles Colaboratory
X-ray micro-computed tomography (X-ray microCT) has enabled the characterization of the properties and processes that take place in plants and soils at the micron scale. Despite the widespread use of this advanced techni…
NavigateConstructive Interpretability with CoLabel: Corroborative Integration, Complementary Features, and Collaborative Learning
Machine learning models with explainable predictions are increasingly sought after, especially for real-world, mission-critical applications that require bias detection and risk mitigation. Inherent interpretability, whe…
Bias DetectionColabSfM: Collaborative Structure-from-Motion by Point Cloud Registration
Structure-from-Motion (SfM) is the task of estimating 3D structure and camera poses from images. We define Collaborative SfM (ColabSfM) as sharing distributed SfM reconstructions. Sharing maps requires estimating a joint…
Dataset GenerationPoint Cloud Registration