paper-with-me

홈 › Papers

Efficient Neural Architecture Transformation Searchin Channel-Level for Object Detection

2019-09-05 · Junran Peng, Ming Sun, Zhao-Xiang Zhang, Tieniu Tan, Junjie Yan

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet pre-training is always required for detectors. Training from scratch, as a substitute, demands more epochs to converge and brings no computation saving. To overcome this obstacle, we introduce a practical neural architecture transformation search(NATS)algorithm for object detection in this paper. Instead of searching and constructing an entire network, NATS explores the architecture space on the base of existing network and reusing its weights. We propose a novel neural architecture search strategy in channel-level instead of path-level and devise a search space specially targeting at object detection. With the combination of these two designs, an architecture transformation scheme could be discovered to adapt a network designed for image classification to task of object detection. Since our method is gradient-based and only searches for a transformation scheme, the weights of models pretrained inImageNet could be utilized in both searching and retraining stage, which makes the whole process very efficient. The transformed network requires no extra parameters and FLOPs, and is friendly to hardware optimization, which is practical to use in real-time application. In experiments, we demonstrate the effectiveness of NATSon networks like ResNet and ResNeXt. Our transformed networks, combined with various detection frameworks, achieve significant improvements on the COCO dataset while keeping fast.

📄 PDF Abstract BibTeX arXiv:1909.02293

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage ClassificationNeural Architecture SearchObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Average Pooling 설명 없음
ResNeXt Block A ResNeXt Block is a type of residual block used as part of the ResNeXt CNN…
Grouped Convolution A Grouped Convolution uses a group of convolutions - multiple kernels per layer - resulting in multiple channel outputs per layer. This leads to wider networks helping a…
ResNeXt A ResNeXt repeats a building block that aggregates a set of transformations with the same topology. Compared to a ResNet, it…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection

2019-12-01 · NeurIPS 2019 12 · Junran Peng, Ming Sun, Zhao-Xiang Zhang, Tieniu Tan 외

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the cos…

image-classificationImage ClassificationNeural Architecture SearchObject+2

Neural Architecture Adaptation for Object Detection by Searching Channel Dimensions and Mapping Pre-trained Parameters

2022-06-17 · Harim Jung, Myeong-Seok Oh, Cheoljong Yang, Seong-Whan Lee

Most object detection frameworks use backbone architectures originally designed for image classification, conventionally with pre-trained parameters on ImageNet. However, image classification and object detection are ess…

Classificationimage-classificationImage ClassificationNeural Architecture Search+3

G-DARTS-A: Groups of Channel Parallel Sampling with Attention

2020-10-16 · Zhaowen Wang, Wei zhang, Zhiming Wang

Differentiable Architecture Search (DARTS) provides a baseline for searching effective network architectures based gradient, but it is accompanied by huge computational overhead in searching and training network architec…

GPU

SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection

2019-11-22 · Lewei Yao, Hang Xu, Wei zhang, Xiaodan Liang 외

The state-of-the-art object detection method is complicated with various modules such as backbone, feature fusion neck, RPN and RCNN head, where each module may have different designs and structures. How to leverage the …

GPUNeural Architecture SearchObjectobject-detection+1

Revisiting Parameter Sharing for Automatic Neural Channel Number Search

2020-12-01 · NeurIPS 2020 12 · Jiaxing Wang, Haoli Bai, Jiaxiang Wu, Xupeng Shi 외

Recent advances in neural architecture search inspire many channel number search algorithms~(CNS) for convolutional neural networks. To improve searching efficiency, parameter sharing is widely applied, which reuses para…

Neural Architecture Search