paper-with-me

Papers

HGC: Hierarchical Group Convolution for Highly Efficient Neural Network

2019-06-09 · Xukai Xie, Yuan Zhou, Sun-Yuan Kung

Group convolution works well with many deep convolutional neural networks (CNNs) that can effectively compress the model by reducing the number of parameters and computational cost. Using this operation, feature maps of different group cannot communicate, which restricts their representation capability. To address this issue, in this work, we propose a novel operation named Hierarchical Group Convolution (HGC) for creating computationally efficient neural networks. Different from standard group convolution which blocks the inter-group information exchange and induces the severe performance degradation, HGC can hierarchically fuse the feature maps from each group and leverage the inter-group information effectively. Taking advantage of the proposed method, we introduce a family of compact networks called HGCNets. Compared to networks using standard group convolution, HGCNets have a huge improvement in accuracy at the same model size and complexity level. Extensive experimental results on the CIFAR dataset demonstrate that HGCNets obtain significant reduction of parameters and computational cost to achieve comparable performance over the prior CNN architectures designed for mobile devices such as MobileNet and ShuffleNet.

📄 PDF Abstract BibTeX arXiv:1906.03657

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Neural Network

Methods 이 논문이 사용한 방법론

Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution
Inverted Residual Block 설명 없음
Tether Customer Service Number +1-833-534-1729 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Grouped Convolution A Grouped Convolution uses a group of convolutions - multiple kernels per layer - resulting in multiple channel outputs per layer. This leads to wider networks helping a…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…

Similar Papers 제목 키워드 기반

Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks

2020-04-09 · Kakeru Mitsuno, Junichi Miyao, Takio Kurita

In a deep neural network (DNN), the number of the parameters is usually huge to get high learning performances. For that reason, it costs a lot of memory and substantial computational resources, and also causes overfitti…

Filter Pruning using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks

2020-11-04 · Kakeru Mitsuno, Takio Kurita

Since the convolutional neural networks are often trained with redundant parameters, it is possible to reduce redundant kernels or filters to obtain a compact network without dropping the classification accuracy. In this…

Green Hierarchical Vision Transformer for Masked Image Modeling

2022-05-26 · Lang Huang, Shan You, Mingkai Zheng, Fei Wang 외

We present an efficient approach for Masked Image Modeling (MIM) with hierarchical Vision Transformers (ViTs), allowing the hierarchical ViTs to discard masked patches and operate only on the visible ones. Our approach c…

GPUObject Detection

Multiscale Combinatorial Grouping

2014-06-01 · CVPR 2014 6 · Pablo Arbelaez, Jordi Pont-Tuset, Jonathan T. Barron, Ferran Marques 외

We propose a unified approach for bottom-up hierarchical image segmentation and object candidate generation for recognition, called Multiscale Combinatorial Grouping (MCG). For this purpose, we first develop a fast norma…

Image SegmentationObjectSegmentationSemantic Segmentation

Learning Hierarchical Relational Representations through Relational Convolutions

2023-10-05 · Awni Altabaa, John Lafferty

An evolving area of research in deep learning is the study of architectures and inductive biases that support the learning of relational feature representations. In this paper, we address the challenge of learning repres…

Relation