paper-with-me

Papers

XSepConv: Extremely Separated Convolution

2020-02-27 · Jiarong Chen, Zongqing Lu, Jing-Hao Xue, Qingmin Liao

Depthwise convolution has gradually become an indispensable operation for modern efficient neural networks and larger kernel sizes ($\ge5$) have been applied to it recently. In this paper, we propose a novel extremely separated convolutional block (XSepConv), which fuses spatially separable convolutions into depthwise convolution to further reduce both the computational cost and parameter size of large kernels. Furthermore, an extra $2\times2$ depthwise convolution coupled with improved symmetric padding strategy is employed to compensate for the side effect brought by spatially separable convolutions. XSepConv is designed to be an efficient alternative to vanilla depthwise convolution with large kernel sizes. To verify this, we use XSepConv for the state-of-the-art architecture MobileNetV3-Small and carry out extensive experiments on four highly competitive benchmark datasets (CIFAR-10, CIFAR-100, SVHN and Tiny-ImageNet) to demonstrate that XSepConv can indeed strike a better trade-off between accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2002.12046

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Video Classification with Channel-Separated Convolutional Networks

2019-04-04 · ICCV 2019 10 · Du Tran, Heng Wang, Lorenzo Torresani, Matt Feiszli

Group convolution has been shown to offer great computational savings in various 2D convolutional architectures for image classification. It is natural to ask: 1) if group convolution can help to alleviate the high compu…

Action ClassificationAction RecognitionGeneral Classificationimage-classification+2

SSHPool: The Separated Subgraph-based Hierarchical Pooling

2024-03-24 · Zhuo Xu, Lixin Cui, Ming Li, Yue Wang 외

In this paper, we develop a novel local graph pooling method, namely the Separated Subgraph-based Hierarchical Pooling (SSHPool), for graph classification. We commence by assigning the nodes of a sample graph into differ…

Graph Classification

Learning optimally separated class-specific subspace representations using convolutional autoencoder

2021-05-19 · Krishan Sharma, Shikha Gupta, Renu Rameshan

In this work, we propose a novel convolutional autoencoder based architecture to generate subspace specific feature representations that are best suited for classification task. The class-specific data is assumed to lie …

Decoder

Computational optimization of convolutional neural networks using separated filters architecture

2020-02-18 · Elena Limonova, Alexander Sheshkus, Dmitry Nikolaev

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to…

CPUGPU

Extreme time extrapolation capabilities and thermodynamic consistency of physics-inspired Neural Networks for the 3D microstructure evolution of materials via Cahn-Hilliard flow

2024-07-29 · Daniele Lanzoni, Andrea Fantasia, Roberto Bergamaschini, Olivier Pierre-Louis 외

A Convolutional Recurrent Neural Network (CRNN) is trained to reproduce the evolution of the spinodal decomposition process in three dimensions as described by the Cahn-Hilliard equation. A specialized, physics-inspired …

PDE Surrogate Modeling