paper-with-me

홈 › Papers

Doubly Convolutional Neural Networks

2016-10-30 · NeurIPS 2016 12 · Shuangfei Zhai, Yu Cheng, Weining Lu, Zhongfei Zhang

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance of CNNs by further exploring this idea. In stead of allocating a set of convolutional filters that are independently learned, a DCNN maintains groups of filters where filters within each group are translated versions of each other. Practically, a DCNN can be easily implemented by a two-step convolution procedure, which is supported by most modern deep learning libraries. We perform extensive experiments on three image classification benchmarks: CIFAR-10, CIFAR-100 and ImageNet, and show that DCNNs consistently outperform other competing architectures. We have also verified that replacing a convolutional layer with a doubly convolutional layer at any depth of a CNN can improve its performance. Moreover, various design choices of DCNNs are demonstrated, which shows that DCNN can serve the dual purpose of building more accurate models and/or reducing the memory footprint without sacrificing the accuracy.

📄 PDF Abstract BibTeX arXiv:1610.09716

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classification

Methods 이 논문이 사용한 방법론

DCNN Diffusion-convolutional neural networks (DCNN) is a model for graph-structured data. Through the introduction of a diffusion-convolution operation, diffusion-based representations…

Similar Papers 제목 키워드 기반

Doubly Attentive Transformer Machine Translation

2018-07-30 · Hasan Sait Arslan, Mark Fishel, Gholamreza Anbarjafari

In this paper a doubly attentive transformer machine translation model (DATNMT) is presented in which a doubly-attentive transformer decoder normally joins spatial visual features obtained via pretrained convolutional ne…

DecoderImage CaptioningMachine TranslationMultimodal Machine Translation+1

Asymptotic Singular Value Distribution of Linear Convolutional Layers

2020-06-12 · Xinping Yi

In convolutional neural networks, the linear transformation of multi-channel two-dimensional convolutional layers with linear convolution is a block matrix with doubly Toeplitz blocks. Although a "wrapping around" operat…

Doubly-Attentive Decoder for Multi-modal Neural Machine Translation

2017-02-04 · ACL 2017 7 · Iacer Calixto, Qun Liu, Nick Campbell

We introduce a Multi-modal Neural Machine Translation model in which a doubly-attentive decoder naturally incorporates spatial visual features obtained using pre-trained convolutional neural networks, bridging the gap be…

DecoderImage DescriptionMachine TranslationMultimodal Machine Translation+1

Deep Learning Based Channel Estimation in High Mobility Communications Using Bi-RNN Networks

2023-04-29 · Abdul Karim Gizzini, Marwa Chafii

Doubly-selective channel estimation represents a key element in ensuring communication reliability in wireless systems. Due to the impact of multi-path propagation and Doppler interference in dynamic environments, doubly…

Doubly infinite residual neural networks: a diffusion process approach

2020-07-07 · Stefano Peluchetti, Stefano Favaro

Modern neural networks (NN) featuring a large number of layers (depth) and units per layer (width) have achieved a remarkable performance across many domains. While there exists a vast literature on the interplay between…

Gaussian Processes