Convolutional Neural Networks In Convolution

2018-10-09 · Xiaobo Huang

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the Network In Network(NIN), aiming for higher accuracy without input data transmutation. In our architecture, namely "CNN In Convolution"(CNNIC), a small CNN, instead of the original generalized liner model(GLM) based filters, is convoluted as kernel on the original image, serving as feature extracting layer of this networks. And further classifications are then carried out by a global average pooling layer and a softmax layer. Dropout and orthonormal initialization are applied to overcome training difficulties including slow convergence and over-fitting. Persuasive classification performance is demonstrated on MNIST.

📄 PDF Abstract BibTeX arXiv:1810.03946

Code (1)

MyWorkShop/Convolutional-Neural-Networks-in-Convolution 공식 구현 tf

Tasks

General Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Learning Deep Analysis Dictionaries -- Part II: Convolutional Dictionaries

2020-01-31 · Jun-Jie Huang, Pier Luigi Dragotti

In this paper, we introduce a Deep Convolutional Analysis Dictionary Model (DeepCAM) by learning convolutional dictionaries instead of unstructured dictionaries as in the case of deep analysis dictionary model introduced…

Clustering Dictionary Learning Image Super-Resolution Super-Resolution

On the Robustness of Convolutional Neural Networks to Internal Architecture and Weight Perturbations

2017-03-23 · Nicholas Cheney, Martin Schrimpf, Gabriel Kreiman

Deep convolutional neural networks are generally regarded as robust function approximators. So far, this intuition is based on perturbations to external stimuli such as the images to be classified. Here we explore the ro…

Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections

2016-06-29 · Xiao-Jiao Mao, Chunhua Shen, Yu-Bin Yang

Image restoration, including image denoising, super resolution, inpainting, and so on, is a well-studied problem in computer vision and image processing, as well as a test bed for low-level image modeling algorithms. In …

Denoising Image Denoising Image Restoration JPEG Artifact Correction+1

Local Binary Convolutional Neural Networks

2016-08-22 · CVPR 2017 7 · Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides

We propose local binary convolution (LBC), an efficient alternative to convolutional layers in standard convolutional neural networks (CNN). The design principles of LBC are motivated by local binary patterns (LBP). The …

A Dynamic Convolutional Layer for Short Range Weather Prediction

2015-06-01 · CVPR 2015 6 · Benjamin Klein, Lior Wolf, Yehuda Afek

We present a new deep network layer called ``Dynamic Convolutional Layer" which is a generalization of the convolutional layer. The conventional convolutional layer uses filters that are learned during training and are h…

Prediction