paper-with-me

홈 › Papers

On the performance of residual block design alternatives in convolutional neural networks for end-to-end audio classification

2019-06-26 · Javier Naranjo-Alcazar, Sergi Perez-Castanos, Irene Martin-Morato, Pedro Zuccarello, Maximo Cobos

Residual learning is a recently proposed learning framework to facilitate the training of very deep neural networks. Residual blocks or units are made of a set of stacked layers, where the inputs are added back to their outputs with the aim of creating identity mappings. In practice, such identity mappings are accomplished by means of the so-called skip or residual connections. However, multiple implementation alternatives arise with respect to where such skip connections are applied within the set of stacked layers that make up a residual block. While ResNet architectures for image classification using convolutional neural networks (CNNs) have been widely discussed in the literature, few works have adopted ResNet architectures so far for 1D audio classification tasks. Thus, the suitability of different residual block designs for raw audio classification is partly unknown. The purpose of this paper is to analyze and discuss the performance of several residual block implementations within a state-of-the-art CNN-based architecture for end-to-end audio classification using raw audio waveforms. For comparison purposes, we analyze as well the performance of the residual blocks under a similar 2D architecture using a conventional time-frequency audio represen-tation as input. The results show that the achieved accuracy is considerably dependent, not only on the specific residual block implementation, but also on the selected input normalization.

📄 PDF Abstract BibTeX arXiv:1906.10891

Code (0)

등록된 구현이 없습니다.

Tasks

Audio ClassificationClassificationGeneral Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Kaiming Initialization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Dynamic Steerable Blocks in Deep Residual Networks

2017-06-02 · Jörn-Henrik Jacobsen, Bert de Brabandere, Arnold W. M. Smeulders

Filters in convolutional networks are typically parameterized in a pixel basis, that does not take prior knowledge about the visual world into account. We investigate the generalized notion of frames designed with image …

Contour Detection

Self-Organized Residual Blocks for Image Super-Resolution

2021-05-31 · Onur Keleş, A. Murat Tekalp, Junaid Malik, Serkan Kiranyaz

It has become a standard practice to use the convolutional networks (ConvNet) with RELU non-linearity in image restoration and super-resolution (SR). Although the universal approximation theorem states that a multi-layer…

Image RestorationImage Super-ResolutionSuper-Resolution

Distillation Guided Residual Learning for Binary Convolutional Neural Networks

2020-07-10 · Jianming Ye, Shiliang Zhang, Jingdong Wang

It is challenging to bridge the performance gap between Binary CNN (BCNN) and Floating point CNN (FCNN). We observe that, this performance gap leads to substantial residuals between intermediate feature maps of BCNN and …

When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks

2020-04-19 · Zhiyu Zhu, Zhen-Peng Bian, Junhui Hou, Yi Wang 외

Various architectures (such as GoogLeNets, ResNets, and DenseNets) have been proposed. However, the existing networks usually suffer from either redundancy of convolutional layers or insufficient utilization of parameter…

Neural Architecture Search

A Preliminary Exploration into an Alternative CellLineNet: An Evolutionary Approach

2020-07-26 · Akwarandu Ugo Nwachuku, Xavier Lewis-Palmer, Darlington Ahiale Akogo

Within this paper, the exploration of an evolutionary approach to an alternative CellLineNet: a convolutional neural network adept at the classification of epithelial breast cancer cell lines, is presented. This evolutio…

ClassificationGeneral Classification