End-to-End Auditory Object Recognition via Inception Nucleus
Machine learning approaches to auditory object recognition are traditionally based on engineered features such as those derived from the spectrum or cepstrum. More recently, end-to-end classification systems in image and auditory recognition systems have been developed to learn features jointly with classification and result in improved classification accuracy. In this paper, we propose a novel end-to-end deep neural network to map the raw waveform inputs to sound class labels. Our network includes an "inception nucleus" that optimizes the size of convolutional filters on the fly that results in reducing engineering efforts dramatically. Classification results compared favorably against current state-of-the-art approaches, besting them by 10.4 percentage points on the Urbansound8k dataset. Analyses of learned representations revealed that filters in the earlier hidden layers learned wavelet-like transforms to extract features that were informative for classification.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationObjectObject RecognitionSimilar Papers 제목 키워드 기반
Temperature manipulation in songbird brain implicates the premotor nucleus HVC in birdsong syntax
Behavioral sequences of animals are often structured and can be described by probabilistic rules (or "action syntax"). The patterns of vocal elements in birdsong are a prime example. The encoding of such rules in neural …
A comparative study of eight human auditory models of monaural processing
A number of auditory models have been developed using diverging approaches, either physiological or perceptual, but they share comparable stages of signal processing, as they are inspired by the same constitutive parts o…
Inception Recurrent Convolutional Neural Network for Object Recognition
Deep convolutional neural networks (DCNNs) are an influential tool for solving various problems in the machine learning and computer vision fields. In this paper, we introduce a new deep learning model called an Inceptio…
ObjectObject RecognitionMulti-Transfer Learning Techniques for Detecting Auditory Brainstem Response
The assessment of the well-being of the peripheral auditory nerve system in individuals experiencing hearing impairment is conducted through auditory brainstem response (ABR) testing. Audiologists assess and document the…
Transfer LearningJointly Learning Visual and Auditory Speech Representations from Raw Data
We present RAVEn, a self-supervised multi-modal approach to jointly learn visual and auditory speech representations. Our pre-training objective involves encoding masked inputs, and then predicting contextualised targets…
Audio-Visual Speech RecognitionLipreadingspeech-recognitionSpeech Recognition+1