Improving performance and inference on audio classification tasks using capsule networks
Classification of audio samples is an important part of many auditory systems. Deep learning models based on the Convolutional and the Recurrent layers are state-of-the-art in many such tasks. In this paper, we approach audio classification tasks using capsule networks trained by recently proposed dynamic routing-by-agreement mechanism. We propose an architecture for capsule networks fit for audio classification tasks and study the impact of various parameters on classification accuracy. Further, we suggest modifications for regularization and multi-label classification. We also develop insights into the data using capsule outputs and show the utility of the learned network for transfer learning. We perform experiments on 7 datasets of different domains and sizes and show significant improvements in performance compared to strong baseline models. To the best of our knowledge, this is the first detailed study about the application of capsule networks in the audio domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Audio ClassificationClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONTransfer LearningSimilar Papers 제목 키워드 기반
Hierarchical Multi-label Classification of Text with Capsule Networks
Capsule networks have been shown to demonstrate good performance on structured data in the area of visual inference. In this paper we apply and compare simple shallow capsule networks for hierarchical multi-label text cl…
AttributeClassificationGeneral ClassificationHierarchical Multi-label Classification+6Domestic activities clustering from audio recordings using convolutional capsule autoencoder network
Recent efforts have been made on domestic activities classification from audio recordings, especially the works submitted to the challenge of DCASE (Detection and Classification of Acoustic Scenes and Events) since 2018.…
ClusteringTimeCaps: Capturing Time Series Data With Capsule Networks
Capsule networks excel in understanding spatial relationships in 2D data for vision related tasks. Even though they are not designed to capture 1D temporal relationships, with TimeCaps we demonstrate that given the abili…
Time SeriesTime Series AnalysisVariational Capsules for Image Analysis and Synthesis
A capsule is a group of neurons whose activity vector models different properties of the same entity. This paper extends the capsule to a generative version, named variational capsules (VCs). Each VC produces a latent va…
AttributeDiversityGeneral Classificationimage-classification+2Subspace Capsule Network
Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among …
General ClassificationGenerative Adversarial Networkimage-classificationImage Classification+2