An End-to-End Audio Classification System based on Raw Waveforms and Mix-Training Strategy
Audio classification can distinguish different kinds of sounds, which is helpful for intelligent applications in daily life. However, it remains a challenging task since the sound events in an audio clip is probably multiple, even overlapping. This paper introduces an end-to-end audio classification system based on raw waveforms and mix-training strategy. Compared to human-designed features which have been widely used in existing research, raw waveforms contain more complete information and are more appropriate for multi-label classification. Taking raw waveforms as input, our network consists of two variants of ResNet structure which can learn a discriminative representation. To explore the information in intermediate layers, a multi-level prediction with attention structure is applied in our model. Furthermore, we design a mix-training strategy to break the performance limitation caused by the amount of training data. Experiments show that the mean average precision of the proposed audio classification system on Audio Set dataset is 37.2%. Without using extra training data, our system exceeds the state-of-the-art multi-level attention model.
Code (0)
등록된 구현이 없습니다.
Tasks
Audio ClassificationClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Audio Classification of Bit-Representation Waveform
This study investigated the waveform representation for audio signal classification. Recently, many studies on audio waveform classification such as acoustic event detection and music genre classification have been publi…
Audio ClassificationClassificationEvent DetectionGeneral Classification+3Deep Convolutional and Recurrent Networks for Polyphonic Instrument Classification from Monophonic Raw Audio Waveforms
Sound Event Detection and Audio Classification tasks are traditionally addressed through time-frequency representations of audio signals such as spectrograms. However, the emergence of deep neural networks as efficient f…
Audio ClassificationClassificationEvent DetectionGeneral Classification+1RawNet: Advanced end-to-end deep neural network using raw waveforms for text-independent speaker verification
Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary p…
ClassificationData AugmentationGeneral ClassificationSpeaker Verification+1Conditional variational autoencoder to improve neural audio synthesis for polyphonic music sound
Deep generative models for audio synthesis have recently been significantly improved. However, the task of modeling raw-waveforms remains a difficult problem, especially for audio waveforms and music signals. Recently, t…
Audio SynthesisDifferentiable Wavetable Synthesis
Differentiable Wavetable Synthesis (DWTS) is a technique for neural audio synthesis which learns a dictionary of one-period waveforms i.e. wavetables, through end-to-end training. We achieve high-fidelity audio synthesis…
Audio SynthesisOne-Shot Learning