Dilated Convolution with Dilated GRU for Music Source Separation
Stacked dilated convolutions used in Wavenet have been shown effective for generating high-quality audios. By replacing pooling/striding with dilation in convolution layers, they can preserve high-resolution information and still reach distant locations. Producing high-resolution predictions is also crucial in music source separation, whose goal is to separate different sound sources while maintaining the quality of the separated sounds. Therefore, this paper investigates using stacked dilated convolutions as the backbone for music source separation. However, while stacked dilated convolutions can reach wider context than standard convolutions, their effective receptive fields are still fixed and may not be wide enough for complex music audio signals. To reach information at remote locations, we propose to combine dilated convolution with a modified version of gated recurrent units (GRU) called the `Dilated GRU' to form a block. A Dilated GRU unit receives information from k steps before instead of the previous step for a fixed k. This modification allows a GRU unit to reach a location with fewer recurrent steps and run faster because it can execute partially in parallel. We show that the proposed model with a stack of such blocks performs equally well or better than the state-of-the-art models for separating vocals and accompaniments.
Code (0)
등록된 구현이 없습니다.
Tasks
Music Source SeparationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
D3Net: Densely connected multidilated DenseNet for music source separation
Music source separation involves a large input field to model a long-term dependence of an audio signal. Previous convolutional neural network (CNN)-based approaches address the large input field modeling using sequentia…
Music Source SeparationDensely connected multidilated convolutional networks for dense prediction tasks
Tasks that involve high-resolution dense prediction require a modeling of both local and global patterns in a large input field. Although the local and global structures often depend on each other and their simultaneous …
Audio Source SeparationMusic Source SeparationSemantic SegmentationDensely Connected Multi-Dilated Convolutional Networks for Dense Prediction Tasks
Tasks that involve high-resolution dense prediction require a modeling of both local and global patterns in a large input field. Although the local and global structures often depend on each other and their simultane…
Audio Source SeparationSemantic SegmentationAn Efficient Speech Separation Network Based on Recurrent Fusion Dilated Convolution and Channel Attention
We present an efficient speech separation neural network, ARFDCN, which combines dilated convolutions, multi-scale fusion (MSF), and channel attention to overcome the limited receptive field of convolution-based networks…
Computational EfficiencyDecoderSpeech SeparationStructure-Aware Audio-to-Score Alignment using Progressively Dilated Convolutional Neural Networks
The identification of structural differences between a music performance and the score is a challenging yet integral step of audio-to-score alignment, an important subtask of music information retrieval. We present a nov…
Information RetrievalMusic Information RetrievalRetrieval