Investigating U-Nets with various Intermediate Blocks for Spectrogram-based Singing Voice Separation
Singing Voice Separation (SVS) tries to separate singing voice from a given mixed musical signal. Recently, many U-Net-based models have been proposed for the SVS task, but there were no existing works that evaluate and compare various types of intermediate blocks that can be used in the U-Net architecture. In this paper, we introduce a variety of intermediate spectrogram transformation blocks. We implement U-nets based on these blocks and train them on complex-valued spectrograms to consider both magnitude and phase. These networks are then compared on the SDR metric. When using a particular block composed of convolutional and fully-connected layers, it achieves state-of-the-art SDR on the MUSDB singing voice separation task by a large margin of 0.9 dB. Our code and models are available online.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesis
We describe a sequence-to-sequence neural network which directly generates speech waveforms from text inputs. The architecture extends the Tacotron model by incorporating a normalizing flow into the autoregressive decode…
DecoderSpeech Synthesistext-to-speechText to Speech+1Speech Audio Synthesis from Tagged MRI and Non-Negative Matrix Factorization via Plastic Transformer
The tongue's intricate 3D structure, comprising localized functional units, plays a crucial role in the production of speech. When measured using tagged MRI, these functional units exhibit cohesive displacements and deri…
Audio SynthesisAxial Residual Networks for CycleGAN-based Voice Conversion
We propose a novel architecture and improved training objectives for non-parallel voice conversion. Our proposed CycleGAN-based model performs a shape-preserving transformation directly on a high frequency-resolution mag…
Voice ConversionAdam-mini: Use Fewer Learning Rates To Gain More
We propose Adam-mini, an optimizer that achieves on par or better performance than AdamW with 50% less memory footprint. Adam-mini reduces memory by cutting down the learning rate resources in Adam (i.e., $1/\sqrt{v}$). …
Optimising for Interpretability: Convolutional Dynamic Alignment Networks
We introduce a new family of neural network models called Convolutional Dynamic Alignment Networks (CoDA Nets), which are performant classifiers with a high degree of inherent interpretability. Their core building blocks…