J-Net: Randomly weighted U-Net for audio source separation
Several results in the computer vision literature have shown the potential of randomly weighted neural networks. While they perform fairly well as feature extractors for discriminative tasks, a positive correlation exists between their performance and their fully trained counterparts. According to these discoveries, we pose two questions: what is the value of randomly weighted networks in difficult generative audio tasks such as audio source separation and does such positive correlation still exist when it comes to large random networks and their trained counterparts? In this paper, we demonstrate that the positive correlation still exists. Based on this discovery, we can try out different architecture designs or tricks without training the whole model. Meanwhile, we find a surprising result that in comparison to the non-trained encoder (down-sample path) in Wave-U-Net, fixing the decoder (up-sample path) to random weights results in better performance, almost comparable to the fully trained model.
Code (1)
Tasks
Audio Source SeparationDecoderSimilar Papers 제목 키워드 기반
Deep Audio Prior
Deep convolutional neural networks are known to specialize in distilling compact and robust prior from a large amount of data. We are interested in applying deep networks in the absence of training dataset. In this paper…
blind source separationTexture SynthesisSeparate Anything You Describe
Language-queried audio source separation (LASS) is a new paradigm for computational auditory scene analysis (CASA). LASS aims to separate a target sound from an audio mixture given a natural language query, which provide…
Audio Source SeparationNatural Language QueriesSpeech EnhancementZero-shot GeneralizationDOSE : Drum One-Shot Extraction from Music Mixture
Drum one-shot samples are crucial for music production, particularly in sound design and electronic music. This paper introduces Drum One-Shot Extraction, a task in which the goal is to extract drum one-shots that are pr…
FADVisual Scene Graphs for Audio Source Separation
State-of-the-art approaches for visually-guided audio source separation typically assume sources that have characteristic sounds, such as musical instruments. These approaches often ignore the visual context of these sou…
Audio Source SeparationVisually Guided Sound Source SeparationSampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method
Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the varieties of audio signals. Since samplin…
Audio Source SeparationMusic Source Separation