Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures
Separating an audio scene into isolated sources is a fundamental problem in computer audition, analogous to image segmentation in visual scene analysis. Source separation systems based on deep learning are currently the most successful approaches for solving the underdetermined separation problem, where there are more sources than channels. Traditionally, such systems are trained on sound mixtures where the ground truth decomposition is already known. Since most real-world recordings do not have such a decomposition available, this limits the range of mixtures one can train on, and the range of mixtures the learned models may successfully separate. In this work, we use a simple blind spatial source separation algorithm to generate estimated decompositions of stereo mixtures. These estimates, together with a weighting scheme in the time-frequency domain, based on confidence in the separation quality, are used to train a deep learning model that can be used for single-channel separation, where no source direction information is available. This demonstrates how a simple cue such as the direction of origin of source can be used to bootstrap a model for source separation that can be used in situations where that cue is not available.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringImage SegmentationSemantic SegmentationUnsupervised Spatial ClusteringSimilar Papers 제목 키워드 기반
Towards Unsupervised Single-Channel Blind Source Separation using Adversarial Pair Unmix-and-Remix
Blind single-channel source separation is a long standing signal processing challenge. Many methods were proposed to solve this task utilizing multiple signal priors such as low rank, sparsity, temporal continuity etc. T…
blind source separationregressionUnsupervised training of a deep clustering model for multichannel blind source separation
We propose a training scheme to train neural network-based source separation algorithms from scratch when parallel clean data is unavailable. In particular, we demonstrate that an unsupervised spatial clustering algorith…
blind source separationClusteringDeep ClusteringUnsupervised Spatial ClusteringReverberation as Supervision for Speech Separation
This paper proposes reverberation as supervision (RAS), a novel unsupervised loss function for single-channel reverberant speech separation. Prior methods for unsupervised separation required the synthesis of mixtures of…
Speech SeparationUnsupervised Sound Separation Using Mixture Invariant Training
In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the componen…
Domain AdaptationSpeech EnhancementSpeech SeparationUnsupervised Domain AdaptationEnhanced Reverberation as Supervision for Unsupervised Speech Separation
Reverberation as supervision (RAS) is a framework that allows for training monaural speech separation models from multi-channel mixtures in an unsupervised manner. In RAS, models are trained so that sources predicted fro…
Speech Separation