paper-with-me

Papers

Distributed speech separation in spatially unconstrained microphone arrays

2020-11-02 · Nicolas Furnon, Romain Serizel, Irina Illina, Slim Essid

Speech separation with several speakers is a challenging task because of the non-stationarity of the speech and the strong signal similarity between interferent sources. Current state-of-the-art solutions can separate well the different sources using sophisticated deep neural networks which are very tedious to train. When several microphones are available, spatial information can be exploited to design much simpler algorithms to discriminate speakers. We propose a distributed algorithm that can process spatial information in a spatially unconstrained microphone array. The algorithm relies on a convolutional recurrent neural network that can exploit the signal diversity from the distributed nodes. In a typical case of a meeting room, this algorithm can capture an estimate of each source in a first step and propagate it over the microphone array in order to increase the separation performance in a second step. We show that this approach performs even better when the number of sources and nodes increases. We also study the influence of a mismatch in the number of sources between the training and testing conditions.

📄 PDF Abstract BibTeX arXiv:2011.00982

Code (1)

nfurnon/disco 공식 구현 pytorch

Tasks

DiversitySpeech Separation

Similar Papers 제목 키워드 기반

Neural Speech Separation Using Spatially Distributed Microphones

2020-04-28 · Dongmei Wang, Zhuo Chen, Takuya Yoshioka

This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangem…

speech-recognitionSpeech RecognitionSpeech Separation

DNN-based mask estimation for distributed speech enhancement in spatially unconstrained microphone arrays

2020-11-03 · Nicolas Furnon, Romain Serizel, Irina Illina, Slim Essid

Deep neural network (DNN)-based speech enhancement algorithms in microphone arrays have now proven to be efficient solutions to speech understanding and speech recognition in noisy environments. However, in the context o…

DiversityNoise EstimationSpeech Enhancementspeech-recognition+1

Continuous Speech Separation with Ad Hoc Microphone Arrays

2021-03-03 · Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang 외

Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges mu…

speech-recognitionSpeech RecognitionSpeech Separation

Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments

2024-06-14 · Jihyun Kim, Stijn Kindt, Nilesh Madhu, Hong-Goo Kang

Ad-hoc distributed microphone environments, where microphone locations and numbers are unpredictable, present a challenge to traditional deep learning models, which typically require fixed architectures. To tailor deep l…

Deep LearningSpeech Separation

Cooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices

2019-12-10

Augmented listening devices such as hearing aids often perform poorly in noisy and reverberant environments with many competing sound sources. Large distributed microphone arrays can improve performance, but data from re…

Audio Source Separation