Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments
Ad-hoc distributed microphone environments, where microphone locations and numbers are unpredictable, present a challenge to traditional deep learning models, which typically require fixed architectures. To tailor deep learning models to accommodate arbitrary array configurations, the Transform-Average-Concatenate (TAC) layer was previously introduced. In this work, we integrate TAC layers with dual-path transformers for speech separation from two simultaneous talkers in realistic settings. However, the distributed nature makes it hard to fuse information across microphones efficiently. Therefore, we explore the efficacy of blindly clustering microphones around sources of interest prior to enhancement. Experimental results show that this deep cluster-informed approach significantly improves the system's capacity to cope with the inherent variability observed in ad-hoc distributed microphone environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningSpeech SeparationSimilar Papers 제목 키워드 기반
Neural Speech Separation Using Spatially Distributed Microphones
This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangem…
speech-recognitionSpeech RecognitionSpeech SeparationDistributed speech separation in spatially unconstrained microphone arrays
Speech separation with several speakers is a challenging task because of the non-stationarity of the speech and the strong signal similarity between interferent sources. Current state-of-the-art solutions can separate we…
DiversitySpeech SeparationCooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices
Augmented listening devices such as hearing aids often perform poorly in noisy and reverberant environments with many competing sound sources. Large distributed microphone arrays can improve performance, but data from re…
Audio Source SeparationUtterance-Wise Meeting Transcription System Using Asynchronous Distributed Microphones
A novel framework for meeting transcription using asynchronous microphones is proposed in this paper. It consists of audio synchronization, speaker diarization, utterance-wise speech enhancement using guided source separ…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speaker-diarizationSpeaker Diarization+3Continuous Speech Separation with Ad Hoc Microphone Arrays
Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges mu…
speech-recognitionSpeech RecognitionSpeech Separation