Multi-Speaker Localization Using Convolutional Neural Network Trained with Noise
The problem of multi-speaker localization is formulated as a multi-class multi-label classification problem, which is solved using a convolutional neural network (CNN) based source localization method. Utilizing the common assumption of disjoint speaker activities, we propose a novel method to train the CNN using synthesized noise signals. The proposed localization method is evaluated for two speakers and compared to a well-known steered response power method.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSimilar Papers 제목 키워드 기반
Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained with Noise Signals
Supervised learning based methods for source localization, being data driven, can be adapted to different acoustic conditions via training and have been shown to be robust to adverse acoustic environments. In this paper,…
Binary ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONDeep Beamforming for Speech Enhancement and Speaker Localization with an Array Response-Aware Loss Function
Recent research advances in deep neural network (DNN)-based beamformers have shown great promise for speech enhancement under adverse acoustic conditions. Different network architectures and input features have been expl…
Speech EnhancementLocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanism
The prevailing noise-resistant and reverberation-resistant localization algorithms primarily emphasize separating and providing directional output for each speaker in multi-speaker scenarios, without association with the…
Audio Inputs for Active Speaker Detection and Localization via Microphone Array
This study considers the problem of detecting and locating an active talker's horizontal position from multichannel audio captured by a microphone array. We refer to this as active speaker detection and localization (ASD…
Active Speaker DetectionLeveraging Visual Supervision for Array-based Active Speaker Detection and Localization
Conventional audio-visual approaches for active speaker detection (ASD) typically rely on visually pre-extracted face tracks and the corresponding single-channel audio to find the speaker in a video. Therefore, they tend…
Active Speaker DetectionSelf-Supervised Learning