Learning Multiple Sound Source 2D Localization
In this paper, we propose novel deep learning based algorithms for multiple sound source localization. Specifically, we aim to find the 2D Cartesian coordinates of multiple sound sources in an enclosed environment by using multiple microphone arrays. To this end, we use an encoding-decoding architecture and propose two improvements on it to accomplish the task. In addition, we also propose two novel localization representations which increase the accuracy. Lastly, new metrics are developed relying on resolution-based multiple source association which enables us to evaluate and compare different localization approaches. We tested our method on both synthetic and real world data. The results show that our method improves upon the previous baseline approach for this problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Sound Source LocalizationSimilar Papers 제목 키워드 기반
Multiple Sound Sources Localization from Coarse to Fine
How to visually localize multiple sound sources in unconstrained videos is a formidable problem, especially when lack of the pairwise sound-object annotations. To solve this problem, we develop a two-stage audiovisual le…
Deep Neural Networks for Multiple Speaker Detection and Localization
We propose to use neural networks for simultaneous detection and localization of multiple sound sources in human-robot interaction. In contrast to conventional signal processing techniques, neural network-based sound sou…
Sound Source LocalizationSound event localization and classification using WASN in Outdoor Environment
Deep learning-based sound event localization and classification is an emerging research area within wireless acoustic sensor networks. However, current methods for sound event localization and classification typically re…
ClassificationSound Source LocalizationA Proposal-Based Paradigm for Self-Supervised Sound Source Localization in Videos
Humans can easily recognize where and how the sound is produced via watching a scene and listening to corresponding audio cues. To achieve such cross-modal perception on machines, existing methods only use the maps g…
Multiple Instance LearningSound Source LocalizationLeveraging Sound Source Trajectories for Universal Sound Separation
Existing methods utilizing spatial information for sound source separation require prior knowledge of the direction of arrival (DOA) of the source or utilize estimated but imprecise localization results, which impairs th…
Sound Source Localization