Efficient and Microphone-Fault-Tolerant 3D Sound Source Localization
Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calibration requirements, limiting their deployment in dynamic or resource-constrained environments. This paper introduces a novel 3D SSL framework, which uses sparse cross-attention, pretraining, and adaptive signal coherence metrics, to achieve accurate and computationally efficient localization with fewer input microphones. The framework is also fault-tolerant to unreliable or even unknown microphone position inputs, ensuring its applicability in real-world scenarios. Preliminary experiments demonstrate its scalability for multi-source localization without requiring additional hardware. This work advances SSL by balancing the model's performance and efficiency and improving its robustness for real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionSound Source LocalizationSimilar Papers 제목 키워드 기반
End-to-end Two-dimensional Sound Source Localization With Ad-hoc Microphone Arrays
Conventional sound source localization methods are mostly based on a single microphone array that consists of multiple microphones. They are usually formulated as the estimation of the direction of arrival problem. In th…
Sound Source Localizationwav2pos: Sound Source Localization using Masked Autoencoders
We present a novel approach to the 3D sound source localization task for distributed ad-hoc microphone arrays by formulating it as a set-to-set regression problem. By training a multi-modal masked autoencoder model that …
Indoor LocalizationSound Source LocalizationIPDnet: A Universal Direct-Path IPD Estimation Network for Sound Source Localization
Extracting direct-path spatial feature is crucial for sound source localization in adverse acoustic environments. This paper proposes the IPDnet, a neural network that estimates direct-path inter-channel phase difference…
Sound Source LocalizationSound Source Localization for Human-Robot Interaction in Outdoor Environments
This paper presents a sound source localization strategy that relies on a microphone array embedded in an unmanned ground vehicle and an asynchronous close-talking microphone near the operator. A signal coarse alignment …
Sound Source LocalizationPhased Microphone Array for Sound Source Localization with Deep Learning
To phased microphone array for sound source localization, algorithm with both high computational efficiency and high precision is a persistent pursuit. In this paper convolutional neural network (CNN) a kind of deep lear…
Computational EfficiencyDeep LearningSound Source Localization