paper-with-me

홈 › Papers

Iterative Sound Source Localization for Unknown Number of Sources

2022-06-24 · Yanjie Fu, Meng Ge, Haoran Yin, Xinyuan Qian, Longbiao Wang, Gaoyan Zhang, Jianwu Dang

Sound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio. For the practical problem of unknown number of sources, existing localization algorithms attempt to predict a likelihood-based coding (i.e., spatial spectrum) and employ a pre-determined threshold to detect the source number and corresponding DOA value. However, these threshold-based algorithms are not stable since they are limited by the careful choice of threshold. To address this problem, we propose an iterative sound source localization approach called ISSL, which can iteratively extract each source's DOA without threshold until the termination criterion is met. Unlike threshold-based algorithms, ISSL designs an active source detector network based on binary classifier to accept residual spatial spectrum and decide whether to stop the iteration. By doing so, our ISSL can deal with an arbitrary number of sources, even more than the number of sources seen during the training stage. The experimental results show that our ISSL achieves significant performance improvements in both DOA estimation and source number detection compared with the existing threshold-based algorithms.

📄 PDF Abstract BibTeX arXiv:2206.12273

Code (2)

fyjneverfollows/issl 공식 구현 pytorch
fyjneverfollows/vctk-sim 공식 구현

Tasks

Sound Source Localization

Similar Papers 제목 키워드 기반

Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge

2024-03-26 · CVPR 2024 1 · DongJin Kim, Sung Jin Um, Sangmin Lee, Jung Uk Kim

The goal of the multi-sound source localization task is to localize sound sources from the mixture individually. While recent multi-sound source localization methods have shown improved performance, they face challenges …

ObjectSound Source Localization

CoLoC: Conditioned Localizer and Classifier for Sound Event Localization and Detection

2022-10-25 · Sławomir Kapka, Jakub Tkaczuk

In this article, we describe Conditioned Localizer and Classifier (CoLoC) which is a novel solution for Sound Event Localization and Detection (SELD). The solution constitutes of two stages: the localization is done firs…

Sound Event Localization and Detection

Unsupervised Sound Localization via Iterative Contrastive Learning

2021-04-01 · Yan-Bo Lin, Hung-Yu Tseng, Hsin-Ying Lee, Yen-Yu Lin 외

Sound localization aims to find the source of the audio signal in the visual scene. However, it is labor-intensive to annotate the correlations between the signals sampled from the audio and visual modalities, thus makin…

Contrastive Learning

Efficient and Microphone-Fault-Tolerant 3D Sound Source Localization

2025-05-27 · Yiyuan Yang, Shitong Xu, Niki Trigoni, Andrew Markham

Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calib…

PositionSound Source Localization

Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization

2023-08-11 · Sung Jin Um, DongJin Kim, Jung Uk Kim

The objective of the sound source localization task is to enable machines to detect the location of sound-making objects within a visual scene. While the audio modality provides spatial cues to locate the sound source, e…

Sound Source Localization