paper-with-me

홈 › Papers

SSLIDE: Sound Source Localization for Indoors based on Deep Learning

2020-10-27 · Yifan Wu, Roshan Ayyalasomayajula, Michael J. Bianco, Dinesh Bharadia, Peter Gerstoft

This paper presents SSLIDE, Sound Source Localization for Indoors using DEep learning, which applies deep neural networks (DNNs) with encoder-decoder structure to localize sound sources with random positions in a continuous space. The spatial features of sound signals received by each microphone are extracted and represented as likelihood surfaces for the sound source locations in each point. Our DNN consists of an encoder network followed by two decoders. The encoder obtains a compressed representation of the input likelihoods. One decoder resolves the multipath caused by reverberation, and the other decoder estimates the source location. Experiments based on both the simulated and experimental data show that our method can not only outperform multiple signal classification (MUSIC), steered response power with phase transform (SRP-PHAT), sparse Bayesian learning (SBL), and a competing convolutional neural network (CNN) approach in the reverberant environment but also achieve a good generalization performance.

📄 PDF Abstract BibTeX arXiv:2010.14420

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDeep LearningSound Source Localization

Similar Papers 제목 키워드 기반

Sound Source Localization is All about Cross-Modal Alignment

2023-09-19 · ICCV 2023 1 · Arda Senocak, Hyeonggon Ryu, Junsik Kim, Tae-Hyun Oh 외

Humans can easily perceive the direction of sound sources in a visual scene, termed sound source localization. Recent studies on learning-based sound source localization have mainly explored the problem from a localizati…

Allcross-modal alignmentCross-Modal RetrievalRetrieval+1

Modelling Uncertainty in Deep Learning for Camera Relocalization

2015-09-19 · Alex Kendall, Roberto Cipolla

We present a robust and real-time monocular six degree of freedom visual relocalization system. We use a Bayesian convolutional neural network to regress the 6-DOF camera pose from a single RGB image. It is trained in an…

Camera RelocalizationDeep Learning

Do We Need Sound for Sound Source Localization?

2020-07-11 · Takashi Oya, Shohei Iwase, Ryota Natsume, Takahiro Itazuri 외

During the performance of sound source localization which uses both visual and aural information, it presently remains unclear how much either image or sound modalities contribute to the result, i.e. do we need both imag…

Sound Source Localization

Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment

2024-07-18 · Arda Senocak, Hyeonggon Ryu, Junsik Kim, Tae-Hyun Oh 외

Recent studies on learning-based sound source localization have mainly focused on the localization performance perspective. However, prior work and existing benchmarks overlook a crucial aspect: cross-modal interaction, …

cross-modal alignmentCross-Modal RetrievalSound Source Localization

Multiple Sound Sources Localization from Coarse to Fine

2020-07-13 · ECCV 2020 8 · Rui Qian, Di Hu, Heinrich Dinkel, Mengyue Wu 외

How to visually localize multiple sound sources in unconstrained videos is a formidable problem, especially when lack of the pairwise sound-object annotations. To solve this problem, we develop a two-stage audiovisual le…