Audio Simulation for Sound Source Localization in Virtual Evironment
Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to locate sound sources to specific locations within a virtual environment by leveraging physically grounded sound propagation simulations and machine learning methods. This process attempts to overcome the issue of data insufficiency to localize sound sources to their location of occurrence especially in post-event localization. We achieve 0.786+/- 0.0136 F1-score using an audio transformer spectrogram approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Sound Source LocalizationSimilar Papers 제목 키워드 기반
VAST : The Virtual Acoustic Space Traveler Dataset
This paper introduces a new paradigm for sound source lo-calization referred to as virtual acoustic space traveling (VAST) and presents a first dataset designed for this purpose. Existing sound source localization method…
Sound Source LocalizationHARP: A Large-Scale Higher-Order Ambisonic Room Impulse Response Dataset
This contribution introduces a dataset of 7th-order Ambisonic Room Impulse Responses (HOA-RIRs), created using the Image Source Method. By employing higher-order Ambisonics, our dataset enables precise spatial audio repr…
Visual Sound Localization in the Wild by Cross-Modal Interference Erasing
The task of audio-visual sound source localization has been well studied under constrained scenes, where the audio recordings are clean. However, in real-world scenarios, audios are usually contaminated by off-screen sou…
Sound Source LocalizationT-VSL: Text-Guided Visual Sound Source Localization in Mixtures
Visual sound source localization poses a significant challenge in identifying the semantic region of each sounding source within a video. Existing self-supervised and weakly supervised source localization methods struggl…
Sound Source LocalizationJoint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videos
Visual and audio events simultaneously occur and both attract attention. However, most existing saliency prediction works ignore the influence of audio and only consider vision modality. In this paper, we propose a multi…
PredictionSaliency PredictionSound Source Localization