Papers Sound Source Localization
“Sound Source Localization” 태그가 달린 논문 122편 · 필터 해제
FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localization
Extracting direct-path spatial features is critical for sound source localization in adverse acoustic environments. This paper proposes a full-band and narrow-band fusion network for estimating direct-path inter-channel …
Sound Source LocalizationSoft Label Coding for End-to-end Sound Source Localization With Ad-hoc Microphone Arrays
Recently, an end-to-end two-dimensional sound source localization algorithm with ad-hoc microphone arrays formulates the sound source localization problem as a classification problem. The algorithm divides the target ind…
QuantizationSound Source LocalizationSound to Visual Scene Generation by Audio-to-Visual Latent Alignment
How does audio describe the world around us? In this paper, we propose a method for generating an image of a scene from sound. Our method addresses the challenges of dealing with the large gaps that often exist between s…
Scene GenerationSchedulingSound Source LocalizationAudio-Visual Grouping Network for Sound Localization from Mixtures
Sound source localization is a typical and challenging task that predicts the location of sound sources in a video. Previous single-source methods mainly used the audio-visual association as clues to localize sounding ob…
Object LocalizationSound Source LocalizationLOCUS: LOcalization with Channel Uncertainty and Sporadic Energy
Accurate sound source localization (SSL) requires consistent multichannel data for reliable degree of arrival (DoA) estimation. However, intermittently powered batteryless systems often suffer from incomplete sensor data…
Event DetectionMissing ElementsSound Event DetectionSound Source Localization+1Real-Time Acoustic Perception for Automotive Applications
In recent years the automotive industry has been strongly promoting the development of smart cars, equipped with multi-modal sensors to gather information about the surroundings, in order to aid human drivers or make aut…
Sound Source LocalizationChaotic World: A Large and Challenging Benchmark for Human Behavior Understanding in Chaotic Events
Understanding and analyzing human behaviors (actions and interactions of people), voices, and sounds in chaotic events is crucial in many applications, e.g., crowd management, emergency response services. Different f…
Action LocalizationPathfinderSound Source LocalizationImproving trajectory localization accuracy via direction-of-arrival derivative estimation
Sound source localization is crucial in acoustic sensing and monitoring-related applications. In this paper, we do a comprehensive analysis of improvement in sound source localization by combining the direction of arriva…
Direction of Arrival EstimationSound Source LocalizationFlowGrad: Using Motion for Visual Sound Source Localization
Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos. While it proves to …
Optical Flow EstimationScene UnderstandingSound Source LocalizationHear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization
Learning to localize the sound source in videos without explicit annotations is a novel area of audio-visual research. Existing work in this area focuses on creating attention maps to capture the correlation between the …
Optical Flow EstimationSound Source LocalizationMarginNCE: Robust Sound Localization with a Negative Margin
The goal of this work is to localize sound sources in visual scenes with a self-supervised approach. Contrastive learning in the context of sound source localization leverages the natural correspondence between audio and…
Contrastive LearningSound Source LocalizationPosition tracking of a varying number of sound sources with sliding permutation invariant training
Recent data- and learning-based sound source localization (SSL) methods have shown strong performance in challenging acoustic scenarios. However, little work has been done on adapting such methods to track consistently m…
PositionSound Source LocalizationDeep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function
In this paper, we propose a deep learning based multi-speaker direction of arrival (DOA) estimation with audio and visual signals by using permutation-free loss function. We first collect a data set for multi-modal sound…
Active Speaker DetectionSound Source LocalizationEnd-to-end Two-dimensional Sound Source Localization With Ad-hoc Microphone Arrays
Conventional sound source localization methods are mostly based on a single microphone array that consists of multiple microphones. They are usually formulated as the estimation of the direction of arrival problem. In th…
Sound Source LocalizationA Closer Look at Weakly-Supervised Audio-Visual Source Localization
Audio-visual source localization is a challenging task that aims to predict the location of visual sound sources in a video. Since collecting ground-truth annotations of sounding objects can be costly, a plethora of weak…
Sound Source LocalizationIterative Sound Source Localization for Unknown Number of Sources
Sound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio. For the practical problem of unknown number of sources, existing localization algorithms a…
Sound Source LocalizationSelf-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes
Sound source localization in visual scenes aims to localize objects emitting the sound in a given image. Recent works showing impressive localization performance typically rely on the contrastive learning framework. Howe…
Contrastive LearningSound Source LocalizationHRTF measurement for accurate sound localization cues
A new database of head-related transfer functions (HRTFs) for accurate sound source localization is presented through precise measurement and post-processing in terms of improved frequency bandwidth and causality of head…
Sound Source LocalizationVisual Sound Localization in the Wild by Cross-Modal Interference Erasing
The task of audio-visual sound source localization has been well studied under constrained scenes, where the audio recordings are clean. However, in real-world scenarios, audios are usually contaminated by off-screen sou…
Sound Source LocalizationA Proposal-Based Paradigm for Self-Supervised Sound Source Localization in Videos
Humans can easily recognize where and how the sound is produced via watching a scene and listening to corresponding audio cues. To achieve such cross-modal perception on machines, existing methods only use the maps g…
Multiple Instance LearningSound Source Localization