Papers Sound Source Localization
“Sound Source Localization” 태그가 달린 논문 122편 · 필터 해제
AuralNet: Hierarchical Attention-based 3D Binaural Localization of Overlapping Speakers
We propose AuralNet, a novel 3D multi-source binaural sound source localization approach that localizes overlapping sources in both azimuth and elevation without prior knowledge of the number of sources. AuralNet employs…
Sound Source LocalizationEfficient and Microphone-Fault-Tolerant 3D Sound Source Localization
Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calib…
PositionSound Source LocalizationHearing and Seeing Through CLIP: A Framework for Self-Supervised Sound Source Localization
Large-scale vision-language models demonstrate strong multimodal alignment and generalization across diverse tasks. Among them, CLIP stands out as one of the most successful approaches. In this work, we extend the applic…
Scene UnderstandingSound Source LocalizationDiffusionRIR: Room Impulse Response Interpolation using Diffusion Models
Room Impulse Responses (RIRs) characterize acoustic environments and are crucial in multiple audio signal processing tasks. High-quality RIR estimates drive applications such as virtual microphones, sound source localiza…
Audio Signal ProcessingData AugmentationDenoisingImage Inpainting+1Improving Sound Source Localization with Joint Slot Attention on Image and Audio
Sound source localization (SSL) is the task of locating the source of sound within an image. Due to the lack of localization labels, the de facto standard in SSL has been to represent an image and audio as a single embed…
Contrastive LearningCross-Modal RetrievalSound Source LocalizationThe trajectoRIR Database: Room Acoustic Recordings Along a Trajectory of Moving Microphones
Data availability is essential to develop acoustic signal processing algorithms, especially when it comes to data-driven approaches that demand large and diverse training datasets. For this reason, an increasing number o…
Sound Source LocalizationEEG-Based Decoding of Sound Location: Comparing Free-Field to Headphone-Based Non-Individual HRTFs
Sound source localization relies on spatial cues such as interaural time differences (ITD), interaural level differences (ILD), and monaural spectral cues. Individually measured Head-Related Transfer Functions (HRTFs) fa…
EEGSound Source LocalizationCNN-based Robust Sound Source Localization with SRP-PHAT for the Extreme Edge
Robust sound source localization for environments with noise and reverberation are increasingly exploiting deep neural networks fed with various acoustic features. Yet, state-of-the-art research mainly focuses on optimiz…
Sound Source LocalizationObject-aware Sound Source Localization via Audio-Visual Scene Understanding
Audio-visual sound source localization task aims to spatially localize sound-making objects within visual scenes by integrating visual and audio cues. However, existing methods struggle with accurately localizing sou…
Scene UnderstandingSound Source LocalizationGraph-Enhanced Dual-Stream Feature Fusion with Pre-Trained Model for Acoustic Traffic Monitoring
Microphone array techniques are widely used in sound source localization and smart city acoustic-based traffic monitoring, but these applications face significant challenges due to the scarcity of labeled real-world traf…
Graph AttentionSound Source LocalizationSoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera
Accurately localizing 3D sound sources and estimating their semantic labels -- where the sources may not be visible, but are assumed to lie on the physical surface of objects in the scene -- have many real applications, …
Sound Source LocalizationSound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignment
How does audio describe the world around us? In this work, we propose a method for generating images of visual scenes from diverse in-the-wild sounds. This cross-modal generation task is challenging due to the significan…
Sound Source LocalizationMask-Weighted Spatial Likelihood Coding for Speaker-Independent Joint Localization and Mask Estimation
Due to their robustness and flexibility, neural-driven beamformers are a popular choice for speech separation in challenging environments with a varying amount of simultaneous speakers alongside noise and reverberation. …
Sound Source LocalizationSpeech SeparationA Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
The task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding. Despite advancements in state-of-th…
Scene UnderstandingSound Source LocalizationTF-Mamba: A Time-Frequency Network for Sound Source Localization
Sound source localization (SSL) determines the position of sound sources using multi-channel audio data. It is commonly used to improve speech enhancement and separation. Extracting spatial features is crucial for SSL, e…
MambaSound Source LocalizationSpeech EnhancementLeveraging Sound Source Trajectories for Universal Sound Separation
Existing methods utilizing spatial information for sound source separation require prior knowledge of the direction of arrival (DOA) of the source or utilize estimated but imprecise localization results, which impairs th…
Sound Source LocalizationEnhancing Sound Source Localization via False Negative Elimination
Sound source localization aims to localize objects emitting the sound in visual scenes. Recent works obtaining impressive results typically rely on contrastive learning. However, the common practice of randomly sampling …
audio-visual learningContrastive Learningobject-detectionObject Detection+1wav2pos: Sound Source Localization using Masked Autoencoders
We present a novel approach to the 3D sound source localization task for distributed ad-hoc microphone arrays by formulating it as a set-to-set regression problem. By training a multi-modal masked autoencoder model that …
Indoor LocalizationSound Source LocalizationAligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
Recent studies on learning-based sound source localization have mainly focused on the localization performance perspective. However, prior work and existing benchmarks overlook a crucial aspect: cross-modal interaction, …
cross-modal alignmentCross-Modal RetrievalSound Source LocalizationWhere's That Voice Coming? Continual Learning for Sound Source Localization
Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and inference environments differ. Adapting SSL …
Continual LearningExemplar-FreeIncremental LearningSound Source Localization