Papers Sound Source Localization
“Sound Source Localization” 태그가 달린 논문 122편 · 필터 해제
Joint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videos
Visual and audio events simultaneously occur and both attract attention. However, most existing saliency prediction works ignore the influence of audio and only consider vision modality. In this paper, we propose a multi…
PredictionSaliency PredictionSound Source LocalizationDifferentiable Tracking-Based Training of Deep Learning Sound Source Localizers
Data-based and learning-based sound source localization (SSL) has shown promising results in challenging conditions, and is commonly set as a classification or a regression problem. Regression-based approaches have certa…
ClassificationDeep LearningDirection of Arrival Estimationregression+2Emergency Vehicles Audio Detection and Localization in Autonomous Driving
Emergency vehicles in service have right-of-way over all other vehicles. Hence, all other vehicles are supposed to take proper actions to yield emergency vehicles with active sirens. As this task requires the cooperation…
Autonomous DrivingSound Source LocalizationA Survey of Sound Source Localization with Deep Learning Methods
This article is a survey on deep learning methods for single and multiple sound source localization. We are particularly interested in sound source localization in indoor/domestic environment, where reverberation and dif…
Deep LearningSound Source LocalizationSurveyAcousticFusion: Fusing Sound Source Localization to Visual SLAM in Dynamic Environments
Dynamic objects in the environment, such as people and other agents, lead to challenges for existing simultaneous localization and mapping (SLAM) approaches. To deal with dynamic environments, computer vision researchers…
Depth EstimationObjectSimultaneous Localization and MappingSound Source LocalizationDual Normalization Multitasking for Audio-Visual Sounding Object Localization
Although several research works have been reported on audio-visual sound source localization in unconstrained videos, no datasets and metrics have been proposed in the literature to quantitatively evaluate its performanc…
ObjectObject LocalizationSound Source LocalizationSelf-supervised object detection from audio-visual correspondence
We tackle the problem of learning object detectors without supervision. Differently from weakly-supervised object detection, we do not assume image-level class labels. Instead, we extract a supervisory signal from audio-…
Objectobject-detectionObject DetectionSound Source Localization+1ODAS: Open embeddeD Audition System
Artificial audition aims at providing hearing capabilities to machines, computers and robots. Existing frameworks in robot audition offer interesting sound source localization, tracking and separation performance, althou…
Sound Source LocalizationContrastive Self-Supervised Learning of Global-Local Audio-Visual Representations
Contrastive self-supervised learning has delivered impressive results in many audio-visual recognition tasks. However, existing approaches optimize for learning either global representations useful for high-level underst…
ClassificationDeepFake DetectionFace SwappingGeneral Classification+4Localize to Binauralize: Audio Spatialization From Visual Sound Source Localization
Videos with binaural audios provide an immersive viewing experience by enabling 3D sound sensation. Recent works attempt to generate binaural audio in a multimodal learning framework using large quantities of videos …
Audio GenerationSound Source LocalizationLearning Multiple Sound Source 2D Localization
In this paper, we propose novel deep learning based algorithms for multiple sound source localization. Specifically, we aim to find the 2D Cartesian coordinates of multiple sound sources in an enclosed environment by usi…
Sound Source LocalizationData-Efficient Framework for Real-world Multiple Sound Source 2D Localization
Deep neural networks have recently led to promising results for the task of multiple sound source localization. Yet, they require a lot of training data to cover a variety of acoustic conditions and microphone array layo…
Sound Source LocalizationEnsemble of Discriminators for Domain Adaptation in Multiple Sound Source 2D Localization
This paper introduces an ensemble of discriminators that improves the accuracy of a domain adaptation technique for the localization of multiple sound sources. Recently, deep neural networks have led to promising results…
Domain AdaptationSound Source LocalizationDOANet: a deep dilated convolutional neural network approach for search and rescue with drone-embedded sound source localization
Drone-embedded sound source localization (SSL) has interesting application perspective in challenging search and rescue scenarios due to bad lighting conditions or occlusions. However, the problem gets complicated by sev…
Sound Source LocalizationBeamforming for measurements under disturbed propagation conditions using numerically calculated Green's functions
Beamforming methods for sound source localization are usually based on free-field Green's functions to model the sound propagation between source and microphone. This assumption is known to be incorrect for many industri…
Sound Source LocalizationSSLIDE: Sound Source Localization for Indoors based on Deep Learning
This paper presents SSLIDE, Sound Source Localization for Indoors using DEep learning, which applies deep neural networks (DNNs) with encoder-decoder structure to localize sound sources with random positions in a continu…
DecoderDeep LearningSound Source LocalizationLook, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning
When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlying correlation between audio and visual …
Action RecognitionAudio-Visual SynchronizationRepresentation LearningSound Source LocalizationSelf-supervised Neural Audio-Visual Sound Source Localization via Probabilistic Spatial Modeling
Detecting sound source objects within visual observation is important for autonomous robots to comprehend surrounding environments. Since sounding objects have a large variety with different appearances in our living env…
Self-Supervised LearningSound Source LocalizationDo We Need Sound for Sound Source Localization?
During the performance of sound source localization which uses both visual and aural information, it presently remains unclear how much either image or sound modalities contribute to the result, i.e. do we need both imag…
Sound Source LocalizationMulti-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network
Inspired by the mammal's auditory localization pathway, in this paper we propose a pure spiking neural network (SNN) based computational model for precise sound localization in the noisy real-world environment, and imple…
Sound Source Localization