Papers Sound Source Localization
“Sound Source Localization” 태그가 달린 논문 122편 · 필터 해제
S2A2: Audio-Visual Imitation Learning for Manipulation Tasks Using Acoustic Spatial Information
Acoustic information provides rich cues about object location, material properties, and changes caused by contact or motion. This paper introduces a new set of acoustic-aware manipulation tasks for imitation learning, in…
Sound Source LocalizationSelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarios
Humans can selectively attend to a target sound and estimate its direction in complex scenarios, whereas such selective localization remains challenging for current deep learning-based systems. Sound source localization …
Sound Source LocalizationTarget Sound ExtractionNeuralMUSIC: A Hybrid Neural-Subspace Framework for Robot Sound Source Localization
Reliable sound source localization is fundamental to robot audition, enabling autonomous robots to perceive spatial cues and operate effectively in dynamic environments. Classical methods such as Multiple Signal Classifi…
Sound Source LocalizationDomain GeneralizationInitiation of Interaction Detection Framework using a Nonverbal Cue for Human-Robot Interaction
This paper describes an initiation of interaction(IoI) detection framework without keywords for human-robot interaction(HRI) based on audio and vision sensor fusion in a domestic environment. In the proposed framework, t…
Sound Source LocalizationGenerate, Analyze, and Refine: Training-Free Sound Source Localization via MLLM Meta-Reasoning
Sound source localization task aims to identify the locations of sound-emitting objects by leveraging correlations between audio and visual modalities. Most existing SSL methods rely on contrastive learning-based feature…
Sound Source LocalizationContrastive LearningRA-SSU: Towards Fine-Grained Audio-Visual Learning with Region-Aware Sound Source Understanding
Audio-Visual Learning (AVL) is one fundamental task of multi-modality learning and embodied intelligence, displaying the vital role in scene understanding and interaction. However, previous researchers mostly focus on ex…
audio-visual event localizationSound Source LocalizationScene UnderstandingLend me an Ear: Speech Enhancement Using a Robotic Arm with a Microphone Array
Speech enhancement performance degrades significantly in noisy environments, limiting the deployment of speech-controlled technologies in industrial settings, such as manufacturing plants. Existing speech enhancement sol…
Sound Source LocalizationSpeech EnhancementAnalytic Incremental Learning For Sound Source Localization With Imbalance Rectification
Sound source localization (SSL) demonstrates remarkable results in controlled settings but struggles in real-world deployment due to dual imbalance challenges: intra-task imbalance arising from long-tailed direction-of-a…
Sound Source LocalizationIncremental LearningData AugmentationAudio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
World models simulate environmental dynamics to enable embodied agents to plan and reason about future states. While real-world perception is inherently multimodal, existing approaches focus primarily on visual observati…
Sound Source LocalizationVisual NavigationReal-Time Object Tracking with On-Device Deep Learning for Adaptive Beamforming in Dynamic Acoustic Environments
Advances in object tracking and acoustic beamforming are driving new capabilities in surveillance, human-computer interaction, and robotics. This work presents an embedded system that integrates deep learning-based track…
Sound Source LocalizationDepth EstimationObject TrackingSystematic Evaluation of Time-Frequency Features for Binaural Sound Source Localization
This study presents a systematic evaluation of time-frequency feature design for binaural sound source localization (SSL), focusing on how feature selection influences model performance across diverse conditions. We inve…
Sound Source LocalizationSound Source Localization for Spatial Mapping of Surgical Actions in Dynamic Scenes
Purpose: Surgical scene understanding is key to advancing computer-aided and intelligent surgical systems. Current approaches predominantly rely on visual data or end-to-end learning, which limits fine-grained contextual…
Sound Source LocalizationScene UnderstandingPoint CloudsMulti Agent Switching Mode Controller for Sound Source localization
Source seeking is an important topic in robotic research, especially considering sound-based sensors since they allow the agents to locate a target even in critical conditions where it is not possible to establish a dire…
Sound Source LocalizationLearning from Silence and Noise for Visual Sound Source Localization
Visual sound source localization is a fundamental perception task that aims to detect the location of sounding sources in a video given its audio. Despite recent progress, we identify two shortcomings in current methods:…
Sound Source LocalizationSemantic correspondenceCross-Modal RetrievalTake That for Me: Multimodal Exophora Resolution with Interactive Questioning for Ambiguous Out-of-View Instructions
Daily life support robots must interpret ambiguous verbal instructions involving demonstratives such as ``Bring me that cup,'' even when objects or users are out of the robot's view. Existing approaches to exophora resol…
Sound Source LocalizationAcoustic Imaging for UAV Detection: Dense Beamformed Energy Maps and U-Net SELD
We introduce a U-net model for 360° acoustic source localization formulated as a spherical semantic segmentation task. Rather than regressing discrete direction-of-arrival (DoA) angles, our model segments beamformed audi…
Sound Event Localization and DetectionSound Source LocalizationSemantic SegmentationSound Source Localization for Human-Robot Interaction in Outdoor Environments
This paper presents a sound source localization strategy that relies on a microphone array embedded in an unmanned ground vehicle and an asynchronous close-talking microphone near the operator. A signal coarse alignment …
Sound Source LocalizationA Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods
Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate …
Sound Source LocalizationRobot NavigationA Wireless Self-Calibrating Ultrasound Microphone Array with Sub-Microsecond Synchronization
We present a novel system architecture for a distributed wireless, self-calibrating ultrasound microphone network for synchronized in-air acoustic sensing. Once deployed the embedded nodes determine their position in the…
Sound Source LocalizationSHAMaNS: Sound Localization with Hybrid Alpha-Stable Spatial Measure and Neural Steerer
This paper describes a sound source localization (SSL) technique that combines an $\alpha$-stable model for the observed signal with a neural network-based approach for modeling steering vectors. Specifically, a physics-…
Sound Source Localization