Papers Sound Event Localization and Detection
“Sound Event Localization and Detection” 태그가 달린 논문 70편 · 필터 해제
Text-Queried Target Sound Event Localization
Sound event localization and detection (SELD) aims to determine the appearance of sound classes, together with their Direction of Arrival (DOA). However, current SELD systems can only predict the activities of specific c…
Room Impulse Response (RIR)Sound Event Localization and DetectionSound Source LocalizationExploring Audio-Visual Information Fusion for Sound Event Localization and Detection In Low-Resource Realistic Scenarios
This study presents an audio-visual information fusion approach to sound event localization and detection (SELD) in low-resource scenarios. We aim at utilizing audio and video modality information through cross-modal lea…
Data AugmentationSound Event Localization and DetectionMFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection
Sound Event Localization and Detection (SELD) involves detecting and localizing sound events using multichannel sound recordings. Previously proposed Event-Independent Network V2 (EINV2) has achieved outstanding performa…
Sound Event Localization and Detection6DoF SELD: Sound Event Localization and Detection Using Microphones and Motion Tracking Sensors on self-motioning human
We aim to perform sound event localization and detection (SELD) using wearable equipment for a moving human, such as a pedestrian. Conventional SELD tasks have dealt only with microphone arrays located in static position…
Sound Event Localization and DetectionOverview of the L3DAS23 Challenge on Audio-Visual Extended Reality
The primary goal of the L3DAS23 Signal Processing Grand Challenge at ICASSP 2023 is to promote and support collaborative research on machine learning for 3D audio signal processing, with a specific emphasis on 3D speech …
Audio Signal ProcessingSound Event Localization and DetectionSpeech EnhancementBAT: Learning to Reason about Spatial Sounds with Large Language Models
Spatial sound reasoning is a fundamental human skill, enabling us to navigate and interpret our surroundings based on sound. In this paper we present BAT, which combines the spatial sound perception ability of a binaural…
Event DetectionLanguage ModellingLarge Language ModelNavigate+3Enhanced Sound Event Localization and Detection in Real 360-degree audio-visual soundscapes
This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by…
Data AugmentationSound Event Localization and DetectionSynthetic Data GenerationSpatial Scaper: A Library to Simulate and Augment Soundscapes for Sound Event Localization and Detection in Realistic Rooms
Sound event localization and detection (SELD) is an important task in machine listening. Major advancements rely on simulated data with sound events in specific rooms and strong spatio-temporal labels. SELD data is simul…
Data AugmentationDiversitySound Event Localization and DetectionSelective-Memory Meta-Learning with Environment Representations for Sound Event Localization and Detection
Environment shifts and conflicts present significant challenges for learning-based sound event localization and detection (SELD) methods. SELD systems, when trained in particular acoustic settings, often show restricted …
Meta-LearningSound Event Localization and DetectionCST-former: Transformer with Channel-Spectro-Temporal Attention for Sound Event Localization and Detection
Sound event localization and detection (SELD) is a task for the classification of sound events and the localization of direction of arrival (DoA) utilizing multichannel acoustic signals. Prior studies employ spectral and…
Sound Event Localization and DetectionFusion of Audio and Visual Embeddings for Sound Event Localization and Detection
Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only problem, but visual information has bee…
Data AugmentationEvent DetectionSound Event DetectionSound Event Localization and Detectionw2v-SELD: A Sound Event Localization and Detection Framework for Self-Supervised Spatial Audio Pre-Training
Sound Event Detection and Localization (SELD) constitutes a complex task that depends on extensive multichannel audio recordings with annotated sound events and their respective locations. In this paper, we introduce a s…
Event DetectionSound Event DetectionSound Event Localization and DetectionFeature Aggregation in Joint Sound Classification and Localization Neural Networks
This study addresses the application of deep learning techniques in joint sound signal classification and localization networks. Current state-of-the-art sound source localization deep learning networks lack feature aggr…
regressionSound ClassificationSound Event Localization and DetectionSound Source LocalizationSwG-former: A Sliding-Window Graph Convolutional Network for Simultaneous Spatial-Temporal Information Extraction in Sound Event Localization and Detection
Sound event localization and detection (SELD) involves sound event detection (SED) and direction of arrival (DoA) estimation tasks. SED mainly relies on temporal dependencies to distinguish different sound classes, while…
Event DetectionSound Event DetectionSound Event Localization and DetectionTemporal Information ExtractionLeveraging Geometrical Acoustic Simulations of Spatial Room Impulse Responses for Improved Sound Event Detection and Localization
As deeper and more complex models are developed for the task of sound event localization and detection (SELD), the demand for annotated spatial audio data continues to increase. Annotating field recordings with 360$^{\ci…
Event DetectionSound Event DetectionSound Event Localization and DetectionMETA-SELD: Meta-Learning for Fast Adaptation to the new environment in Sound Event Localization and Detection
For learning-based sound event localization and detection (SELD) methods, different acoustic environments in the training and test sets may result in large performance differences in the validation and evaluation stages.…
Meta-LearningSound Event Localization and DetectionDynamic Kernel Convolution Network with Scene-dedicate Training for Sound Event Localization and Detection
DNN-based methods have shown high performance in sound event localization and detection(SELD). While in real spatial sound scenes, reverberation and the imbalanced presence of various sound events increase the complexity…
Data AugmentationSound Event Localization and DetectionSTARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events
While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perceptible source objects, e.g., sounds of f…
Sound Event Localization and DetectionDivided spectro-temporal attention for sound event localization and detection in real scenes for DCASE2023 challenge
Localizing sounds and detecting events in different room environments is a difficult task, mainly due to the wide range of reflections and reverberations. When training neural network models with sounds recorded in only …
Event DetectionSound Event DetectionSound Event Localization and DetectionPerception Test: A Diagnostic Benchmark for Multimodal Video Models
We propose a novel multimodal video benchmark - the Perception Test - to evaluate the perception and reasoning skills of pre-trained multimodal models (e.g. Flamingo, SeViLA, or GPT-4). Compared to existing benchmarks th…
DiagnosticGrounded Video Question AnsweringObject TrackingPoint Tracking+3