SELD-Mamba: Selective State-Space Model for Sound Event Localization and Detection with Source Distance Estimation
In the Sound Event Localization and Detection (SELD) task, Transformer-based models have demonstrated impressive capabilities. However, the quadratic complexity of the Transformer's self-attention mechanism results in computational inefficiencies. In this paper, we propose a network architecture for SELD called SELD-Mamba, which utilizes Mamba, a selective state-space model. We adopt the Event-Independent Network V2 (EINV2) as the foundational framework and replace its Conformer blocks with bidirectional Mamba blocks to capture a broader range of contextual information while maintaining computational efficiency. Additionally, we implement a two-stage training method, with the first stage focusing on Sound Event Detection (SED) and Direction of Arrival (DoA) estimation losses, and the second stage reintroducing the Source Distance Estimation (SDE) loss. Our experimental results on the 2024 DCASE Challenge Task3 dataset demonstrate the effectiveness of the selective state-space model in SELD and highlight the benefits of the two-stage training approach in enhancing SELD performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyEvent DetectionMambaSound Event DetectionSound Event Localization and DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Stereo sound event localization and detection based on PSELDnet pretraining and BiMamba sequence modeling
Pre-training methods have achieved significant performance improvements in sound event localization and detection (SELD) tasks, but existing Transformer-based models suffer from high computational complexity. In this wor…
DecoderMambaSound Event Localization and DetectionMambaFoley: Foley Sound Generation using Selective State-Space Models
Recent advancements in deep learning have led to widespread use of techniques for audio content generation, notably employing Denoising Diffusion Probabilistic Models (DDPM) across various tasks. Among these, Foley Sound…
DenoisingMambaState Space ModelsvalidCross-attention Inspired Selective State Space Models for Target Sound Extraction
The Transformer model, particularly its cross-attention module, is widely used for feature fusion in target sound extraction which extracts the signal of interest based on given clues. Despite its effectiveness, this app…
Computational EfficiencyMambaState Space ModelsTarget Sound ExtractionMambaLRP: Explaining Selective State Space Sequence Models
Recent sequence modeling approaches using selective state space sequence models, referred to as Mamba models, have seen a surge of interest. These models allow efficient processing of long sequences in linear time and ar…
Language ModelingLanguage ModellingMambaSelective-Memory Meta-Learning with Environment Representations for Sound Event Localization and Detection
Environment shifts and conflicts present significant challenges for learning-based sound event localization and detection (SELD) methods. SELD systems, when trained in particular acoustic settings, often show restricted …
Meta-LearningSound Event Localization and Detection