Where's That Voice Coming? Continual Learning for Sound Source Localization
Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and inference environments differ. Adapting SSL models to dynamic acoustic conditions faces a major challenge: catastrophic forgetting. In this work, we propose an exemplar-free continual learning strategy for SSL (CL-SSL) to address such a forgetting phenomenon. CL-SSL applies task-specific sub-networks to adapt across diverse acoustic environments while retaining previously learned knowledge. It also uses a scaling mechanism to limit parameter growth, ensuring consistent performance across incremental tasks. We evaluated CL-SSL on simulated data with varying microphone distances and real-world data with different noise levels. The results demonstrate CL-SSL's ability to maintain high accuracy with minimal parameter increase, offering an efficient solution for SSL applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningExemplar-FreeIncremental LearningSound Source LocalizationSimilar Papers 제목 키워드 기반
Vowels and Prosody Contribution in Neural Network Based Voice Conversion Algorithm with Noisy Training Data
This research presents a neural network based voice conversion (VC) model. While it is a known fact that voiced sounds and prosody are the most important component of the voice conversion framework, what is not known is …
Voice ConversionAnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting
Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem…
class-incremental learningClass Incremental LearningContinual LearningExemplar-Free+3SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech
Voice-activated systems are integrated into a variety of desktop, mobile, and Internet-of-Things (IoT) devices. However, voice spoofing attacks, such as impersonation and replay attacks, in which malicious attackers synt…
Speaker VerificationText-Independent Speaker VerificationContinual Audio-Visual Sound Separation
In this paper, we introduce a novel continual audio-visual sound separation task, aiming to continuously separate sound sources for new classes while preserving performance on previously learned classes, with the aid of …
Continual LearningSemantic SimilaritySemantic Textual SimilarityDisappeared Command: Spoofing Attack On Automatic Speech Recognition Systems with Sound Masking
The development of deep learning technology has greatly promoted the performance improvement of automatic speech recognition (ASR) technology, which has demonstrated an ability comparable to human hearing in many tasks. …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition