paper-with-me

홈 › Papers

Where's That Voice Coming? Continual Learning for Sound Source Localization

2024-07-04 · Yang Xiao, Rohan Kumar Das

Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and inference environments differ. Adapting SSL models to dynamic acoustic conditions faces a major challenge: catastrophic forgetting. In this work, we propose an exemplar-free continual learning strategy for SSL (CL-SSL) to address such a forgetting phenomenon. CL-SSL applies task-specific sub-networks to adapt across diverse acoustic environments while retaining previously learned knowledge. It also uses a scaling mechanism to limit parameter growth, ensuring consistent performance across incremental tasks. We evaluated CL-SSL on simulated data with varying microphone distances and real-world data with different noise levels. The results demonstrate CL-SSL's ability to maintain high accuracy with minimal parameter increase, offering an efficient solution for SSL applications.

📄 PDF Abstract BibTeX arXiv:2407.03661

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningExemplar-FreeIncremental LearningSound Source Localization

Similar Papers 제목 키워드 기반

Vowels and Prosody Contribution in Neural Network Based Voice Conversion Algorithm with Noisy Training Data

2020-03-10

This research presents a neural network based voice conversion (VC) model. While it is a known fact that voiced sounds and prosody are the most important component of the voice conversion framework, what is not known is …

Voice Conversion

AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting

2025-05-17 · Yang Xiao, Tianyi Peng, Rohan Kumar Das, Yuchen Hu 외

Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem…

class-incremental learningClass Incremental LearningContinual LearningExemplar-Free+3

SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech

2022-05-28 · Hanqing Guo, Qiben Yan, Nikolay Ivanov, Ying Zhu 외

Voice-activated systems are integrated into a variety of desktop, mobile, and Internet-of-Things (IoT) devices. However, voice spoofing attacks, such as impersonation and replay attacks, in which malicious attackers synt…

Speaker VerificationText-Independent Speaker Verification

Continual Audio-Visual Sound Separation

2024-11-05 · Weiguo Pian, Yiyang Nan, Shijian Deng, Shentong Mo 외

In this paper, we introduce a novel continual audio-visual sound separation task, aiming to continuously separate sound sources for new classes while preserving performance on previously learned classes, with the aid of …

Continual LearningSemantic SimilaritySemantic Textual Similarity

Disappeared Command: Spoofing Attack On Automatic Speech Recognition Systems with Sound Masking

2022-04-19 · Jinghui Xu, Jifeng Zhu, Yong Yang

The development of deep learning technology has greatly promoted the performance improvement of automatic speech recognition (ASR) technology, which has demonstrated an ability comparable to human hearing in many tasks. …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition