Continual Learning in Machine Speech Chain Using Gradient Episodic Memory
Continual learning for automatic speech recognition (ASR) systems poses a challenge, especially with the need to avoid catastrophic forgetting while maintaining performance on previously learned tasks. This paper introduces a novel approach leveraging the machine speech chain framework to enable continual learning in ASR using gradient episodic memory (GEM). By incorporating a text-to-speech (TTS) component within the machine speech chain, we support the replay mechanism essential for GEM, allowing the ASR model to learn new tasks sequentially without significant performance degradation on earlier tasks. Our experiments, conducted on the LJ Speech dataset, demonstrate that our method outperforms traditional fine-tuning and multitask learning approaches, achieving a substantial error rate reduction while maintaining high performance across varying noise conditions. We showed the potential of our semi-supervised machine speech chain approach for effective and efficient continual learning in speech recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Continual Learningspeech-recognitionSpeech Recognitiontext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
Online Continual Learning of End-to-End Speech Recognition Models
Continual Learning, also known as Lifelong Learning, aims to continually learn from new data as it becomes available. While prior research on continual learning in automatic speech recognition has focused on the adaptati…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Continual LearningLifelong learning+3Discriminative Representation Loss (DRL): A More Efficient Approach than Gradient Re-Projection in Continual Learning
The use of episodic memories in continual learning has been shown to be effective in terms of alleviating catastrophic forgetting. In recent studies, several gradient-based approaches have been developed to make more eff…
Continual LearningDiversityMetric LearningSemi-Discriminative Representation Loss for Online Continual Learning
The use of episodic memory in continual learning has demonstrated effectiveness for alleviating catastrophic forgetting. In recent studies, gradient-based approaches have been developed to make more efficient use of comp…
Continual LearningDiversityMetric LearningGradient Episodic Memory with a Soft Constraint for Continual Learning
Catastrophic forgetting in continual learning is a common destructive phenomenon in gradient-based neural networks that learn sequential tasks, and it is much different from forgetting in humans, who can learn and accumu…
Continual LearningSteady State Analysis of Episodic Reinforcement Learning
This paper proves that the episodic learning environment of every finite-horizon decision task has a unique steady state under any behavior policy, and that the marginal distribution of the agent's input indeed converges…
Continual Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)