From Static to Dynamic: A Continual Learning Framework for Large Language Models
The vast number of parameters in large language models (LLMs) endows them with remarkable capabilities, allowing them to excel in a variety of natural language processing tasks. However, this complexity also presents challenges, making LLMs difficult to train and inhibiting their ability to continuously assimilate new knowledge, which may lead to inaccuracies in their outputs. To mitigate these issues, this paper presents DynaMind, a novel continual learning framework designed for LLMs. DynaMind incorporates memory mechanisms to assimilate new knowledge and modular operators to enhance the model inference process with the newly assimilated knowledge, consequently improving the accuracies of LLMs' outputs. Benchmark experiments demonstrate DynaMind's effectiveness in overcoming these challenges. The code and demo of DynaMind are available on GitHub: https://github.com/Elfsong/DynaMind.
Code (1)
Tasks
Continual LearningSimilar Papers 제목 키워드 기반
ConPET: Continual Parameter-Efficient Tuning for Large Language Models
Continual learning necessitates the continual adaptation of models to newly emerging tasks while minimizing the catastrophic forgetting of old ones. This is extremely challenging for large language models (LLMs) with van…
Continual LearningDynamic Dialogue Policy for Continual Reinforcement Learning
Continual learning is one of the key components of human learning and a necessary requirement of artificial intelligence. As dialogue can potentially span infinitely many topics and tasks, a task-oriented dialogue system…
Continual Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Reactivation: Empirical NTK Dynamics Under Task Shifts
The Neural Tangent Kernel (NTK) offers a powerful tool to study the functional dynamics of neural networks. In the so-called lazy, or kernel regime, the NTK remains static during training and the network function is line…
Continual LearningReinforced Interactive Continual Learning via Real-time Noisy Human Feedback
This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major…
Continual LearningContrastive LearningTowards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning
Continual instruction tuning enables large language models (LLMs) to learn incrementally while retaining past knowledge, whereas existing methods primarily focus on how to retain old knowledge rather than on selecting wh…
Continual Learning