Knowledge accumulating: The general pattern of learning
Artificial Intelligence has been developed for decades with the achievement of great progress. Recently, deep learning shows its ability to solve many real world problems, e.g. image classification and detection, natural language processing, playing GO. Theoretically speaking, an artificial neural network can fit any function and reinforcement learning can learn from any delayed reward. But in solving real world tasks, we still need to spend a lot of effort to adjust algorithms to fit task unique features. This paper proposes that the reason of this phenomenon is the sparse feedback feature of the nature, and a single algorithm, no matter how we improve it, can only solve dense feedback tasks or specific sparse feedback tasks. This paper first analyses how sparse feedback affects algorithm perfomance, and then proposes a pattern that explains how to accumulate knowledge to solve sparse feedback problems.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationReinforcement Learning (RL)Similar Papers 제목 키워드 기반
FINED: Feed Instance-Wise Information Need with Essential and Disentangled Parametric Knowledge from the Past
Recommender models play a vital role in various industrial scenarios, while often faced with the catastrophic forgetting problem caused by the fast shifting data distribution. To alleviate this problem, a common approach…
DisentanglementMemorizationGeneralizable Self-Evolving Memory for Automatic Prompt Optimization
Automatic prompt optimization is a promising approach for adapting large language models (LLMs) to downstream tasks, yet existing methods typically search for a specific prompt specialized to a fixed task. This paradigm …
ORANGE: An Online Reflection ANd GEneration framework with Domain Knowledge for Text-to-SQL
Large Language Models (LLMs) have demonstrated remarkable progress in translating natural language to SQL, but a significant semantic gap persists between their general knowledge and domain-specific semantics of database…
General KnowledgeExploring the Efficacy of Federated-Continual Learning Nodes with Attention-Based Classifier for Robust Web Phishing Detection: An Empirical Investigation
Web phishing poses a dynamic threat, requiring detection systems to quickly adapt to the latest tactics. Traditional approaches of accumulating data and periodically retraining models are outpaced. We propose a novel par…
Continual LearningFederated LearningLearn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning
The ability to continuously expand knowledge over time and utilize it to rapidly generalize to new tasks is a key feature of human linguistic intelligence. Existing models that pursue rapid generalization to new tasks (e…
Continual LearningFew-Shot LearningLanguage ModellingMeta-Learning+1