Towards learning-to-learn

2018-11-01 · Benjamin James Lansdell, Konrad Paul Kording

In good old-fashioned artificial intelligence (GOFAI), humans specified systems that solved problems. Much of the recent progress in AI has come from replacing human insights by learning. However, learning itself is still usually built by humans -- specifically the choice that parameter updates should follow the gradient of a cost function. Yet, in analogy with GOFAI, there is no reason to believe that humans are particularly good at defining such learning systems: we may expect learning itself to be better if we learn it. Recent research in machine learning has started to realize the benefits of that strategy. We should thus expect this to be relevant for neuroscience: how could the correct learning rules be acquired? Indeed, cognitive science has long shown that humans learn-to-learn, which is potentially responsible for their impressive learning abilities. Here we discuss ideas across machine learning, neuroscience, and cognitive science that matter for the principle of learning-to-learn.

📄 PDF Abstract BibTeX arXiv:1811.00231

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Meta-SGD: Learning to Learn Quickly for Few-Shot Learning

2017-07-31 · Zhenguo Li, Fengwei Zhou, Fei Chen, Hang Li

Few-shot learning is challenging for learning algorithms that learn each task in isolation and from scratch. In contrast, meta-learning learns from many related tasks a meta-learner that can learn a new task more accurat…

Few-Shot Learning Meta-Learning reinforcement-learning Reinforcement Learning+1

Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness

2025-05-16 · Hanyu Duan, Yi Yang, Ahmed Abbasi, Kar Yan Tam

This paper introduces Ready2Unlearn, a learning-time optimization approach designed to facilitate future unlearning processes. Unlike the majority of existing unlearning efforts that focus on designing unlearning algorit…

Machine Unlearning Meta-Learning

Deep Reinforcement Learning for Adaptive Learning Systems

2020-04-17 · Xiao Li, Hanchen Xu, Jinming Zhang, Hua-hua Chang

In this paper, we formulate the adaptive learning problem---the problem of how to find an individualized learning plan (called policy) that chooses the most appropriate learning materials based on learner's latent traits…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

A Comprehensive Overview and Survey of Recent Advances in Meta-Learning

2020-04-17 · Huimin Peng

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing …

BIG-bench Machine Learning Deep Learning Few-Shot Learning Image Classification+2

Learning from Mistakes -- A Framework for Neural Architecture Search

2021-11-11 · Bhanu Garg, Li Zhang, Pradyumna Sridhara, Ramtin Hosseini 외

Learning from one's mistakes is an effective human learning technique where the learners focus more on the topics where mistakes were made, so as to deepen their understanding. In this paper, we investigate if this human…

BIG-bench Machine Learning Neural Architecture Search