paper-with-me

홈 › Papers

Meta-Learned Models of Cognition

2023-04-12 · Marcel Binz, Ishita Dasgupta, Akshay Jagadish, Matthew Botvinick, Jane X. Wang, Eric Schulz

Meta-learning is a framework for learning learning algorithms through repeated interactions with an environment as opposed to designing them by hand. In recent years, this framework has established itself as a promising tool for building models of human cognition. Yet, a coherent research program around meta-learned models of cognition is still missing. The purpose of this article is to synthesize previous work in this field and establish such a research program. We rely on three key pillars to accomplish this goal. We first point out that meta-learning can be used to construct Bayes-optimal learning algorithms. This result not only implies that any behavioral phenomenon that can be explained by a Bayesian model can also be explained by a meta-learned model but also allows us to draw strong connections to the rational analysis of cognition. We then discuss several advantages of the meta-learning framework over traditional Bayesian methods. In particular, we argue that meta-learning can be applied to situations where Bayesian inference is impossible and that it enables us to make rational models of cognition more realistic, either by incorporating limited computational resources or neuroscientific knowledge. Finally, we reexamine prior studies from psychology and neuroscience that have applied meta-learning and put them into the context of these new insights. In summary, our work highlights that meta-learning considerably extends the scope of rational analysis and thereby of cognitive theories more generally.

📄 PDF Abstract BibTeX arXiv:2304.06729

Code (1)

marcelbinz/meta-learned-models 공식 구현

Tasks

Bayesian InferenceMeta-Learning

Similar Papers 제목 키워드 기반

Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources

2019-11-14 · Qianhui Wu, Zijia Lin, Guoxin Wang, Hui Chen 외

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned…

Cross-Lingual NERCross-Lingual TransferMeta-Learningnamed-entity-recognition+4

Meta Learning for End-to-End Low-Resource Speech Recognition

2019-10-26 · Jui-Yang Hsu, Yuan-Jui Chen, Hung-Yi Lee

In this paper, we proposed to apply meta learning approach for low-resource automatic speech recognition (ASR). We formulated ASR for different languages as different tasks, and meta-learned the initialization parameters…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Meta-Learningspeech-recognition+1

Deep Meta-Learning: Learning to Learn in the Concept Space

2018-02-10 · Fengwei Zhou, Bin Wu, Zhenguo Li

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learn…

Few-Shot LearningMeta-Learning

Meta-Learning for Effective Multi-task and Multilingual Modelling

2021-01-25 · EACL 2021 2 · Ishan Tarunesh, Sushil Khyalia, Vishwajeet Kumar, Ganesh Ramakrishnan 외

Natural language processing (NLP) tasks (e.g. question-answering in English) benefit from knowledge of other tasks (e.g. named entity recognition in English) and knowledge of other languages (e.g. question-answering in S…

Meta-Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Meta-Learning MCMC Proposals

2017-08-21 · NeurIPS 2018 12 · Tongzhou Wang, Yi Wu, David A. Moore, Stuart J. Russell

Effective implementations of sampling-based probabilistic inference often require manually constructed, model-specific proposals. Inspired by recent progresses in meta-learning for training learning agents that can gener…

Meta-Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)