paper-with-me

Papers

A Comprehensive Overview and Survey of Recent Advances in Meta-Learning

2020-04-17 · Huimin Peng

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike deep learning, meta-learning can be applied to few-shot high-dimensional datasets and considers further improving model generalization to unseen tasks. Deep learning is focused upon in-sample prediction and meta-learning concerns model adaptation for out-of-sample prediction. Meta-learning can continually perform self-improvement to achieve highly autonomous AI. Meta-learning may serve as an additional generalization block complementary for original deep learning model. Meta-learning seeks adaptation of machine learning models to unseen tasks which are vastly different from trained tasks. Meta-learning with coevolution between agent and environment provides solutions for complex tasks unsolvable by training from scratch. Meta-learning methodology covers a wide range of great minds and thoughts. We briefly introduce meta-learning methodologies in the following categories: black-box meta-learning, metric-based meta-learning, layered meta-learning and Bayesian meta-learning framework. Recent applications concentrate upon the integration of meta-learning with other machine learning framework to provide feasible integrated problem solutions. We briefly present recent meta-learning advances and discuss potential future research directions.

📄 PDF Abstract BibTeX arXiv:2004.11149

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDeep LearningFew-Shot LearningImage ClassificationMeta-LearningReinforcement Learning

Similar Papers 제목 키워드 기반

A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities

2022-05-13 · Yisheng Song, Ting Wang, Subrota K Mondal, Jyoti Prakash Sahoo

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samp…

Few-Shot LearningMeta-LearningSurveyTransfer Learning+1

Deep Learning Approaches to Lexical Simplification: A Survey

2023-05-19 · Kai North, Tharindu Ranasinghe, Matthew Shardlow, Marcos Zampieri

Lexical Simplification (LS) is the task of replacing complex for simpler words in a sentence whilst preserving the sentence's original meaning. LS is the lexical component of Text Simplification (TS) with the aim of maki…

Deep LearningLexical SimplificationPrompt LearningSentence+2

Multimodality in Meta-Learning: A Comprehensive Survey

2021-09-28 · Yao Ma, Shilin Zhao, Weixiao Wang, Yaoman Li 외

Meta-learning has gained wide popularity as a training framework that is more data-efficient than traditional machine learning methods. However, its generalization ability in complex task distributions, such as multimoda…

Few-Shot LearningMeta-LearningSurveyZero-Shot Learning

LLM Inference Serving: Survey of Recent Advances and Opportunities

2024-07-17 · Baolin Li, Yankai Jiang, Vijay Gadepally, Devesh Tiwari

This survey offers a comprehensive overview of recent advancements in Large Language Model (LLM) serving systems, focusing on research since the year 2023. We specifically examine system-level enhancements that improve p…

Language ModelingLanguage ModellingLarge Language ModelSurvey

A Complete Survey on Contemporary Methods, Emerging Paradigms and Hybrid Approaches for Few-Shot Learning

2024-02-05 · Georgios Tsoumplekas, Vladislav Li, Panagiotis Sarigiannidis, Vasileios Argyriou

Despite the widespread success of deep learning, its intense requirements for vast amounts of data and extensive training make it impractical for various real-world applications where data is scarce. In recent years, Few…

Few-Shot LearningIn-Context LearningMeta-LearningSurvey