Multi-Task Meta Learning: learn how to adapt to unseen tasks
This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple tasks, an element of MTL and promptly adapting to new tasks, a quality of meta learning. It is important to highlight that we focus on heterogeneous tasks, which are of distinct kind, in contrast to typically considered homogeneous tasks (e.g., if all tasks are classification or if all tasks are regression tasks). The fundamental idea is to train a multi-task model, such that when an unseen task is introduced, it can learn in fewer steps whilst offering a performance at least as good as conventional single task learning on the new task or inclusion within the MTL. By conducting various experiments, we demonstrate this paradigm on two datasets and four tasks: NYU-v2 and the taskonomy dataset for which we perform semantic segmentation, depth estimation, surface normal estimation, and edge detection. MTML achieves state-of-the-art results for three out of four tasks for the NYU-v2 dataset and two out of four for the taskonomy dataset. In the taskonomy dataset, it was discovered that many pseudo-labeled segmentation masks lacked classes that were expected to be present in the ground truth; however, our MTML approach was found to be effective in detecting these missing classes, delivering good qualitative results. While, quantitatively its performance was affected due to the presence of incorrect ground truth labels. The the source code for reproducibility can be found at https://github.com/ricupa/MTML-learn-how-to-adapt-to-unseen-tasks.
Code (1)
Tasks
Depth EstimationEdge DetectionMeta-LearningMulti-Task LearningSemantic SegmentationSurface Normal EstimationSimilar Papers 제목 키워드 기반
MAML-en-LLM: Model Agnostic Meta-Training of LLMs for Improved In-Context Learning
Adapting large language models (LLMs) to unseen tasks with in-context training samples without fine-tuning remains an important research problem. To learn a robust LLM that adapts well to unseen tasks, multiple meta-trai…
In-Context LearningMetaWeather: Few-Shot Weather-Degraded Image Restoration
Real-world weather conditions are intricate and often occur concurrently. However, most existing restoration approaches are limited in their applicability to specific weather conditions in training data and struggle to g…
Image RestorationMeta-LearningSingle Particle AnalysisSSIMA Comprehensive Overview and Survey of Recent Advances in Meta-Learning
This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing …
BIG-bench Machine LearningDeep LearningFew-Shot LearningImage Classification+2PERIL: Probabilistic Embeddings for hybrid Meta-Reinforcement and Imitation Learning
Imitation learning is a natural way for a human to describe a task to an agent, and it can be combined with reinforcement learning to enable the agent to solve that task through exploration. However, traditional methods …
Imitation LearningMeta Reinforcement Learningreinforcement-learningReinforcement Learning+1Meta Learning MPC using Finite-Dimensional Gaussian Process Approximations
Data availability has dramatically increased in recent years, driving model-based control methods to exploit learning techniques for improving the system description, and thus control performance. Two key factors that hi…
Autonomous RacingMeta-LearningModel Predictive Controlregression