paper-with-me

Papers

Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfer

2017-10-10 · David Isele, Mohammad Rostami, Eric Eaton

Knowledge transfer between tasks can improve the performance of learned models, but requires an accurate estimate of the inter-task relationships to identify the relevant knowledge to transfer. These inter-task relationships are typically estimated based on training data for each task, which is inefficient in lifelong learning settings where the goal is to learn each consecutive task rapidly from as little data as possible. To reduce this burden, we develop a lifelong learning method based on coupled dictionary learning that utilizes high-level task descriptions to model the inter-task relationships. We show that using task descriptors improves the performance of the learned task policies, providing both theoretical justification for the benefit and empirical demonstration of the improvement across a variety of learning problems. Given only the descriptor for a new task, the lifelong learner is also able to accurately predict a model for the new task through zero-shot learning using the coupled dictionary, eliminating the need to gather training data before addressing the task.

📄 PDF Abstract BibTeX arXiv:1710.03850

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDictionary LearningLifelong learningTransfer LearningZero-Shot Learning

Similar Papers 제목 키워드 기반

Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective Transfer

2020-07-14 · Aswin Raghavan, Jesse Hostetler, Indranil Sur, Abrar Rahman 외

We introduce the eigentask framework for lifelong learning. An eigentask is a pairing of a skill that solves a set of related tasks, paired with a generative model that can sample from the skill's input space. The framew…

Continual LearningLifelong learningTransfer Learning

LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videos

2023-12-07 · Ying Wang, Yanlai Yang, Mengye Ren

In this paper we introduce LifelongMemory, a new framework for accessing long-form egocentric videographic memory through natural language question answering and retrieval. LifelongMemory generates concise video activity…

EgoSchemaFormQuestion AnsweringRetrieval

Neural Topic Modeling with Continual Lifelong Learning

2020-06-19 · ICML 2020 1 · Pankaj Gupta, Yatin Chaudhary, Thomas Runkler, Hinrich Schütze

Lifelong learning has recently attracted attention in building machine learning systems that continually accumulate and transfer knowledge to help future learning. Unsupervised topic modeling has been popularly used to d…

Data AugmentationInformation RetrievalLifelong learningRetrieval+1

Regularize, Expand and Compress: Multi-task based Lifelong Learning via NonExpansive AutoML

2019-03-20 · Jie Zhang, Junting Zhang, Shalini Ghosh, Dawei Li 외

Lifelong learning, the problem of continual learning where tasks arrive in sequence, has been lately attracting more attention in the computer vision community. The aim of lifelong learning is to develop a system that ca…

AutoMLContinual LearningLifelong learning

Improving Few-Shot Image Classification Using Machine- and User-Generated Natural Language Descriptions

2022-07-07 · Findings (NAACL) 2022 7 · Kosuke Nishida, Kyosuke Nishida, Shuichi Nishioka

Humans can obtain the knowledge of novel visual concepts from language descriptions, and we thus use the few-shot image classification task to investigate whether a machine learning model can have this capability. Our pr…

DecoderFew-Shot Image Classificationimage-classificationImage Classification