paper-with-me

Papers

A Meta-Learning Approach for Custom Model Training

2018-09-21 · Amir Erfan Eshratifar, Mohammad Saeed Abrishami, David Eigen, Massoud Pedram

Transfer-learning and meta-learning are two effective methods to apply knowledge learned from large data sources to new tasks. In few-class, few-shot target task settings (i.e. when there are only a few classes and training examples available in the target task), meta-learning approaches that optimize for future task learning have outperformed the typical transfer approach of initializing model weights from a pre-trained starting point. But as we experimentally show, meta-learning algorithms that work well in the few-class setting do not generalize well in many-shot and many-class cases. In this paper, we propose a joint training approach that combines both transfer-learning and meta-learning. Benefiting from the advantages of each, our method obtains improved generalization performance on unseen target tasks in both few- and many-class and few- and many-shot scenarios.

📄 PDF Abstract BibTeX arXiv:1809.08346

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-LearningmodelTransfer Learning

Similar Papers 제목 키워드 기반

$FastDoc$: Domain-Specific Fast Continual Pre-training Technique using Document-Level Metadata and Taxonomy

2023-06-09 · Abhilash Nandy, Manav Nitin Kapadnis, Sohan Patnaik, Yash Parag Butala 외

In this paper, we propose $FastDoc$ (Fast Continual Pre-training Technique using Document Level Metadata and Taxonomy), a novel, compute-efficient framework that utilizes Document metadata and Domain-Specific Taxonomy as…

Sentence

MetaAnchor: Learning to Detect Objects with Customized Anchors

2018-07-03 · NeurIPS 2018 12 · Tong Yang, Xiangyu Zhang, Zeming Li, Wenqiang Zhang 외

We propose a novel and flexible anchor mechanism named MetaAnchor for object detection frameworks. Unlike many previous detectors model anchors via a predefined manner, in MetaAnchor anchor functions could be dynamically…

Objectobject-detectionObject Detection

MDG: Metaphorical Sentence Detection and Generation with Masked Metaphor Modeling

2021-11-16 · ACL ARR November 2021 11 · Anonymous

This study tackles literal to metaphorical sentence generation, presenting a framework that can potentially lead to the production of an infinite number of new metaphors. To achieve this goal, we propose a complete workf…

SentenceSentence Classification

Categorical Metadata Representation for Customized Text Classification

2019-02-14 · TACL 2019 3 · Jihyeok Kim, Reinald Kim Amplayo, Kyungjae Lee, Sua Sung 외

The performance of text classification has improved tremendously using intelligently engineered neural-based models, especially those injecting categorical metadata as additional information, e.g., using user/product inf…

ClassificationGeneral ClassificationSentenceSentiment Analysis+4

Meta-Reasoning Improves Tool Use in Large Language Models

2024-11-07 · Lisa Alazraki, Marek Rei

External tools help large language models (LLMs) succeed at tasks where they would otherwise typically fail. In existing frameworks, LLMs learn tool use either by in-context demonstrations or via full model fine-tuning o…

Math