paper-with-me

Papers

Extended Few-Shot Learning: Exploiting Existing Resources for Novel Tasks

2020-12-13 · Reza Esfandiarpoor, Amy Pu, Mohsen Hajabdollahi, Stephen H. Bach

In many practical few-shot learning problems, even though labeled examples are scarce, there are abundant auxiliary datasets that potentially contain useful information. We propose the problem of extended few-shot learning to study these scenarios. We then introduce a framework to address the challenges of efficiently selecting and effectively using auxiliary data in few-shot image classification. Given a large auxiliary dataset and a notion of semantic similarity among classes, we automatically select pseudo shots, which are labeled examples from other classes related to the target task. We show that naive approaches, such as (1) modeling these additional examples the same as the target task examples or (2) using them to learn features via transfer learning, only increase accuracy by a modest amount. Instead, we propose a masking module that adjusts the features of auxiliary data to be more similar to those of the target classes. We show that this masking module performs better than naively modeling the support examples and transfer learning by 4.68 and 6.03 percentage points, respectively.

📄 PDF Abstract BibTeX arXiv:2012.07176

Code (2)

BatsResearch/efsl 공식 구현 pytorch
Reza-esfandiarpoor/pseudo-shots 공식 구현 pytorch

Tasks

Few-Shot Image ClassificationFew-Shot Learningimage-classificationImage ClassificationSemantic SimilaritySemantic Textual SimilarityTransfer Learning

Similar Papers 제목 키워드 기반

Self-Training Pre-Trained Language Models for Zero- and Few-Shot Multi-Dialectal Arabic Sequence Labeling

2021-01-12 · EACL 2021 2 · Muhammad Khalifa, Muhammad Abdul-Mageed, Khaled Shaalan

A sufficient amount of annotated data is usually required to fine-tune pre-trained language models for downstream tasks. Unfortunately, attaining labeled data can be costly, especially for multiple language varieties and…

Language ModellingNERPOSPOS Tagging

Exploiting Language Model Prompts Using Similarity Measures: A Case Study on the Word-in-Context Task

2022-05-01 · ACL 2022 5 · Mohsen Tabasi, Kiamehr Rezaee, Mohammad Taher Pilehvar

As a recent development in few-shot learning, prompt-based techniques have demonstrated promising potential in a variety of natural language processing tasks. However, despite proving competitive on most tasks in the GLU…

Few-Shot LearningIn-Context LearningLanguage ModelingLanguage Modelling

Generalized Reinforcement Meta Learning for Few-Shot Optimization

2020-05-04 · Raviteja Anantha, Stephen Pulman, Srinivas Chappidi

We present a generic and flexible Reinforcement Learning (RL) based meta-learning framework for the problem of few-shot learning. During training, it learns the best optimization algorithm to produce a learner (ranker/cl…

DecoderFew-Shot LearningMeta-LearningReinforcement Learning (RL)

Spicy Salmon: Converting between 50+ Annotation Formats with Fintan, Pepper, Salt and Powla

2022-06-01 · LDL (ACL) 2022 6 · Christian Fäth, Christian Chiarcos

Heterogeneity of formats, models and annotations has always been a primary hindrance for exploiting the ever increasing amount of existing linguistic resources for real world applications in and beyond NLP. Fintan - the …

Active PETs: Active Data Annotation Prioritisation for Few-Shot Claim Verification with Pattern Exploiting Training

2022-08-18 · Xia Zeng, Arkaitz Zubiaga

To mitigate the impact of the scarcity of labelled data on fact-checking systems, we focus on few-shot claim verification. Despite recent work on few-shot classification by proposing advanced language models, there is a …

Active LearningClaim VerificationFact Checking