Few-shot Named Entity Recognition with Cloze Questions
Despite the huge and continuous advances in computational linguistics, the lack of annotated data for Named Entity Recognition (NER) is still a challenging issue, especially in low-resource languages and when domain knowledge is required for high-quality annotations. Recent findings in NLP show the effectiveness of cloze-style questions in enabling language models to leverage the knowledge they acquired during the pre-training phase. In our work, we propose a simple and intuitive adaptation of Pattern-Exploiting Training (PET), a recent approach which combines the cloze-questions mechanism and fine-tuning for few-shot learning: the key idea is to rephrase the NER task with patterns. Our approach achieves considerably better performance than standard fine-tuning and comparable or improved results with respect to other few-shot baselines without relying on manually annotated data or distant supervision on three benchmark datasets: NCBI-disease, BC2GM and a private Italian biomedical corpus.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Question Answering by Cloze Translation
Obtaining training data for Question Answering (QA) is time-consuming and resource-intensive, and existing QA datasets are only available for limited domains and languages. In this work, we explore to what extent high qu…
Natural QuestionsNMTQuestion AnsweringTranslationSimple Questions Generate Named Entity Recognition Datasets
Recent named entity recognition (NER) models often rely on human-annotated datasets, requiring the significant engagement of professional knowledge on the target domain and entities. This research introduces an ask-to-ge…
Few-shot NERNamed Entity RecognitionNamed Entity Recognition (NER)Open-Domain Question Answering+1Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Recent advances in prompt-based learning have shown strong results on few-shot text classification by using cloze-style templates. Similar attempts have been made on named entity recognition (NER) which manually design t…
Domain AdaptationFew-Shot Text ClassificationIn-Context Learningnamed-entity-recognition+6Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Recent advances in prompt-based learning have shown strong results on few-shot text classification by using cloze-style templates. Similar attempts have been made on named entity recognition (NER) which manually design t…
Domain AdaptationFew-Shot Text ClassificationIn-Context Learningnamed-entity-recognition+6Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the proble…
Entity TypingFew-shot NERMeta-LearningNamed Entity Recognition+1