Prompt-Learning for Fine-Grained Entity Typing
As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile knowledge of PLMs, prompt-learning can achieve promising results on a series of NLP tasks, such as natural language inference, sentiment classification, and knowledge probing. In this work, we investigate the application of prompt-learning on fine-grained entity typing in fully supervised, few-shot and zero-shot scenarios. We first develop a simple and effective prompt-learning pipeline by constructing entity-oriented verbalizers and templates and conducting masked language modeling. Further, to tackle the zero-shot regime, we propose a self-supervised strategy that carries out distribution-level optimization in prompt-learning to automatically summarize the information of entity types. Extensive experiments on three fine-grained entity typing benchmarks (with up to 86 classes) under fully supervised, few-shot and zero-shot settings show that prompt-learning methods significantly outperform fine-tuning baselines, especially when the training data is insufficient.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity TypingKnowledge ProbingLanguage ModelingLanguage ModellingMasked Language ModelingNatural Language InferencePrompt LearningSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
Prompt-Learning for Fine-Grained Entity Typing
As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using cloze-style language prompts to stimulate the versa…
Entity TypingKnowledge ProbingLanguage ModelingLanguage Modelling+5A Chinese Corpus for Fine-grained Entity Typing
Fine-grained entity typing is a challenging task with wide applications. However, most existing datasets for this task are in English. In this paper, we introduce a corpus for Chinese fine-grained entity typing that cont…
Cross-Lingual TransferEntity TypingTransfer LearningFew-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation
We study the problem of few-shot Fine-grained Entity Typing (FET), where only a few annotated entity mentions with contexts are given for each entity type. Recently, prompt-based tuning has demonstrated superior performa…
Entity TypingLanguage ModelingLanguage ModellingVocal Bursts Type PredictionOntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing
Fine-grained entity typing (FET), which assigns entities in text with context-sensitive, fine-grained semantic types, is a basic but important task for knowledge extraction from unstructured text. FET has been studied ex…
Entity TypingLanguage ModelingLanguage ModellingNatural Language Inference+1Fine-grained General Entity Typing in German using GermaNet
Fine-grained entity typing is important to tasks like relation extraction and knowledge base construction. We find however, that fine-grained entity typing systems perform poorly on general entities (e.g. “ex-president”)…
Entity TypingKnowledge Base ConstructionRelation ExtractionType prediction