Textual Entailment with Dynamic Contrastive Learning for Zero-shot NER
In this paper, we study the problem of zero-shot NER, which aims at building a Named Entity Recognition (NER) system from scratch. It needs to identify the entities in the given sentences when we have zero token-level annotations for training. Previous works usually use sequential labeling models to solve the NER task and obtain weakly labeled data from entity dictionaries in the zero-shot setting. However, these labeled data are quite noisy since we need the labels for each token and the entity coverage of the dictionaries is limited. Here we propose to formulate the NER task as a Textual Entailment problem and solve the task via Textual Entailment with Dynamic Contrastive Learning (TEDC). TEDC not only alleviates the noisy labeling issue, but also transfers the knowledge from pre-trained textual entailment models. Additionally, the dynamic contrastive learning framework contrasts the entities and non-entities in the same sentence and improves the model's discrimination ability. Experiments on two datasets show that TEDC can achieve state-of-the-art performance on the task of zero-shot NER.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language InferenceNERSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zero-shot Relation Classification as Textual Entailment
We consider the task of relation classification, and pose this task as one of textual entailment. We show that this formulation leads to several advantages, including the ability to (i) perform zero-shot relation classif…
ClassificationGeneral ClassificationKnowledge Base PopulationNatural Language Inference+7ConEntail: An Entailment-based Framework for Universal Zero and Few Shot Classification with Supervised Contrastive Pretraining
A universal classification model aims to generalize to diverse classification tasks in both zero and few shot settings. A promising way toward universal classification is to cast heterogeneous data formats into a dataset…
ClassificationNatural Language InferenceQuestion AnsweringSentenceZero-shot Entailment of Leaderboards for Empirical AI Research
We present a large-scale empirical investigation of the zero-shot learning phenomena in a specific recognizing textual entailment (RTE) task category, i.e. the automated mining of leaderboards for Empirical AI Research. …
Natural Language InferenceRTEZero-Shot LearningCompositional Entailment Learning for Hyperbolic Vision-Language Models
Image-text representation learning forms a cornerstone in vision-language models, where pairs of images and textual descriptions are contrastively aligned in a shared embedding space. Since visual and textual concepts ar…
Language ModellingRepresentation LearningSentenceTextual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning
Recent work has shown that NLP tasks such as Relation Extraction (RE) can be recasted as Textual Entailment tasks using verbalizations, with strong performance in zero-shot and few-shot settings thanks to pre-trained ent…
Event Argument ExtractionNatural Language InferenceRelation ExtractionZero-shot Named Entity Recognition (NER)