paper-with-me

Papers

Textual Entailment with Dynamic Contrastive Learning for Zero-shot NER

2021-11-16 · ACL ARR November 2021 11 · Anonymous

In this paper, we study the problem of zero-shot NER, which aims at building a Named Entity Recognition (NER) system from scratch. It needs to identify the entities in the given sentences when we have zero token-level annotations for training. Previous works usually use sequential labeling models to solve the NER task and obtain weakly labeled data from entity dictionaries in the zero-shot setting. However, these labeled data are quite noisy since we need the labels for each token and the entity coverage of the dictionaries is limited. Here we propose to formulate the NER task as a Textual Entailment problem and solve the task via Textual Entailment with Dynamic Contrastive Learning (TEDC). TEDC not only alleviates the noisy labeling issue, but also transfers the knowledge from pre-trained textual entailment models. Additionally, the dynamic contrastive learning framework contrasts the entities and non-entities in the same sentence and improves the model's discrimination ability. Experiments on two datasets show that TEDC can achieve state-of-the-art performance on the task of zero-shot NER.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language InferenceNERSentence

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Zero-shot Relation Classification as Textual Entailment

2018-11-01 · WS 2018 11 · Abiola Obamuyide, Andreas Vlachos

We consider the task of relation classification, and pose this task as one of textual entailment. We show that this formulation leads to several advantages, including the ability to (i) perform zero-shot relation classif…

ClassificationGeneral ClassificationKnowledge Base PopulationNatural Language Inference+7

ConEntail: An Entailment-based Framework for Universal Zero and Few Shot Classification with Supervised Contrastive Pretraining

2022-10-14 · Ranran Haoran Zhang, Aysa Xuemo Fan, Rui Zhang

A universal classification model aims to generalize to diverse classification tasks in both zero and few shot settings. A promising way toward universal classification is to cast heterogeneous data formats into a dataset…

ClassificationNatural Language InferenceQuestion AnsweringSentence

Zero-shot Entailment of Leaderboards for Empirical AI Research

2023-03-29 · Salomon Kabongo, Jennifer D'Souza, Sören Auer

We present a large-scale empirical investigation of the zero-shot learning phenomena in a specific recognizing textual entailment (RTE) task category, i.e. the automated mining of leaderboards for Empirical AI Research. …

Natural Language InferenceRTEZero-Shot Learning

Compositional Entailment Learning for Hyperbolic Vision-Language Models

2024-10-09 · Avik Pal, Max van Spengler, Guido Maria D'Amely di Melendugno, Alessandro Flaborea 외

Image-text representation learning forms a cornerstone in vision-language models, where pairs of images and textual descriptions are contrastively aligned in a shared embedding space. Since visual and textual concepts ar…

Language ModellingRepresentation LearningSentence

Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning

2022-05-03 · Findings (NAACL) 2022 7 · Oscar Sainz, Itziar Gonzalez-Dios, Oier Lopez de Lacalle, Bonan Min 외

Recent work has shown that NLP tasks such as Relation Extraction (RE) can be recasted as Textual Entailment tasks using verbalizations, with strong performance in zero-shot and few-shot settings thanks to pre-trained ent…

Event Argument ExtractionNatural Language InferenceRelation ExtractionZero-shot Named Entity Recognition (NER)