paper-with-me

Papers

Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning

2024-04-10 · Peipei Liu, Gaosheng Wang, Ying Tong, Jian Liang, Zhenquan Ding, Hongsong Zhu

Few-shot named entity recognition can identify new types of named entities based on a few labeled examples. Previous methods employing token-level or span-level metric learning suffer from the computational burden and a large number of negative sample spans. In this paper, we propose the Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning (MsFNER), which splits the general NER into two stages: entity-span detection and entity classification. There are 3 processes for introducing MsFNER: training, finetuning, and inference. In the training process, we train and get the best entity-span detection model and the entity classification model separately on the source domain using meta-learning, where we create a contrastive learning module to enhance entity representations for entity classification. During finetuning, we finetune the both models on the support dataset of target domain. In the inference process, for the unlabeled data, we first detect the entity-spans, then the entity-spans are jointly determined by the entity classification model and the KNN. We conduct experiments on the open FewNERD dataset and the results demonstrate the advance of MsFNER.

📄 PDF Abstract BibTeX arXiv:2404.06970

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationContrastive Learningfew-shot-nerFew-shot NERMeta-LearningMetric Learningnamed-entity-recognitionNamed Entity RecognitionNER

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

2022-03-17 · Findings (ACL) 2022 5 · Yew Ken Chia, Lidong Bing, Soujanya Poria, Luo Si

Despite the importance of relation extraction in building and representing knowledge, less research is focused on generalizing to unseen relations types. We introduce the task setting of Zero-Shot Relation Triplet Extrac…

Language ModelingLanguage ModellingRelationRelation Classification+5

A Read-and-Select Framework for Zero-shot Entity Linking

2023-10-19 · Zhenran Xu, Yulin Chen, Baotian Hu, Min Zhang

Zero-shot entity linking (EL) aims at aligning entity mentions to unseen entities to challenge the generalization ability. Previous methods largely focus on the candidate retrieval stage and ignore the essential candidat…

Entity DisambiguationEntity LinkingRetrieval

Transferable Decoding with Visual Entities for Zero-Shot Image Captioning

2023-07-31 · ICCV 2023 1 · Junjie Fei, Teng Wang, Jinrui Zhang, Zhenyu He 외

Image-to-text generation aims to describe images using natural language. Recently, zero-shot image captioning based on pre-trained vision-language models (VLMs) and large language models (LLMs) has made significant progr…

Caption GenerationHallucinationImage CaptioningImage to text+2

MIA 2022 Shared Task Submission: Leveraging Entity Representations, Dense-Sparse Hybrids, and Fusion-in-Decoder for Cross-Lingual Question Answering

2022-07-05 · NAACL (MIA) 2022 7 · Zhucheng Tu, Sarguna Janani Padmanabhan

We describe our two-stage system for the Multilingual Information Access (MIA) 2022 Shared Task on Cross-Lingual Open-Retrieval Question Answering. The first stage consists of multilingual passage retrieval with a hybrid…

Cross-Lingual Question AnsweringDecoderLanguage ModelingLanguage Modelling+3

Improving Few-shot and Zero-shot Entity Linking with Coarse-to-Fine Lexicon-based Retriever

2023-08-07 · Shijue Huang, Bingbing Wang, Libo Qin, Qin Zhao 외

Few-shot and zero-shot entity linking focus on the tail and emerging entities, which are more challenging but closer to real-world scenarios. The mainstream method is the ''retrieve and rerank'' two-stage framework. In t…

Entity LinkingRetrieval