paper-with-me

홈 › Papers

WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition

2022-03-14 · Renjie Zhou, Qiang Hu, Jian Wan, Jilin Zhang, Qiang Liu, Tianxiang Hu, Jianjun Li

Named Entity Recognition task is one of the core tasks of information extraction. Word ambiguity and word abbreviation are important reasons for the low recognition rate of named entities. In this paper, we propose a novel named entity recognition model WCL-BBCD (Word Contrastive Learning with BERT-BiLSTM-CRF-DBpedia), which incorporates the idea of contrastive learning. The model first trains the sentence pairs in the text, calculate similarity between sentence pairs, and fine-tunes BERT used for the named entity recognition task according to the similarity, so as to alleviate word ambiguity. Then, the fine-tuned BERT is combined with BiLSTM-CRF to perform the named entity recognition task. Finally, the recognition results are corrected in combination with prior knowledge such as knowledge graphs, so as to alleviate the low-recognition-rate problem caused by word abbreviations. The results of experimentals conducted on the CoNLL-2003 English dataset and OntoNotes V5 English dataset show that our model outperforms other similar models on.

📄 PDF Abstract BibTeX arXiv:2203.06925

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningKnowledge Graphsnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Sentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Contrastive Learning 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Weight Decay 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Multi-Granularity Contrastive Knowledge Distillation for Multimodal Named Entity Recognition

2021-11-16 · ACL ARR November 2021 11 · Anonymous

It is very valuable to recognize named entities from short and informal multimodal posts in this age of information explosion. Despite existing methods success in multi-modal named entity recognition (MNER), they rely on…

Knowledge DistillationMulti-modal Named Entity Recognitionnamed-entity-recognitionNamed Entity Recognition+1

Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System

2022-04-19 · Ding Zou, Wei Wei, Xian-Ling Mao, Ziyang Wang 외

Knowledge graph (KG) plays an increasingly important role in recommender systems. Recently, graph neural networks (GNNs) based model has gradually become the theme of knowledge-aware recommendation (KGR). However, there …

Contrastive LearningData Augmentationgraph constructionKnowledge-Aware Recommendation+1

Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

2023-10-18 · Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li 외

Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an en…

Contrastive LearningEntity TypingKnowledge GraphsMixture-of-Experts

CLLMFS: A Contrastive Learning enhanced Large Language Model Framework for Few-Shot Named Entity Recognition

2024-08-23 · Yafeng Zhang, Zilan Yu, Yuang Huang, Jing Tang

Few-shot Named Entity Recognition (NER), the task of identifying named entities with only a limited amount of labeled data, has gained increasing significance in natural language processing. While existing methodologies …

Contrastive Learningfew-shot-nerFew-shot NERLanguage Modeling+7

KoGNER: A Novel Framework for Knowledge Graph Distillation on Biomedical Named Entity Recognition

2025-03-19 · Heming Zhang, Wenyu Li, Di Huang, Yinjie Tang 외

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that plays a crucial role in information extraction, question answering, and knowledge-based systems. Traditional deep learning-ba…

Knowledge DistillationKnowledge Graphsnamed-entity-recognitionNamed Entity Recognition+3