paper-with-me

홈 › Papers

SLK-NER: Exploiting Second-order Lexicon Knowledge for Chinese NER

2020-07-16 · Dou Hu, Lingwei Wei

Although character-based models using lexicon have achieved promising results for Chinese named entity recognition (NER) task, some lexical words would introduce erroneous information due to wrongly matched words. Existing researches proposed many strategies to integrate lexicon knowledge. However, they performed with simple first-order lexicon knowledge, which provided insufficient word information and still faced the challenge of matched word boundary conflicts; or explored the lexicon knowledge with graph where higher-order information introducing negative words may disturb the identification. To alleviate the above limitations, we present new insight into second-order lexicon knowledge (SLK) of each character in the sentence to provide more lexical word information including semantic and word boundary features. Based on these, we propose a SLK-based model with a novel strategy to integrate the above lexicon knowledge. The proposed model can exploit more discernible lexical words information with the help of global context. Experimental results on three public datasets demonstrate the validity of SLK. The proposed model achieves more excellent performance than the state-of-the-art comparison methods.

📄 PDF Abstract BibTeX arXiv:2007.08416

Code (1)

zerohd4869/SLK-NER 공식 구현 pytorch

Tasks

Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSentence

Similar Papers 제목 키워드 기반

End-to-End Chinese Parsing Exploiting Lexicons

2020-12-08 · Yuan Zhang, Zhiyang Teng, Yue Zhang

Chinese parsing has traditionally been solved by three pipeline systems including word-segmentation, part-of-speech tagging and dependency parsing modules. In this paper, we propose an end-to-end Chinese parsing model ba…

Dependency ParsingGraph AttentionPart-Of-Speech TaggingSegmentation

Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter

2021-05-15 · ACL 2021 5 · Wei Liu, Xiyan Fu, Yue Zhang, Wenming Xiao

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a sha…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Part-Of-Speech Tagging

TURNER: The Uncertainty-based Retrieval Framework for Chinese NER

2022-02-18 · Zhichao Geng, Hang Yan, Zhangyue Yin, Chenxin An 외

Chinese NER is a difficult undertaking due to the ambiguity of Chinese characters and the absence of word boundaries. Previous work on Chinese NER focus on lexicon-based methods to introduce boundary information and redu…

General KnowledgeNERRetrieval

Building domain specific lexicon based on TikTok comment dataset

2020-12-16 · Hao Jiaxiang

In the sentiment analysis task, predicting the sentiment tendency of a sentence is an important branch. Previous research focused more on sentiment analysis in English, for example, analyzing the sentiment tendency of se…

SentenceSentiment AnalysisSentiment Classification

Chinese Named Entity Recognition Augmented with Lexicon Memory

2019-12-17 · Yi Zhou, Xiaoqing Zheng, Xuanjing Huang

Inspired by a concept of content-addressable retrieval from cognitive science, we propose a novel fragment-based model augmented with a lexicon-based memory for Chinese NER, in which both the character-level and word-lev…

Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3