paper-with-me

Papers

Augmenting Named Entity Recognition with Commonsense Knowledge

2019-08-01 · WS 2019 8 · Gaith Dekhili, Tan Ngoc Le, Fatiha Sadat

Commonsense can be vital in some applications like Natural Language Understanding (NLU), where it is often required to resolve ambiguity arising from implicit knowledge and underspecification. In spite of the remarkable success of neural network approaches on a variety of Natural Language Processing tasks, many of them struggle to react effectively in cases that require commonsense knowledge. In the present research, we take advantage of the availability of the open multilingual knowledge graph ConceptNet, by using it as an additional external resource in Named Entity Recognition (NER). Our proposed architecture involves BiLSTM layers combined with a CRF layer that was augmented with some features such as pre-trained word embedding layers and dropout layers. Moreover, apart from using word representations, we used also character-based representation to capture the morphological and the orthographic information. Our experiments and evaluations showed an improvement in the overall performance with +2.86 in the F1-measure. Commonsense reasonnig has been employed in other studies and NLP tasks but to the best of our knowledge, there is no study relating the integration of a commonsense knowledge base in NER.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language UnderstandingNER

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

2019-04-09 · NAACL 2019 6 · Angli Liu, Jingfei Du, Veselin Stoyanov

Traditional language models are unable to efficiently model entity names observed in text. All but the most popular named entities appear infrequently in text providing insufficient context. Recent efforts have recognize…

Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+3

Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generation

2022-05-27 · NAACL 2022 7 · Deeksha Varshney, Akshara Prabhakar, Asif Ekbal

Grounding dialogue on external knowledge and interpreting linguistic patterns in dialogue history context, such as ellipsis, anaphora, and co-references is critical for dialogue comprehension and generation. In this pape…

Dialogue Generation

How to Understand Named Entities: Using Common Sense for News Captioning

2024-03-11 · Ning Xu, Yanhui Wang, Tingting Zhang, Hongshuo Tian 외

News captioning aims to describe an image with its news article body as input. It greatly relies on a set of detected named entities, including real-world people, organizations, and places. This paper exploits commonsens…

Common Sense Reasoning

Few-Shot Class-Incremental Learning for Named Entity Recognition

2022-05-01 · ACL 2022 5 · Rui Wang, Tong Yu, Handong Zhao, Sungchul Kim 외

Previous work of class-incremental learning for Named Entity Recognition (NER) relies on the assumption that there exists abundance of labeled data for the training of new classes. In this work, we study a more challengi…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+4

Chain-of-Thought Prompt Distillation for Multimodal Named Entity Recognition and Multimodal Relation Extraction

2023-06-25 · Feng Chen, Yujian Feng

Multimodal Named Entity Recognition (MNER) and Multimodal Relation Extraction (MRE) necessitate the fundamental reasoning capacity for intricate linguistic and multimodal comprehension. In this study, we explore distilli…

Data AugmentationDomain Generalizationnamed-entity-recognitionNamed Entity Recognition+3