paper-with-me

Papers

Document-level Clinical Entity and Relation Extraction via Knowledge Base-Guided Generation

2024-07-13 · Kriti Bhattarai, Inez Y. Oh, Zachary B. Abrams, Albert M. Lai

Generative pre-trained transformer (GPT) models have shown promise in clinical entity and relation extraction tasks because of their precise extraction and contextual understanding capability. In this work, we further leverage the Unified Medical Language System (UMLS) knowledge base to accurately identify medical concepts and improve clinical entity and relation extraction at the document level. Our framework selects UMLS concepts relevant to the text and combines them with prompts to guide language models in extracting entities. Our experiments demonstrate that this initial concept mapping and the inclusion of these mapped concepts in the prompts improves extraction results compared to few-shot extraction tasks on generic language models that do not leverage UMLS. Further, our results show that this approach is more effective than the standard Retrieval Augmented Generation (RAG) technique, where retrieved data is compared with prompt embeddings to generate results. Overall, we find that integrating UMLS concepts with GPT models significantly improves entity and relation identification, outperforming the baseline and RAG models. By combining the precise concept mapping capability of knowledge-based approaches like UMLS with the contextual understanding capability of GPT, our method highlights the potential of these approaches in specialized domains like healthcare.

📄 PDF Abstract BibTeX arXiv:2407.10021

Code (0)

등록된 구현이 없습니다.

Tasks

RAGRelationRelation ExtractionRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction

2022-05-28 · NAACL 2022 7 · Jiaxin Yu, Deqing Yang, Shuyu Tian

Compared with traditional sentence-level relation extraction, document-level relation extraction is a more challenging task where an entity in a document may be mentioned multiple times and associated with multiple relat…

Document-level Relation ExtractionRelationRelation ClassificationRelation Extraction+1

Document-level Entity-based Extraction as Template Generation

2021-09-10 · EMNLP 2021 11 · Kung-Hsiang Huang, Sam Tang, Nanyun Peng

Document-level entity-based extraction (EE), aiming at extracting entity-centric information such as entity roles and entity relations, is key to automatic knowledge acquisition from text corpora for various domains. Mos…

4-ary Relation ExtractionBinary Relation ExtractionRole-filler Entity Extraction

A Masked Image Reconstruction Network for Document-level Relation Extraction

2022-04-21 · Liang Zhang, Yidong Cheng

Document-level relation extraction aims to extract relations among entities within a document. Compared with its sentence-level counterpart, Document-level relation extraction requires inference over multiple sentences t…

Document-level Relation ExtractionImage ReconstructionRelationRelation Extraction+1

Entity and Evidence Guided Document-Level Relation Extraction

2021-08-01 · ACL (RepL4NLP) 2021 8 · Kevin Huang, Peng Qi, Guangtao Wang, Tengyu Ma 외

Document-level relation extraction is a challenging task, requiring reasoning over multiple sentences to predict a set of relations in a document. In this paper, we propose a novel framework E2GRE (Entity and Evidence Gu…

Document-level Relation ExtractionLanguage ModelingLanguage ModellingRelation+1

Coarse-to-Fine Entity Representations for Document-level Relation Extraction

2020-12-04 · Damai Dai, Jing Ren, Shuang Zeng, Baobao Chang 외

Document-level Relation Extraction (RE) requires extracting relations expressed within and across sentences. Recent works show that graph-based methods, usually constructing a document-level graph that captures document-…

Document-level Relation ExtractionRelationRelation Extraction