paper-with-me

홈 › Papers

AutoRE: Document-Level Relation Extraction with Large Language Models

2024-03-21 · Lilong Xue, Dan Zhang, Yuxiao Dong, Jie Tang

Large Language Models (LLMs) have demonstrated exceptional abilities in comprehending and generating text, motivating numerous researchers to utilize them for Information Extraction (IE) purposes, including Relation Extraction (RE). Nonetheless, most existing methods are predominantly designed for Sentence-level Relation Extraction (SentRE) tasks, which typically encompass a restricted set of relations and triplet facts within a single sentence. Furthermore, certain approaches resort to treating relations as candidate choices integrated into prompt templates, leading to inefficient processing and suboptimal performance when tackling Document-Level Relation Extraction (DocRE) tasks, which entail handling multiple relations and triplet facts distributed across a given document, posing distinct challenges. To overcome these limitations, we introduce AutoRE, an end-to-end DocRE model that adopts a novel RE extraction paradigm named RHF (Relation-Head-Facts). Unlike existing approaches, AutoRE does not rely on the assumption of known relation options, making it more reflective of real-world scenarios. Additionally, we have developed an easily extensible RE framework using a Parameters Efficient Fine Tuning (PEFT) algorithm (QLoRA). Our experiments on the RE-DocRED dataset showcase AutoRE's best performance, achieving state-of-the-art results, surpassing TAG by 10.03\% and 9.03\% respectively on the dev and test set. The code is available at https://github.com/THUDM/AutoRE and the demonstration video is provided at https://www.youtube.com/watch?v=IhKRsZUAxKk.

📄 PDF Abstract BibTeX arXiv:2403.14888

Code (2)

bigdante/autore 공식 구현
thudm/autore 공식 구현

Tasks

Document-level Relation ExtractionRelationRelation ExtractionSentenceTAGTriplet

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

PromptRE: Weakly-Supervised Document-Level Relation Extraction via Prompting-Based Data Programming

2023-10-13 · Chufan Gao, Xulin Fan, Jimeng Sun, Xuan Wang

Relation extraction aims to classify the relationships between two entities into pre-defined categories. While previous research has mainly focused on sentence-level relation extraction, recent studies have expanded the …

Document-level Relation ExtractionRelationRelation ClassificationRelation Extraction+1

TTM-RE: Memory-Augmented Document-Level Relation Extraction

2024-06-09 · Chufan Gao, Xuan Wang, Jimeng Sun

Document-level relation extraction aims to categorize the association between any two entities within a document. We find that previous methods for document-level relation extraction are ineffective in exploiting the ful…

Document-level Relation ExtractionDocument-level RE with incomplete labelingRelationRelation Extraction

Document-Level In-Context Few-Shot Relation Extraction via Pre-Trained Language Models

2023-10-17 · Yilmazcan Ozyurt, Stefan Feuerriegel, Ce Zhang

Document-level relation extraction aims at inferring structured human knowledge from textual documents. State-of-the-art methods for this task use pre-trained language models (LMs) via fine-tuning, yet fine-tuning is com…

Document-level Relation ExtractionFew-Shot Learningnamed-entity-recognitionNamed Entity Recognition+2

Entity and Evidence Guided Document-Level Relation Extraction

2021-08-01 · ACL (RepL4NLP) 2021 8 · Kevin Huang, Peng Qi, Guangtao Wang, Tengyu Ma 외

Document-level relation extraction is a challenging task, requiring reasoning over multiple sentences to predict a set of relations in a document. In this paper, we propose a novel framework E2GRE (Entity and Evidence Gu…

Document-level Relation ExtractionLanguage ModelingLanguage ModellingRelation+1

Denoising Relation Extraction from Document-level Distant Supervision

2020-11-08 · EMNLP 2020 11 · Chaojun Xiao, Yuan YAO, Ruobing Xie, Xu Han 외

Distant supervision (DS) has been widely used to generate auto-labeled data for sentence-level relation extraction (RE), which improves RE performance. However, the existing success of DS cannot be directly transferred t…

DenoisingDocument-level Relation ExtractionRelationRelation Extraction+1