Predicting Document Coverage for Relation Extraction
This paper presents a new task of predicting the coverage of a text document for relation extraction (RE): does the document contain many relational tuples for a given entity? Coverage predictions are useful in selecting the best documents for knowledge base construction with large input corpora. To study this problem, we present a dataset of 31,366 diverse documents for 520 entities. We analyze the correlation of document coverage with features like length, entity mention frequency, Alexa rank, language complexity and information retrieval scores. Each of these features has only moderate predictive power. We employ methods combining features with statistical models like TF-IDF and language models like BERT. The model combining features and BERT, HERB, achieves an F1 score of up to 46%. We demonstrate the utility of coverage predictions on two use cases: KB construction and claim refutation.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalKnowledge Base ConstructionRelationRelation ExtractionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Document-level Relation Extraction as Semantic Segmentation
Document-level relation extraction aims to extract relations among multiple entity pairs from a document. Previously proposed graph-based or transformer-based models utilize the entities independently, regardless of glob…
Document-level Relation ExtractionRelationRelation ExtractionSegmentation+1EIDER: Evidence-enhanced Document-level Relation Extraction
Document-level relation extraction (DocRE) aims at extracting the semantic relations among entity pairs in a document. In DocRE, a subset of the sentences in a document, called the evidence sentences, might be sufficient…
Document-level Relation ExtractionRelationRelation ExtractionSentenceSocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction
Constructing Knowledge Graphs (KGs) from unstructured text provides a structured framework for knowledge representation and reasoning, yet current LLM-based approaches struggle with a fundamental trade-off: factual cover…
Knowledge GraphsKey Mention Pairs Guided Document-Level Relation Extraction
Document-level Relation Extraction (DocRE) aims at extracting relations between entities in a given document. Since different mention pairs may express different relations or even no relation, it is crucial to identify k…
Document-level Relation ExtractionRelationRelation ExtractionGREG: A Global Level Relation Extraction with Knowledge Graph Embedding
In an age overflowing with information, the task of converting unstructured data into structured data are a vital task of great need. Currently, most relation extraction modules are more focused on the extraction of loca…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsKnowledge Graphs+2