An Overview of Distant Supervision for Relation Extraction with a Focus on Denoising and Pre-training Methods
Relation Extraction (RE) is a foundational task of natural language processing. RE seeks to transform raw, unstructured text into structured knowledge by identifying relational information between entity pairs found in text. RE has numerous uses, such as knowledge graph completion, text summarization, question-answering, and search querying. The history of RE methods can be roughly organized into four phases: pattern-based RE, statistical-based RE, neural-based RE, and large language model-based RE. This survey begins with an overview of a few exemplary works in the earlier phases of RE, highlighting limitations and shortcomings to contextualize progress. Next, we review popular benchmarks and critically examine metrics used to assess RE performance. We then discuss distant supervision, a paradigm that has shaped the development of modern RE methods. Lastly, we review recent RE works focusing on denoising and pre-training methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingKnowledge Graph CompletionLanguage ModelingLanguage ModellingLarge Language ModelQuestion AnsweringRelation ExtractionText SummarizationSimilar Papers 제목 키워드 기반
Deep Neural Network Based Relation Extraction: An Overview
Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations…
RelationRelation ExtractionSentenceImproving Distantly Supervised Relation Extraction using Word and Entity Based Attention
Relation extraction is the problem of classifying the relationship between two entities in a given sentence. Distant Supervision (DS) is a popular technique for developing relation extractors starting with limited superv…
RelationRelation ExtractionRelationship Extraction (Distant Supervised)SentenceEnhanced Distant Supervision with State-Change Information for Relation Extraction
In this work, we introduce a method for enhancing distant supervision with state-change information for relation extraction. We provide a training dataset created via this process, along with manually annotated developme…
RelationRelation ExtractionH-FND: Hierarchical False-Negative Denoising for Distant Supervision Relation Extraction
Although distant supervision automatically generates training data for relation extraction, it also introduces false-positive (FP) and false-negative (FN) training instances to the generated datasets. Whereas both types …
DenoisingRelationRelation ExtractionEffective Slot Filling Based on Shallow Distant Supervision Methods
Spoken Language Systems at Saarland University (LSV) participated this year with 5 runs at the TAC KBP English slot filling track. Effective algorithms for all parts of the pipeline, from document retrieval to relation p…
RelationRelation ExtractionRelation PredictionRetrieval+3