Dual Supervision Framework for Relation Extraction with Distant Supervision and Human Annotation
Relation extraction (RE) has been extensively studied due to its importance in real-world applications such as knowledge base construction and question answering. Most of the existing works train the models on either distantly supervised data or human-annotated data. To take advantage of the high accuracy of human annotation and the cheap cost of distant supervision, we propose the dual supervision framework which effectively utilizes both types of data. However, simply combining the two types of data to train a RE model may decrease the prediction accuracy since distant supervision has labeling bias. We employ two separate prediction networks HA-Net and DS-Net to predict the labels by human annotation and distant supervision, respectively, to prevent the degradation of accuracy by the incorrect labeling of distant supervision. Furthermore, we propose an additional loss term called disagreement penalty to enable HA-Net to learn from distantly supervised labels. In addition, we exploit additional networks to adaptively assess the labeling bias by considering contextual information. Our performance study on sentence-level and document-level REs confirms the effectiveness of the dual supervision framework.
Code (1)
Tasks
Knowledge Base ConstructionRelationRelation ExtractionSentenceSimilar Papers 제목 키워드 기반
RDSGAN: Rank-based Distant Supervision Relation Extraction with Generative Adversarial Framework
Distant supervision has been widely used for relation extraction but suffers from noise labeling problem. Neural network models are proposed to denoise with attention mechanism but cannot eliminate noisy data due to its …
RelationRelation ExtractionvalidTowards Time-Aware Distant Supervision for Relation Extraction
Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-…
RelationRelation ExtractionTime SeriesTime Series AnalysisImproving Distantly Supervised Relation Extraction using Word and Entity Based Attention
Relation extraction is the problem of classifying the relationship between two entities in a given sentence. Distant Supervision (DS) is a popular technique for developing relation extractors starting with limited superv…
RelationRelation ExtractionRelationship Extraction (Distant Supervised)SentenceGAN Driven Semi-distant Supervision for Relation Extraction
Distant supervision has been widely used in relation extraction tasks without hand-labeled datasets recently. However, the automatically constructed datasets comprise numbers of wrongly labeled negative instances due to …
Generative Adversarial NetworkRelationRelation ExtractionSentence Bag Graph Formulation for Biomedical Distant Supervision Relation Extraction
We introduce a novel graph-based framework for alleviating key challenges in distantly-supervised relation extraction and demonstrate its effectiveness in the challenging and important domain of biomedical data. Specific…
RelationRelation ExtractionSentence