Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning
Distant supervision has become the standard method for relation extraction. However, even though it is an efficient method, it does not come at no cost---The resulted distantly-supervised training samples are often very noisy. To combat the noise, most of the recent state-of-the-art approaches focus on selecting one-best sentence or calculating soft attention weights over the set of the sentences of one specific entity pair. However, these methods are suboptimal, and the false positive problem is still a key stumbling bottleneck for the performance. We argue that those incorrectly-labeled candidate sentences must be treated with a hard decision, rather than being dealt with soft attention weights. To do this, our paper describes a radical solution---We explore a deep reinforcement learning strategy to generate the false-positive indicator, where we automatically recognize false positives for each relation type without any supervised information. Unlike the removal operation in the previous studies, we redistribute them into the negative examples. The experimental results show that the proposed strategy significantly improves the performance of distant supervision comparing to state-of-the-art systems.
Code (2)
Tasks
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)RelationRelation ExtractionSentenceSimilar Papers 제목 키워드 기반
Improving Distantly Supervised Relation Extraction using Word and Entity Based Attention
Relation extraction is the problem of classifying the relationship between two entities in a given sentence. Distant Supervision (DS) is a popular technique for developing relation extractors starting with limited superv…
RelationRelation ExtractionRelationship Extraction (Distant Supervised)SentenceEnhanced Distant Supervision with State-Change Information for Relation Extraction
In this work, we introduce a method for enhancing distant supervision with state-change information for relation extraction. We provide a training dataset created via this process, along with manually annotated developme…
RelationRelation ExtractionAugmenting Document-level Relation Extraction with Efficient Multi-Supervision
Despite its popularity in sentence-level relation extraction, distantly supervised data is rarely utilized by existing work in document-level relation extraction due to its noisy nature and low information density. Among…
Document-level Relation ExtractionRelationRelation ExtractionSentenceTowards Time-Aware Distant Supervision for Relation Extraction
Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-…
RelationRelation ExtractionTime SeriesTime Series AnalysisReinforcement Learning-based N-ary Cross-Sentence Relation Extraction
The models of n-ary cross sentence relation extraction based on distant supervision assume that consecutive sentences mentioning n entities describe the relation of these n entities. However, on one hand, this assumption…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Relation+2