Meta-Learning for Neural Relation Classification with Distant Supervision
Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have been proposed to select a subset of reliable instances for neural model training, but they still suffer from noisy labeling problem or underutilization of the weakly-labeled data. To better select more reliable training instances, we introduce a small amount of manually labeled data as reference to guide the selection process. In this paper, we propose a meta-learning based approach, which learns to reweight noisy training data under the guidance of reference data. As the clean reference data is usually very small, we propose to augment it by dynamically distilling the most reliable elite instances from the noisy data. Experiments on several datasets demonstrate that the reference data can effectively guide the selection of training data, and our augmented approach consistently improves the performance of relation classification comparing to the existing state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationMeta-LearningRelationRelation ClassificationSimilar Papers 제목 키워드 기반
NS-Hunter: BERT-Cloze Based Semantic Denoising for Distantly Supervised Relation Classification
“Distant supervision can generate large-scale relation classification data quickly and economi-cally. However a great number of noise sentences are introduced which can not express their labeled relations. By means of pr…
ClassificationDenoisingLanguage ModellingRelation+2KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
Lexical relations describe how concepts are semantically related, in the form of relation triples. The accurate prediction of lexical relations between concepts is challenging, due to the sparsity of patterns indicating …
General ClassificationMeta-LearningRelationRelation ClassificationImproving Distantly Supervised Relation Extraction by Natural Language Inference
To reduce human annotations for relation extraction (RE) tasks, distantly supervised approaches have been proposed, while struggling with low performance. In this work, we propose a novel DSRE-NLI framework, which consid…
Natural Language InferenceRelationRelation ExtractionARNOR: Attention Regularization based Noise Reduction for Distant Supervision Relation Classification
Distant supervision is widely used in relation classification in order to create large-scale training data by aligning a knowledge base with an unlabeled corpus. However, it also introduces amounts of noisy labels where …
ClassificationGeneral ClassificationRelationRelation Classification+1Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix
Distant supervision significantly reduces human efforts in building training data for many classification tasks. While promising, this technique often introduces noise to the generated training data, which can severely a…
General ClassificationRelationRelation Extraction