Deep Residual Learning for Weakly-Supervised Relation Extraction
Deep residual learning (ResNet) is a new method for training very deep neural networks using identity map-ping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-the-art performances in many computer vision tasks. However, the effect of residual learning on noisy natural language processing tasks is still not well understood. In this paper, we design a novel convolutional neural network (CNN) with residual learning, and investigate its impacts on the task of distantly supervised noisy relation extraction. In contradictory to popular beliefs that ResNet only works well for very deep networks, we found that even with 9 layers of CNNs, using identity mapping could significantly improve the performance for distantly-supervised relation extraction.
Code (1)
Tasks
General ClassificationRelationRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PromptRE: Weakly-Supervised Document-Level Relation Extraction via Prompting-Based Data Programming
Relation extraction aims to classify the relationships between two entities into pre-defined categories. While previous research has mainly focused on sentence-level relation extraction, recent studies have expanded the …
Document-level Relation ExtractionRelationRelation ClassificationRelation Extraction+1A convex relaxation for weakly supervised relation extraction
A Graph-based Cross-lingual Projection Approach for Weakly Supervised Relation Extraction
Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learning
Extracting relations from text corpora is an important task in text mining. It becomes particularly challenging when focusing on weakly-supervised relation extraction, that is, utilizing a few relation instances (i.e., a…
Knowledge Base CompletionRelationRelation ExtractionWebRED: Effective Pretraining And Finetuning For Relation Extraction On The Web
Relation extraction is used to populate knowledge bases that are important to many applications. Prior datasets used to train relation extraction models either suffer from noisy labels due to distant supervision, are lim…
RelationRelation Extraction