SelfORE: Self-supervised Relational Feature Learning for Open Relation Extraction
Open relation extraction is the task of extracting open-domain relation facts from natural language sentences. Existing works either utilize heuristics or distant-supervised annotations to train a supervised classifier over pre-defined relations, or adopt unsupervised methods with additional assumptions that have less discriminative power. In this work, we proposed a self-supervised framework named SelfORE, which exploits weak, self-supervised signals by leveraging large pretrained language model for adaptive clustering on contextualized relational features, and bootstraps the self-supervised signals by improving contextualized features in relation classification. Experimental results on three datasets show the effectiveness and robustness of SelfORE on open-domain Relation Extraction when comparing with competitive baselines.
Code (1)
Tasks
ClusteringLanguage ModelingLanguage ModellingRelationRelation ClassificationRelation ExtractionSimilar Papers 제목 키워드 기반
Relational Self-Attention: What's Missing in Attention for Video Understanding
Convolution has been arguably the most important feature transform for modern neural networks, leading to the advance of deep learning. Recent emergence of Transformer networks, which replace convolution layers with self…
Action RecognitionTemporal Action LocalizationVideo UnderstandingOpen Relation Extraction: Relational Knowledge Transfer from Supervised Data to Unsupervised Data
Open relation extraction (OpenRE) aims to extract relational facts from the open-domain corpus. To this end, it discovers relation patterns between named entities and then clusters those semantically equivalent patterns …
RelationRelation ExtractionTransfer LearningSelf-Supervised Relation Alignment for Scene Graph Generation
The goal of scene graph generation is to predict a graph from an input image, where nodes correspond to identified and localized objects and edges to their corresponding interaction predicates. Existing methods are train…
Graph GenerationRelationRelation PredictionScene Graph GenerationRelational Self-supervised Distillation with Compact Descriptors for Image Copy Detection
Image copy detection is the task of detecting edited copies of any image within a reference database. While previous approaches have shown remarkable progress, the large size of their networks and descriptors remains a d…
Contrastive LearningCopy DetectionHiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction
Unsupervised relation extraction aims to extract the relationship between entities from natural language sentences without prior information on relational scope or distribution. Existing works either utilize self-supervi…
ClusteringContrastive LearningRelationRelation Extraction+1