Improving Unsupervised Relation Extraction by Augmenting Diverse Sentence Pairs
Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on contrastive learning strategies for acquiring relation representations. However, these studies often overlook two important aspects: the inclusion of diverse positive pairs for contrastive learning and the exploration of appropriate loss functions. In this paper, we propose AugURE with both within-sentence pairs augmentation and augmentation through cross-sentence pairs extraction to increase the diversity of positive pairs and strengthen the discriminative power of contrastive learning. We also identify the limitation of noise-contrastive estimation (NCE) loss for relation representation learning and propose to apply margin loss for sentence pairs. Experiments on NYT-FB and TACRED datasets demonstrate that the proposed relation representation learning and a simple K-Means clustering achieves state-of-the-art performance.
Code (1)
Tasks
Contrastive LearningDiversityRelationRelation ExtractionRepresentation LearningSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings
Learning sentence embeddings in an unsupervised manner is fundamental in natural language processing. Recent common practice is to couple pre-trained language models with unsupervised contrastive learning, whose success …
Contrastive LearningOpen-Ended Question AnsweringSentenceSentence Embeddings+1A BERT-based Universal Model for Both Within- and Cross-sentence Clinical Temporal Relation Extraction
Classic methods for clinical temporal relation extraction focus on relational candidates within a sentence. On the other hand, break-through Bidirectional Encoder Representations from Transformers (BERT) are trained on l…
RelationRelation ExtractionSentenceTemporal Relation ExtractionImproving Long-Tail Relation Extraction with Collaborating Relation-Augmented Attention
Wrong labeling problem and long-tail relations are two main challenges caused by distant supervision in relation extraction. Recent works alleviate the wrong labeling by selective attention via multi-instance learning, b…
RelationRelation ExtractionSentenceHiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction
Unsupervised relation extraction aims to extract the relationship between entities from natural language sentences without prior information on relational scope or distribution. Existing works either utilize self-supervi…
ClusteringContrastive LearningRelationRelation Extraction+1HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction
Unsupervised relation extraction aims to extract the relationship between entities from natural language sentences without prior information on relational scope or distribution. Existing works either utilize self-supervi…
ClusteringContrastive LearningRelationRelation Extraction+1