paper-with-me

Papers

Distantly-Supervised Neural Relation Extraction with Side Information using BERT

2020-04-29 · Johny Moreira, Chaina Oliveira, David Macêdo, Cleber Zanchettin, Luciano Barbosa

Relation extraction (RE) consists in categorizing the relationship between entities in a sentence. A recent paradigm to develop relation extractors is Distant Supervision (DS), which allows the automatic creation of new datasets by taking an alignment between a text corpus and a Knowledge Base (KB). KBs can sometimes also provide additional information to the RE task. One of the methods that adopt this strategy is the RESIDE model, which proposes a distantly-supervised neural relation extraction using side information from KBs. Considering that this method outperformed state-of-the-art baselines, in this paper, we propose a related approach to RESIDE also using additional side information, but simplifying the sentence encoding with BERT embeddings. Through experiments, we show the effectiveness of the proposed method in Google Distant Supervision and Riedel datasets concerning the BGWA and RESIDE baseline methods. Although Area Under the Curve is decreased because of unbalanced datasets, P@N results have shown that the use of BERT as sentence encoding allows superior performance to baseline methods.

📄 PDF Abstract BibTeX arXiv:2004.14443

Code (1)

guardiaum/BERT-SIDE 공식 구현 tf

Tasks

RelationRelation ExtractionSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information

2018-12-11 · EMNLP 2018 10 · Shikhar Vashishth, Rishabh Joshi, Sai Suman Prayaga, Chiranjib Bhattacharyya 외

Distantly-supervised Relation Extraction (RE) methods train an extractor by automatically aligning relation instances in a Knowledge Base (KB) with unstructured text. In addition to relation instances, KBs often contain …

RelationRelation ExtractionRelationship Extraction (Distant Supervised)

Active Testing: An Unbiased Evaluation Method for Distantly Supervised Relation Extraction

2020-10-17 · Findings of the Association for Computational Linguistics 2020 · Pengshuai Li, Xinsong Zhang, Weijia Jia, Wei Zhao

Distant supervision has been a widely used method for neural relation extraction for its convenience of automatically labeling datasets. However, existing works on distantly supervised relation extraction suffer from the…

RelationRelation Extraction

Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

2021-08-22 · RANLP 2021 9 · Tapas Nayak, Navonil Majumder, Soujanya Poria

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence i…

RelationRelation ExtractionSentence

Improving Distantly-Supervised Relation Extraction through BERT-based Label & Instance Embeddings

2020-06-01 · Anonymous

Distantly-supervised relation extraction (RE) is an effective method to scale RE to large corpora but suffers from noisy labels. Existing approaches try to alleviate noise through multi-instance learning and by providing…

RelationRelation Extraction

Cooperative Denoising for Distantly Supervised Relation Extraction

2018-08-01 · COLING 2018 8 · Kai Lei, Daoyuan Chen, Yaliang Li, Nan Du 외

Distantly supervised relation extraction greatly reduces human efforts in extracting relational facts from unstructured texts. However, it suffers from noisy labeling problem, which can degrade its performance. Meanwhile…

DenoisingInformation RetrievalKnowledge DistillationQuestion Answering+2