paper-with-me

Papers

A Data-driven Approach for Noise Reduction in Distantly Supervised Biomedical Relation Extraction

2020-05-26 · WS 2020 7 · Saadullah Amin, Katherine Ann Dunfield, Anna Vechkaeva, Günter Neumann

Fact triples are a common form of structured knowledge used within the biomedical domain. As the amount of unstructured scientific texts continues to grow, manual annotation of these texts for the task of relation extraction becomes increasingly expensive. Distant supervision offers a viable approach to combat this by quickly producing large amounts of labeled, but considerably noisy, data. We aim to reduce such noise by extending an entity-enriched relation classification BERT model to the problem of multiple instance learning, and defining a simple data encoding scheme that significantly reduces noise, reaching state-of-the-art performance for distantly-supervised biomedical relation extraction. Our approach further encodes knowledge about the direction of relation triples, allowing for increased focus on relation learning by reducing noise and alleviating the need for joint learning with knowledge graph completion.

📄 PDF Abstract BibTeX arXiv:2005.12565

Code (1)

suamin/umls-medline-distant-re 공식 구현 pytorch

Tasks

Knowledge Graph CompletionMultiple Instance LearningRelationRelation ClassificationRelation Extraction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Ranking-Based Automatic Seed Selection and Noise Reduction for Weakly Supervised Relation Extraction

2018-07-01 · ACL 2018 7 · Van-Thuy Phi, Joan Santoso, Masashi Shimbo, Yuji Matsumoto

This paper addresses the tasks of automatic seed selection for bootstrapping relation extraction, and noise reduction for distantly supervised relation extraction. We first point out that these tasks are related. Then, i…

RelationRelation ExtractionWord Sense Disambiguation

Noise Reduction Methods for Distantly Supervised Biomedical Relation Extraction

2017-08-01 · WS 2017 8 · Gang Li, Cathy Wu, K. Vijay-Shanker

Distant supervision has been applied to automatically generate labeled data for biomedical relation extraction. Noise exists in both positively and negatively-labeled data and affects the performance of supervised machin…

RelationRelation Extraction

Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training

2021-09-10 · EMNLP 2021 11 · Yu Meng, Yunyi Zhang, Jiaxin Huang, Xuan Wang 외

We study the problem of training named entity recognition (NER) models using only distantly-labeled data, which can be automatically obtained by matching entity mentions in the raw text with entity types in a knowledge b…

Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+2

Distantly-Supervised Joint Extraction with Noise-Robust Learning

2023-10-08 · Yufei Li, Xiao Yu, Yanghong Guo, Yanchi Liu 외

Joint entity and relation extraction is a process that identifies entity pairs and their relations using a single model. We focus on the problem of joint extraction in distantly-labeled data, whose labels are generated b…

Joint Entity and Relation ExtractionLanguage ModellingLarge Language ModelRelation+1

Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

2021-08-22 · RANLP 2021 9 · Tapas Nayak, Navonil Majumder, Soujanya Poria

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence i…

RelationRelation ExtractionSentence