paper-with-me

Papers

Enriching Pre-trained Language Model with Entity Information for Relation Classification

2019-05-20 · Shanchan Wu, Yifan He

Relation classification is an important NLP task to extract relations between entities. The state-of-the-art methods for relation classification are primarily based on Convolutional or Recurrent Neural Networks. Recently, the pre-trained BERT model achieves very successful results in many NLP classification / sequence labeling tasks. Relation classification differs from those tasks in that it relies on information of both the sentence and the two target entities. In this paper, we propose a model that both leverages the pre-trained BERT language model and incorporates information from the target entities to tackle the relation classification task. We locate the target entities and transfer the information through the pre-trained architecture and incorporate the corresponding encoding of the two entities. We achieve significant improvement over the state-of-the-art method on the SemEval-2010 task 8 relational dataset.

📄 PDF Abstract BibTeX arXiv:1905.08284

Code (6)

Valdegg/anlp_rbert
chielingyueh/anaphora_resolution_chemical_patents pytorch
mickeystroller/R-BERT pytorch
monologg/R-BERT pytorch
onehaitao/R-BERT-relation-extraction pytorch
wang-h/bert-relation-classification pytorch

Tasks

General ClassificationLanguage ModelingLanguage ModellingRelationRelation ClassificationRelation ExtractionSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Enriching Medcial Terminology Knowledge Bases via Pre-trained Language Model and Graph Convolutional Network

2019-09-02 · Jiaying Zhang, Zhixing Zhang, Huanhuan Zhang, Zhiyuan Ma 외

Enriching existing medical terminology knowledge bases (KBs) is an important and never-ending work for clinical research because new terminology alias may be continually added and standard terminologies may be newly rena…

Language ModelingLanguage Modelling

Enriching entity grids and graphs with discourse relations: the impact in local coherence evaluation

2015-11-01 · WS 2015 11 · M{\'a}rcio de S. Dias, Thiago A. S. Pardo
Coherence EvaluationQuestion Answering

RelDiff: Enriching Knowledge Graph Relation Representations for Sensitivity Classification

2021-11-01 · Findings (EMNLP) 2021 11 · Hitarth Narvala, Graham McDonald, Iadh Ounis

The relationships that exist between entities can be a reliable indicator for classifying sensitive information, such as commercially sensitive information. For example, the relation person-IsDirectorOf-company can indic…

Entity EmbeddingsKnowledge Graph EmbeddingsRelationSensitivity+2

Multiple Streams of Relation Extraction: Enriching and Recalling in Transformers

2025-06-25 · Todd Nief, David Reber, Sean Richardson, Ari Holtzman

When an LLM learns a relation during finetuning (e.g., new movie releases, corporate mergers, etc.), where does this information go? Is it extracted when the model processes an entity, recalled just-in-time before a pred…

RelationRelation Extraction

Hierarchical Relation-Guided Type-Sentence Alignment for Long-Tail Relation Extraction with Distant Supervision

2021-09-19 · Findings (NAACL) 2022 7 · Yang Li, Guodong Long, Tao Shen, Jing Jiang

Distant supervision uses triple facts in knowledge graphs to label a corpus for relation extraction, leading to wrong labeling and long-tail problems. Some works use the hierarchy of relations for knowledge transfer to l…

AttributeKnowledge GraphsRelationRelation Extraction+2