Enriching Pre-trained Language Model with Entity Information for Relation Classification
Relation classification is an important NLP task to extract relations between entities. The state-of-the-art methods for relation classification are primarily based on Convolutional or Recurrent Neural Networks. Recently, the pre-trained BERT model achieves very successful results in many NLP classification / sequence labeling tasks. Relation classification differs from those tasks in that it relies on information of both the sentence and the two target entities. In this paper, we propose a model that both leverages the pre-trained BERT language model and incorporates information from the target entities to tackle the relation classification task. We locate the target entities and transfer the information through the pre-trained architecture and incorporate the corresponding encoding of the two entities. We achieve significant improvement over the state-of-the-art method on the SemEval-2010 task 8 relational dataset.
Code (6)
Tasks
General ClassificationLanguage ModelingLanguage ModellingRelationRelation ClassificationRelation ExtractionSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enriching Medcial Terminology Knowledge Bases via Pre-trained Language Model and Graph Convolutional Network
Enriching existing medical terminology knowledge bases (KBs) is an important and never-ending work for clinical research because new terminology alias may be continually added and standard terminologies may be newly rena…
Language ModelingLanguage ModellingEnriching entity grids and graphs with discourse relations: the impact in local coherence evaluation
RelDiff: Enriching Knowledge Graph Relation Representations for Sensitivity Classification
The relationships that exist between entities can be a reliable indicator for classifying sensitive information, such as commercially sensitive information. For example, the relation person-IsDirectorOf-company can indic…
Entity EmbeddingsKnowledge Graph EmbeddingsRelationSensitivity+2Multiple Streams of Relation Extraction: Enriching and Recalling in Transformers
When an LLM learns a relation during finetuning (e.g., new movie releases, corporate mergers, etc.), where does this information go? Is it extracted when the model processes an entity, recalled just-in-time before a pred…
RelationRelation ExtractionHierarchical Relation-Guided Type-Sentence Alignment for Long-Tail Relation Extraction with Distant Supervision
Distant supervision uses triple facts in knowledge graphs to label a corpus for relation extraction, leading to wrong labeling and long-tail problems. Some works use the hierarchy of relations for knowledge transfer to l…
AttributeKnowledge GraphsRelationRelation Extraction+2