Improving Continual Relation Extraction by Distinguishing Analogous Semantics
Continual relation extraction (RE) aims to learn constantly emerging relations while avoiding forgetting the learned relations. Existing works store a small number of typical samples to re-train the model for alleviating forgetting. However, repeatedly replaying these samples may cause the overfitting problem. We conduct an empirical study on existing works and observe that their performance is severely affected by analogous relations. To address this issue, we propose a novel continual extraction model for analogous relations. Specifically, we design memory-insensitive relation prototypes and memory augmentation to overcome the overfitting problem. We also introduce integrated training and focal knowledge distillation to enhance the performance on analogous relations. Experimental results show the superiority of our model and demonstrate its effectiveness in distinguishing analogous relations and overcoming overfitting.
Code (1)
Tasks
Continual Relation ExtractionKnowledge DistillationRelationRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rationale-Enhanced Language Models are Better Continual Relation Learners
Continual relation extraction (CRE) aims to solve the problem of catastrophic forgetting when learning a sequence of newly emerging relations. Recent CRE studies have found that catastrophic forgetting arises from the mo…
Continual Relation ExtractionRelationRelation ClassificationRelation ExtractionLearning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation
Continual relation extraction (CRE) aims to continually learn new relations from a class-incremental data stream. CRE model usually suffers from catastrophic forgetting problem, i.e., the performance of old relations ser…
Continual Relation ExtractionRelationRelation ExtractionContinual Event Extraction with Semantic Confusion Rectification
We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same te…
Event ExtractionSentenceA Continual Relation Extraction Approach for Knowledge Graph Completeness
Representing unstructured data in a structured form is most significant for information system management to analyze and interpret it. To do this, the unstructured data might be converted into Knowledge Graphs, by levera…
Continual Relation ExtractionKnowledge GraphsManagementnamed-entity-recognition+3Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction
Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the over…
Contrastive LearningKnowledge DistillationRelationRelation Extraction+1