Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation
Continual relation extraction (CRE) aims to continually learn new relations from a class-incremental data stream. CRE model usually suffers from catastrophic forgetting problem, i.e., the performance of old relations seriously degrades when the model learns new relations. Most previous work attributes catastrophic forgetting to the corruption of the learned representations as new relations come, with an implicit assumption that the CRE models have adequately learned the old relations. In this paper, through empirical studies we argue that this assumption may not hold, and an important reason for catastrophic forgetting is that the learned representations do not have good robustness against the appearance of analogous relations in the subsequent learning process. To address this issue, we encourage the model to learn more precise and robust representations through a simple yet effective adversarial class augmentation mechanism (ACA), which is easy to implement and model-agnostic. Experimental results show that ACA can consistently improve the performance of state-of-the-art CRE models on two popular benchmarks.
Code (1)
Tasks
Continual Relation ExtractionRelationRelation ExtractionSimilar Papers 제목 키워드 기반
Enhancing Continual Relation Extraction via Classifier Decomposition
Continual relation extraction (CRE) models aim at handling emerging new relations while avoiding catastrophically forgetting old ones in the streaming data. Though improvements have been shown by previous CRE studies, mo…
Continual Relation ExtractionRelationRelation ExtractionSerial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction
Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the over…
Contrastive LearningKnowledge DistillationRelationRelation Extraction+1Curriculum-Meta Learning for Order-Robust Continual Relation Extraction
Continual relation extraction is an important task that focuses on extracting new facts incrementally from unstructured text. Given the sequential arrival order of the relations, this task is prone to two serious challen…
Continual Relation ExtractionMeta-LearningRelationRelation Extraction+2Improving Continual Relation Extraction through Prototypical Contrastive Learning
Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this…
Continual Relation ExtractionContrastive LearningRelationRelation ExtractionAdversarial Multi-lingual Neural Relation Extraction
Multi-lingual relation extraction aims to find unknown relational facts from text in various languages. Existing models cannot well capture the consistency and diversity of relation patterns in different languages. To ad…
DiversityQuestion AnsweringRelationRelation Extraction+1