paper-with-me

Papers

Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation

2022-10-10 · Peiyi Wang, YiFan Song, Tianyu Liu, Binghuai Lin, Yunbo Cao, Sujian Li, Zhifang Sui

Continual relation extraction (CRE) aims to continually learn new relations from a class-incremental data stream. CRE model usually suffers from catastrophic forgetting problem, i.e., the performance of old relations seriously degrades when the model learns new relations. Most previous work attributes catastrophic forgetting to the corruption of the learned representations as new relations come, with an implicit assumption that the CRE models have adequately learned the old relations. In this paper, through empirical studies we argue that this assumption may not hold, and an important reason for catastrophic forgetting is that the learned representations do not have good robustness against the appearance of analogous relations in the subsequent learning process. To address this issue, we encourage the model to learn more precise and robust representations through a simple yet effective adversarial class augmentation mechanism (ACA), which is easy to implement and model-agnostic. Experimental results show that ACA can consistently improve the performance of state-of-the-art CRE models on two popular benchmarks.

📄 PDF Abstract BibTeX arXiv:2210.04497

Code (1)

wangpeiyi9979/aca 공식 구현 pytorch

Tasks

Continual Relation ExtractionRelationRelation Extraction

Similar Papers 제목 키워드 기반

Enhancing Continual Relation Extraction via Classifier Decomposition

2023-05-08 · Heming Xia, Peiyi Wang, Tianyu Liu, Binghuai Lin 외

Continual relation extraction (CRE) models aim at handling emerging new relations while avoiding catastrophically forgetting old ones in the streaming data. Though improvements have been shown by previous CRE studies, mo…

Continual Relation ExtractionRelationRelation Extraction

Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction

2023-05-11 · Xinyi Wang, Zitao Wang, Wei Hu

Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the over…

Contrastive LearningKnowledge DistillationRelationRelation Extraction+1

Curriculum-Meta Learning for Order-Robust Continual Relation Extraction

2021-01-06 · Tongtong Wu, Xuekai Li, Yuan-Fang Li, Reza Haffari 외

Continual relation extraction is an important task that focuses on extracting new facts incrementally from unstructured text. Given the sequential arrival order of the relations, this task is prone to two serious challen…

Continual Relation ExtractionMeta-LearningRelationRelation Extraction+2

Improving Continual Relation Extraction through Prototypical Contrastive Learning

2022-10-10 · COLING 2022 10 · Chengwei Hu, Deqing Yang, Haoliang Jin, Zhen Chen 외

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this…

Continual Relation ExtractionContrastive LearningRelationRelation Extraction

Adversarial Multi-lingual Neural Relation Extraction

2018-08-01 · COLING 2018 8 · Xiaozhi Wang, Xu Han, Yankai Lin, Zhiyuan Liu 외

Multi-lingual relation extraction aims to find unknown relational facts from text in various languages. Existing models cannot well capture the consistency and diversity of relation patterns in different languages. To ad…

DiversityQuestion AnsweringRelationRelation Extraction+1