paper-with-me

Papers

Improving Continual Relation Extraction by Distinguishing Analogous Semantics

2023-05-11 · Wenzheng Zhao, Yuanning Cui, Wei Hu

Continual relation extraction (RE) aims to learn constantly emerging relations while avoiding forgetting the learned relations. Existing works store a small number of typical samples to re-train the model for alleviating forgetting. However, repeatedly replaying these samples may cause the overfitting problem. We conduct an empirical study on existing works and observe that their performance is severely affected by analogous relations. To address this issue, we propose a novel continual extraction model for analogous relations. Specifically, we design memory-insensitive relation prototypes and memory augmentation to overcome the overfitting problem. We also introduce integrated training and focal knowledge distillation to enhance the performance on analogous relations. Experimental results show the superiority of our model and demonstrate its effectiveness in distinguishing analogous relations and overcoming overfitting.

📄 PDF Abstract BibTeX arXiv:2305.06620

Code (1)

nju-websoft/cear 공식 구현 pytorch

Tasks

Continual Relation ExtractionKnowledge DistillationRelationRelation Extraction

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Rationale-Enhanced Language Models are Better Continual Relation Learners

2023-10-10 · Weimin Xiong, YiFan Song, Peiyi Wang, Sujian Li

Continual relation extraction (CRE) aims to solve the problem of catastrophic forgetting when learning a sequence of newly emerging relations. Recent CRE studies have found that catastrophic forgetting arises from the mo…

Continual Relation ExtractionRelationRelation ClassificationRelation Extraction

Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation

2022-10-10 · Peiyi Wang, YiFan Song, Tianyu Liu, Binghuai Lin 외

Continual relation extraction (CRE) aims to continually learn new relations from a class-incremental data stream. CRE model usually suffers from catastrophic forgetting problem, i.e., the performance of old relations ser…

Continual Relation ExtractionRelationRelation Extraction

Continual Event Extraction with Semantic Confusion Rectification

2023-10-24 · Zitao Wang, Xinyi Wang, Wei Hu

We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same te…

Event ExtractionSentence

A Continual Relation Extraction Approach for Knowledge Graph Completeness

2024-04-20 · Sefika Efeoglu

Representing unstructured data in a structured form is most significant for information system management to analyze and interpret it. To do this, the unstructured data might be converted into Knowledge Graphs, by levera…

Continual Relation ExtractionKnowledge GraphsManagementnamed-entity-recognition+3

Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction

2023-05-11 · Xinyi Wang, Zitao Wang, Wei Hu

Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the over…

Contrastive LearningKnowledge DistillationRelationRelation Extraction+1