paper-with-me

Papers

Graph-Based Continual Learning

2020-07-09 · ICLR 2021 1 · Binh Tang, David S. Matteson

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and replaying a small episodic memory of previous samples, often implemented as an array of independent memory slots. In this work, we propose to augment such an array with a learnable random graph that captures pairwise similarities between its samples, and use it not only to learn new tasks but also to guard against forgetting. Empirical results on several benchmark datasets show that our model consistently outperforms recently proposed baselines for task-free continual learning.

📄 PDF Abstract BibTeX arXiv:2007.04813

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

Continual Learning on Graphs: A Survey

2024-02-09 · Zonggui Tian, Du Zhang, Hong-Ning Dai

Recently, continual graph learning has been increasingly adopted for diverse graph-structured data processing tasks in non-stationary environments. Despite its promising learning capability, current studies on continual …

Continual LearningGraph LearningSurvey

Continual Learning on Graphs: Challenges, Solutions, and Opportunities

2024-02-18 · Xikun Zhang, Dongjin Song, DaCheng Tao

Continual learning on graph data has recently attracted paramount attention for its aim to resolve the catastrophic forgetting problem on existing tasks while adapting the sequentially updated model to newly emerged grap…

Continual LearningGraph Learning

Continual Graph Learning: A Survey

2023-01-28 · Qiao Yuan, Sheng-Uei Guan, Pin Ni, Tianlun Luo 외

Research on continual learning (CL) mainly focuses on data represented in the Euclidean space, while research on graph-structured data is scarce. Furthermore, most graph learning models are tailored for static graphs. Ho…

Continual LearningGraph LearningSurvey

E-CGL: An Efficient Continual Graph Learner

2024-08-18 · Jianhao Guo, Zixuan Ni, Yun Zhu, Siliang Tang

Continual learning has emerged as a crucial paradigm for learning from sequential data while preserving previous knowledge. In the realm of continual graph learning, where graphs continuously evolve based on streaming gr…

Continual LearningGraph Learning

Disentangle-based Continual Graph Representation Learning

2020-10-06 · EMNLP 2020 11 · Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li 외

Graph embedding (GE) methods embed nodes (and/or edges) in graph into a low-dimensional semantic space, and have shown its effectiveness in modeling multi-relational data. However, existing GE models are not practical in…

Continual LearningGraph EmbeddingGraph Representation LearningRepresentation Learning