Universal Graph Continual Learning
We address catastrophic forgetting issues in graph learning as incoming data transits from one to another graph distribution. Whereas prior studies primarily tackle one setting of graph continual learning such as incremental node classification, we focus on a universal approach wherein each data point in a task can be a node or a graph, and the task varies from node to graph classification. We propose a novel method that enables graph neural networks to excel in this universal setting. Our approach perseveres knowledge about past tasks through a rehearsal mechanism that maintains local and global structure consistency across the graphs. We benchmark our method against various continual learning baselines in real-world graph datasets and achieve significant improvement in average performance and forgetting across tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningGraph ClassificationGraph LearningNode ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
UNIT: Unleash Large Language Models Potential for Graph Continual Learning
In real-world multimodal web scenarios, graph-structured data often arrives in a streaming manner, making graph continual learning a crucial paradigm for continuously modeling such evolving structures. However, existing …
Continual LearningGeneral KnowledgeToward Universal Medical Image Registration via Sharpness-Aware Meta-Continual Learning
Current deep learning approaches in medical image registration usually face the challenges of distribution shift and data collection, hindering real-world deployment. In contrast, universal medical image registration aim…
Continual LearningImage RegistrationMedical Image RegistrationMeta-LearningATLAS: Universal Function Approximator for Memory Retention
Artificial neural networks (ANNs), despite their universal function approximation capability and practical success, are subject to catastrophic forgetting. Catastrophic forgetting refers to the abrupt unlearning of a pre…
Continual LearningBetter Rates for Random Task Orderings in Continual Linear Models
We study the common continual learning setup where an overparameterized model is sequentially fitted to a set of jointly realizable tasks. We analyze the forgetting, i.e., loss on previously seen tasks, after $k$ iterati…
Continual LearningTowards Continual Universal Segmentation
Despite the significant progress in continual image segmentation, existing arts still strive to balance between stability and plasticity. Additionally, they are specialist to specific tasks and models, which hinders …
Image SegmentationSegmentationSemantic SegmentationUniversal Segmentation