AdaptCMVC: Robust Adaption to Incremental Views in Continual Multi-view Clustering
Most Multi-view Clustering approaches assume that all views are available for clustering. However, this assumption is often unrealistic as views are incrementally accumulated over time, leading to a need for continual multi-view clustering (CMVC) methods. Current approaches to CMVC leverage late fusion-based approaches, where a new model is typically learned individually for each view to obtain the corresponding partition matrix, and then used to update a consensus matrix via a moving average. These approaches are prone to view-specific noise and struggle to adapt to large gaps between different views. To address these shortcomings, we reconsider CMVC from the perspective of domain adaptation and propose AdaptCMVC, which learns how to incrementally accumulate knowledge of new views as they become available and prevents catastrophic forgetting. Specifically, a self-training framework is introduced to extend the model to new views, particularly designed to be robust to view-specific noise. Further, to combat catastrophic forgetting, a structure alignment mechanism is proposed to enable the model to explore the global group structure across multiple views. Experiments on several multi-view benchmarks demonstrate the effectiveness of our proposed method on the CMVC task. The code is available at: AdaptCMVC.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDomain AdaptationSimilar Papers 제목 키워드 기반
Continual Learning for Class- and Domain-Incremental Semantic Segmentation
The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in th…
class-incremental learningClass Incremental LearningClass-Incremental Semantic SegmentationContinual Learning+9Live and Learn: Continual Action Clustering with Incremental Views
Multi-view action clustering leverages the complementary information from different camera views to enhance the clustering performance. Although existing approaches have achieved significant progress, they assume all cam…
ClusteringContinual LearningContinual Learning in Open-vocabulary Classification with Complementary Memory Systems
We introduce a method for flexible and efficient continual learning in open-vocabulary image classification, drawing inspiration from the complementary learning systems observed in human cognition. Specifically, we propo…
Continual Learningimage-classificationImage ClassificationOpen Vocabulary Image ClassificationIncremental Multi-Scene Modeling via Continual Neural Graphics Primitives
Neural radiance fields (NeRF) have revolutionized photorealistic rendering of novel views for 3D scenes. Despite their growing popularity and efficiency as 3D resources, NeRFs face scalability challenges due to the need …
Continual LearningNeRFMulti-View Class Incremental Learning
Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance. To make MVL methods more practical in an open-ended environmen…
class-incremental learningClass Incremental LearningDecision MakingIncremental Learning+2