Semantic Invariant Multi-view Clustering with Fully Incomplete Information

2023-05-22 · Pengxin Zeng, Mouxing Yang, Yiding Lu, Changqing Zhang, Peng Hu, Xi Peng

Robust multi-view learning with incomplete information has received significant attention due to issues such as incomplete correspondences and incomplete instances that commonly affect real-world multi-view applications. Existing approaches heavily rely on paired samples to realign or impute defective ones, but such preconditions cannot always be satisfied in practice due to the complexity of data collection and transmission. To address this problem, we present a novel framework called SeMantic Invariance LEarning (SMILE) for multi-view clustering with incomplete information that does not require any paired samples. To be specific, we discover the existence of invariant semantic distribution across different views, which enables SMILE to alleviate the cross-view discrepancy to learn consensus semantics without requiring any paired samples. The resulting consensus semantics remain unaffected by cross-view distribution shifts, making them useful for realigning/imputing defective instances and forming clusters. We demonstrate the effectiveness of SMILE through extensive comparison experiments with 13 state-of-the-art baselines on five benchmarks. Our approach improves the clustering accuracy of NoisyMNIST from 19.3\%/23.2\% to 82.7\%/69.0\% when the correspondences/instances are fully incomplete. The code could be accessed from https://pengxi.me.

📄 PDF Abstract BibTeX arXiv:2305.12743

Code (1)

PengxinZeng/2023-TPAMI-SMILE 공식 구현 pytorch

Tasks

ClusteringMULTI-VIEW LEARNING

Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence

2025-09-19 · Xihong Yang, Siwei Wang, Jiaqi Jin, Fangdi Wang 외 arxiv

Multi-view clustering (MVC) aims to explore the common clustering structure across multiple views. Many existing MVC methods heavily rely on the assumption of view consistency, where alignments for corresponding samples …

Superpixel Graph Contrastive Clustering with Semantic-Invariant Augmentations for Hyperspectral Images

2024-03-04 · Jianhan Qi, Yuheng Jia, Hui Liu, Junhui Hou

Hyperspectral images (HSI) clustering is an important but challenging task. The state-of-the-art (SOTA) methods usually rely on superpixels, however, they do not fully utilize the spatial and spectral information in HSI …

Clustering Contrastive Learning Superpixels

Deep Multiview Clustering by Contrasting Cluster Assignments

2023-04-21 · ICCV 2023 1 · Jie Chen, Hua Mao, Wai Lok Woo, Xi Peng

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale dat…

Clustering Contrastive Learning Multiview Clustering

MCoCo: Multi-level Consistency Collaborative Multi-view Clustering

2023-02-26 · Yiyang Zhou, Qinghai Zheng, Wenbiao Yan, Yifei Wang 외

Multi-view clustering can explore consistent information from different views to guide clustering. Most existing works focus on pursuing shallow consistency in the feature space and integrating the information of multipl…

Clustering Contrastive Learning Multiview Clustering Representation Learning

Robust Variational Contrastive Learning for Partially View-unaligned Clustering

2024-10-28 · ACM Multimedia 2024 10 · Changhao He, Hongyuan Zhu, Peng Hu, Xi Peng

Although multi-view learning has achieved remarkable progress over the past decades, most existing methods implicitly assume that all views (or modalities) are well-aligned. In practice, however, collecting fully aligned…

Clustering Contrastive Learning Deep Clustering MULTI-VIEW LEARNING+1