Bootstrap Deep Spectral Clustering with Optimal Transport
Spectral clustering is a leading clustering method. Two of its major shortcomings are the disjoint optimization process and the limited representation capacity. To address these issues, we propose a deep spectral clustering model (named BootSC), which jointly learns all stages of spectral clustering -- affinity matrix construction, spectral embedding, and $k$-means clustering -- using a single network in an end-to-end manner. BootSC leverages effective and efficient optimal-transport-derived supervision to bootstrap the affinity matrix and the cluster assignment matrix. Moreover, a semantically-consistent orthogonal re-parameterization technique is introduced to orthogonalize spectral embeddings, significantly enhancing the discrimination capability. Experimental results indicate that BootSC achieves state-of-the-art clustering performance. For example, it accomplishes a notable 16\% NMI improvement over the runner-up method on the challenging ImageNet-Dogs dataset. Our code is available at https://github.com/spdj2271/BootSC.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Non-Parametric Bootstrap for Spectral Clustering
Finite mixture modelling is a popular method in the field of clustering and is beneficial largely due to its soft cluster membership probabilities. A common method for fitting finite mixture models is to employ spectral …
ClusteringComputational EfficiencyUnbalanced Optimal Transport Dictionary Learning for Unsupervised Hyperspectral Image Clustering
Hyperspectral images capture vast amounts of high-dimensional spectral information about a scene, making labeling an intensive task that is resistant to out-of-the-box statistical methods. Unsupervised learning of cluste…
Image ClusteringSplit-Fuse-Transport: Annotation-Free Saliency via Dual Clustering and Optimal Transport Alignment
Salient object detection (SOD) aims to segment visually prominent regions in images and serves as a foundational task for various computer vision applications. We posit that SOD can now reach near-supervised accuracy wit…
Salient Object DetectionCaSPECT: Discovering Causally Homogeneous Subgroups via Directed Spectral Clustering
We propose \textbf{CaSPECT}, a causal spectral clustering framework for discovering causally homogeneous subgroups from observational data. Rather than clustering in covariate space, CaSPECT defines similarity through th…
Hierarchical Optimal Transport for Unsupervised Domain Adaptation
In this paper, we propose a novel approach for unsupervised domain adaptation, that relates notions of optimal transport, learning probability measures and unsupervised learning. The proposed approach, HOT-DA, is based o…
Domain AdaptationUnsupervised Domain Adaptation