paper-with-me

홈 › Papers

Heterogeneous Tri-stream Clustering Network

2023-01-11 · Xiaozhi Deng, Dong Huang, Chang-Dong Wang

Contrastive deep clustering has recently gained significant attention with its ability of joint contrastive learning and clustering via deep neural networks. Despite the rapid progress, previous works mostly require both positive and negative sample pairs for contrastive clustering, which rely on a relative large batch-size. Moreover, they typically adopt a two-stream architecture with two augmented views, which overlook the possibility and potential benefits of multi-stream architectures (especially with heterogeneous or hybrid networks). In light of this, this paper presents a new end-to-end deep clustering approach termed Heterogeneous Tri-stream Clustering Network (HTCN). The tri-stream architecture in HTCN consists of three main components, including two weight-sharing online networks and a target network, where the parameters of the target network are the exponential moving average of that of the online networks. Notably, the two online networks are trained by simultaneously (i) predicting the instance representations of the target network and (ii) enforcing the consistency between the cluster representations of the target network and that of the two online networks. Experimental results on four challenging image datasets demonstrate the superiority of HTCN over the state-of-the-art deep clustering approaches. The code is available at https://github.com/dengxiaozhi/HTCN.

📄 PDF Abstract BibTeX arXiv:2301.04451

Code (1)

dengxiaozhi/htcn 공식 구현 pytorch

Tasks

ClusteringContrastive LearningDeep Clustering

Methods 이 논문이 사용한 방법론

HTCN Hierarchical Transferability Calibration Network (HTCN) is an adaptive object detector that hierarchically (local-region/image/instance) calibrates the transferability of…
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

2024-12-01 · Yujie Mo, Zhihe Lu, Runpeng Yu, Xiaofeng Zhu 외

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two signif…

ClusteringGraph Learning

Heterogeneous Deep Graph Infomax

2019-11-19 · Yuxiang Ren, Bo Liu, Chao Huang, Peng Dai 외

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such…

ClassificationClusteringGeneral ClassificationGraph Neural Network+5

FMCL: Class-Aware Client Clustering with Foundation Model Representations for Heterogeneous Federated Learning

2026-04-30 · Mahad Ali, Laura J. Brattain arxiv

Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its performance deteriorates under statistical heterogeneity. Clustered Federated Learning addresses t…

Federated Learning

A Framework for Joint Unsupervised Learning of Cluster-Aware Embedding for Heterogeneous Networks

2021-08-09 · Rayyan Ahmad Khan, Martin Kleinsteuber

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for netw…

ClusteringNode Classification

Heterformer: Transformer-based Deep Node Representation Learning on Heterogeneous Text-Rich Networks

2022-05-20 · Bowen Jin, Yu Zhang, Qi Zhu, Jiawei Han

Representation learning on networks aims to derive a meaningful vector representation for each node, thereby facilitating downstream tasks such as link prediction, node classification, and node clustering. In heterogeneo…

ClusteringGraph AttentionLink PredictionNode Classification+3