paper-with-me

Papers

Graph Representation Learning via Contrasting Cluster Assignments

2021-12-15 · ChunYang Zhang, Hongyu Yao, C. L. Philip Chen, Yuena Lin

With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph representation learning either focus on maximizing mutual information between local and global embeddings, or primarily depend on contrasting embeddings at node level. However, they are still not exquisite enough to comprehensively explore the local and global views of network topology. Although the former considers local-global relationship, its coarse global information leads to grudging cooperation between local and global views. The latter pays attention to node-level feature alignment, so that the role of global view appears inconspicuous. To avoid falling into these two extreme cases, we propose a novel unsupervised graph representation model by contrasting cluster assignments, called as GRCCA. It is motivated to make good use of local and global information synthetically through combining clustering algorithms and contrastive learning. This not only facilitates the contrastive effect, but also provides the more high-quality graph information. Meanwhile, GRCCA further excavates cluster-level information, which make it get insight to the elusive association between nodes beyond graph topology. Specifically, we first generate two augmented graphs with distinct graph augmentation strategies, then employ clustering algorithms to obtain their cluster assignments and prototypes respectively. The proposed GRCCA further compels the identical nodes from different augmented graphs to recognize their cluster assignments mutually by minimizing a cross entropy loss. To demonstrate its effectiveness, we compare with the state-of-the-art models in three different downstream tasks. The experimental results show that GRCCA has strong competitiveness in most tasks.

📄 PDF Abstract BibTeX arXiv:2112.07934

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringContrastive LearningGraph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Deep Multiview Clustering by Contrasting Cluster Assignments

2023-04-21 · ICCV 2023 1 · Jie Chen, Hua Mao, Wai Lok Woo, Xi Peng

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale dat…

ClusteringContrastive LearningMultiview Clustering

Graph Contrastive Clustering

2021-04-03 · ICCV 2021 10 · Huasong Zhong, Jianlong Wu, Chong Chen, Jianqiang Huang 외

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category infor…

ClusteringContrastive Learning

Unsupervised Learning of Visual Features by Contrasting Cluster Assignments

2020-06-17 · NeurIPS 2020 12 · Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal 외

Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and…

Contrastive LearningData AugmentationImage ClassificationSelf-Supervised Image Classification+1

Contrasting quadratic assignments for set-based representation learning

2022-05-31 · Artem Moskalev, Ivan Sosnovik, Volker Fischer, Arnold Smeulders

The standard approach to contrastive learning is to maximize the agreement between different views of the data. The views are ordered in pairs, such that they are either positive, encoding different views of the same obj…

Contrastive LearningMetric LearningRepresentation Learning

Total Variation Graph Neural Networks

2022-11-11 · Jonas Berg Hansen, Filippo Maria Bianchi

Recently proposed Graph Neural Networks (GNNs) for vertex clustering are trained with an unsupervised minimum cut objective, approximated by a Spectral Clustering (SC) relaxation. However, the SC relaxation is loose and,…

ClusteringGraph Classification