paper-with-me

Papers

Every Node is Different: Dynamically Fusing Self-Supervised Tasks for Attributed Graph Clustering

2024-01-12 · Pengfei Zhu, Qian Wang, Yu Wang, Jialu Li, QinGhua Hu

Attributed graph clustering is an unsupervised task that partitions nodes into different groups. Self-supervised learning (SSL) shows great potential in handling this task, and some recent studies simultaneously learn multiple SSL tasks to further boost performance. Currently, different SSL tasks are assigned the same set of weights for all graph nodes. However, we observe that some graph nodes whose neighbors are in different groups require significantly different emphases on SSL tasks. In this paper, we propose to dynamically learn the weights of SSL tasks for different nodes and fuse the embeddings learned from different SSL tasks to boost performance. We design an innovative graph clustering approach, namely Dynamically Fusing Self-Supervised Learning (DyFSS). Specifically, DyFSS fuses features extracted from diverse SSL tasks using distinct weights derived from a gating network. To effectively learn the gating network, we design a dual-level self-supervised strategy that incorporates pseudo labels and the graph structure. Extensive experiments on five datasets show that DyFSS outperforms the state-of-the-art multi-task SSL methods by up to 8.66% on the accuracy metric. The code of DyFSS is available at: https://github.com/q086/DyFSS.

📄 PDF Abstract BibTeX arXiv:2401.06595

Code (1)

q086/dyfss 공식 구현 pytorch

Tasks

ClusteringGraph ClusteringSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Point2Node: Correlation Learning of Dynamic-Node for Point Cloud Feature Modeling

2019-12-23 · Wenkai Han, Chenglu Wen, Cheng Wang, Xin Li 외

Fully exploring correlation among points in point clouds is essential for their feature modeling. This paper presents a novel end-to-end graph model, named Point2Node, to represent a given point cloud. Point2Node can dyn…

Graph-to-Sequence Neural Machine Translation

2020-09-16 · Sufeng Duan, Hai Zhao, Rui Wang

Neural machine translation (NMT) usually works in a seq2seq learning way by viewing either source or target sentence as a linear sequence of words, which can be regarded as a special case of graph, taking words in the se…

Graph-to-SequenceMachine TranslationNMTSentence+1

A Graph Neural Network Assisted Monte Carlo Tree Search Approach to Traveling Salesman Problem

2019-09-25 · Zhihao Xing, Shikui Tu

We present a graph neural network assisted Monte Carlo Tree Search approach for the classical traveling salesman problem (TSP). We adopt a greedy algorithm framework to construct the optimal solution to TSP by adding the…

Graph Neural NetworkTraveling Salesman Problem

All Nodes are created Not Equal: Node-Specific Layer Aggregation and Filtration for GNN

2024-05-13 · Shilong Wang, Hao Wu, Yifan Duan, Guibin Zhang 외

The ever-designed Graph Neural Networks, though opening a promising path for the modeling of the graph-structure data, unfortunately introduce two daunting obstacles to their deployment on devices. (I) Most of existing G…

All

Multi-hop Attention Graph Neural Network

2020-09-29 · Guangtao Wang, Rex Ying, Jing Huang, Jure Leskovec

Self-attention mechanism in graph neural networks (GNNs) led to state-of-the-art performance on many graph representation learning tasks. Currently, at every layer, attention is computed between connected pairs of nodes …

Graph Neural NetworkGraph Representation LearningKnowledge Graph CompletionNode Classification+1