ReGrAt: Regularization in Graphs using Attention to handle class imbalance

2022-11-27 · Neeraja Kirtane, Jeshuren Chelladurai, Balaraman Ravindran, Ashish Tendulkar

Node classification is an important task to solve in graph-based learning. Even though a lot of work has been done in this field, imbalance is neglected. Real-world data is not perfect, and is imbalanced in representations most of the times. Apart from text and images, data can be represented using graphs, and thus addressing the imbalance in graphs has become of paramount importance. In the context of node classification, one class has less examples than others. Changing data composition is a popular way to address the imbalance in node classification. This is done by resampling the data to balance the dataset. However, that can sometimes lead to loss of information or add noise to the dataset. Therefore, in this work, we implicitly solve the problem by changing the model loss. Specifically, we study how attention networks can help tackle imbalance. Moreover, we observe that using a regularizer to assign larger weights to minority nodes helps to mitigate this imbalance. We achieve State of the Art results than the existing methods on several standard citation benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2211.14770

Code (0)

등록된 구현이 없습니다.

Tasks

Classification Node Classification

Gophormer: Ego-Graph Transformer for Node Classification

2021-10-25 · Jianan Zhao, Chaozhuo Li, Qianlong Wen, Yiqi Wang 외

Transformers have achieved remarkable performance in a myriad of fields including natural language processing and computer vision. However, when it comes to the graph mining area, where graph neural network (GNN) has bee…

Classification Data Augmentation Graph Mining Graph Neural Network+2

GSINA: Improving Subgraph Extraction for Graph Invariant Learning via Graph Sinkhorn Attention

2024-02-11 · Fangyu Ding, Haiyang Wang, Zhixuan Chu, Tianming Li 외

Graph invariant learning (GIL) has been an effective approach to discovering the invariant relationships between graph data and its labels for different graph learning tasks under various distribution shifts. Many recent…

Graph Attention Graph Learning

Lovasz Convolutional Networks

2018-05-29 · Prateek Yadav, Madhav Nimishakavi, Naganand Yadati, Shikhar Vashishth 외

Semi-supervised learning on graph structured data has received significant attention with the recent introduction of Graph Convolution Networks (GCN). While traditional methods have focused on optimizing a loss augmented…

Multi-class Classification

Sparse Graph Attention Networks

2019-12-02 · Yang Ye, Shihao Ji

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node cla…

Classification General Classification Graph Attention Graph Classification+4

Superpixel Image Classification with Graph Attention Networks

2020-02-13 · Pedro H. C. Avelar, Anderson R. Tavares, Thiago L. T. da Silveira, Cláudio R. Jung 외

This paper presents a methodology for image classification using Graph Neural Network (GNN) models. We transform the input images into region adjacency graphs (RAGs), in which regions are superpixels and edges connect ne…

Classification General Classification Graph Attention Graph Neural Network+5