paper-with-me

Papers

Neighbour Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Graph neural networks (GNNs) have attracted extensive research interests in text classification tasks, due to their superiority in representation learning. However, most existing studies adopt the same semi-supervised learning setting as the vanilla Graph Convolution Network (GCN), which require a large amount of labelled data during training and thus are less robust when dealing with large-scale graph data with few labels. Additionally, graph structure information is normally captured by direct information aggregation via network schema and missing adjacency knowledge may hinder the performance. Addressing those problems, this paper proposes a novel method to learn graph structure, by using simple neighbour contrastive learning for an existing self-supervised heterogeneous graph neural network model (NC-HGAT). It considers the graph structure information from heterogeneous graphs with a multi-layer perceptrons (MLPs) and delivers consistent results, despite the corrupted neighbouring connections. Extensive experiments have been implemented on four benchmark short-text datasets, and demonstrate that our proposed model NC-HGAT outperforms the state-of-the-art methods on three datasets and achieves a competitive result on the remaining dataset.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningGraph AttentionGraph Neural NetworkRepresentation Learningtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Contrastive Learning 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Summarize before Aggregate: A Global-to-local Heterogeneous Graph Inference Network for Conversational Emotion Recognition

2020-12-01 · COLING 2020 8 · Dongming Sheng, Dong Wang, Ying Shen, Haitao Zheng 외

Conversational Emotion Recognition (CER) is a crucial task in Natural Language Processing (NLP) with wide applications. Prior works in CER generally focus on modeling emotion influences solely with utterance-level featur…

Emotion RecognitionEmotion Recognition in Conversation

All4One: Symbiotic Neighbour Contrastive Learning via Self-Attention and Redundancy Reduction

2023-03-16 · ICCV 2023 1 · Imanol G. Estepa, Ignacio Sarasúa, Bhalaji Nagarajan, Petia Radeva

Nearest neighbour based methods have proved to be one of the most successful self-supervised learning (SSL) approaches due to their high generalization capabilities. However, their computational efficiency decreases when…

Computational EfficiencyContrastive LearningSelf-Supervised Image ClassificationSelf-Supervised Learning

Contrastive Graph Learning for Population-based fMRI Classification

2022-03-26 · Xuesong Wang, Lina Yao, Islem Rekik, Yu Zhang

Contrastive self-supervised learning has recently benefited fMRI classification with inductive biases. Its weak label reliance prevents overfitting on small medical datasets and tackles the high intraclass variances. Non…

ClassificationFunctional ConnectivityGraph LearningSelf-Supervised Learning

A Heterogeneous Network-based Contrastive Learning Approach for Predicting Drug-Target Interaction

2024-10-20 · Junwei Hu, Michael Bewong, Selasi Kwashie, Wen Zhang 외

Drug-target interaction (DTI) prediction is crucial for drug development and repositioning. Methods using heterogeneous graph neural networks (HGNNs) for DTI prediction have become a promising approach, with attention-ba…

Contrastive LearningGraph Attention

Dual-Attention Graph Convolutional Network

2019-11-28 · Xueya Zhang, Tong Zhang, Wenting Zhao, Zhen Cui 외

Graph convolutional networks (GCNs) have shown the powerful ability in text structure representation and effectively facilitate the task of text classification. However, challenges still exist in adapting GCN on learning…

Diversitytext-classificationText Classification