Text Level Graph Neural Network for Text Classification
Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information. However, previous methods based on GNN are mainly faced with the practical problems of fixed corpus level graph structure which do not support online testing and high memory consumption. To tackle the problems, we propose a new GNN based model that builds graphs for each input text with global parameters sharing instead of a single graph for the whole corpus. This method removes the burden of dependence between an individual text and entire corpus which support online testing, but still preserve global information. Besides, we build graphs by much smaller windows in the text, which not only extract more local features but also significantly reduce the edge numbers as well as memory consumption. Experiments show that our model outperforms existing models on several text classification datasets even with consuming less memory.
Code (2)
Tasks
ClassificationGeneral ClassificationGraph Neural Networktext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TextRGNN: Residual Graph Neural Networks for Text Classification
Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initializat…
ClassificationGraph Neural NetworkLanguage ModelingLanguage Modelling+2Graph Neural Networks for Text Classification: A Survey
Text Classification is the most essential and fundamental problem in Natural Language Processing. While numerous recent text classification models applied the sequential deep learning technique, graph neural network-base…
Classificationgraph constructionGraph Neural NetworkSurvey+2A semantic hierarchical graph neural network for text classification
The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classificat…
ClassificationGraph Neural NetworkSentencetext-classification+1Multi-Level Graph Convolutional Network with Automatic Graph Learning for Hyperspectral Image Classification
Nowadays, deep learning methods, especially the Graph Convolutional Network (GCN), have shown impressive performance in hyperspectral image (HSI) classification. However, the current GCN-based methods treat graph constru…
General Classificationgraph constructionGraph LearningHyperspectral Image Classification+2Heterogeneous Graph Attention Networks for Semi-supervised Short Text Classification
Short text classification has found rich and critical applications in news and tweet tagging to help users find relevant information. Due to lack of labeled training data in many practical use cases, there is a pressing …
ClassificationGeneral ClassificationGraph AttentionGraph Neural Network+3