HeteGCN: Heterogeneous Graph Convolutional Networks for Text Classification
We consider the problem of learning efficient and inductive graph convolutional networks for text classification with a large number of examples and features. Existing state-of-the-art graph embedding based methods such as predictive text embedding (PTE) and TextGCN have shortcomings in terms of predictive performance, scalability and inductive capability. To address these limitations, we propose a heterogeneous graph convolutional network (HeteGCN) modeling approach that unites the best aspects of PTE and TextGCN together. The main idea is to learn feature embeddings and derive document embeddings using a HeteGCN architecture with different graphs used across layers. We simplify TextGCN by dissecting into several HeteGCN models which (a) helps to study the usefulness of individual models and (b) offers flexibility in fusing learned embeddings from different models. In effect, the number of model parameters is reduced significantly, enabling faster training and improving performance in small labeled training set scenario. Our detailed experimental studies demonstrate the efficacy of the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationGraph Embeddingtext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP
Graph neural networks have triggered a resurgence of graph-based text classification methods, defining today's state of the art. We show that a wide multi-layer perceptron (MLP) using a Bag-of-Words (BoW) outperforms the…
text-classificationText ClassificationTensor Graph Convolutional Networks for Text Classification
Compared to sequential learning models, graph-based neural networks exhibit some excellent properties, such as ability capturing global information. In this paper, we investigate graph-based neural networks for text clas…
ClassificationGeneral Classificationtext-classificationText ClassificationCross-lingual Text Classification with Heterogeneous Graph Neural Network
Cross-lingual text classification aims at training a classifier on the source language and transferring the knowledge to target languages, which is very useful for low-resource languages. Recent multilingual pretrained l…
ClassificationGraph Neural NetworkSemantic SimilaritySemantic Textual Similarity+2LiGCN: Label-interpretable Graph Convolutional Networks for Multi-label Text Classification
Multi-label text classification (MLTC) is an attractive and challenging task in natural language processing (NLP). Compared with single-label text classification, MLTC has a wider range of applications in practice. In th…
ClassificationGeneral ClassificationMulti Label Text ClassificationMulti-Label Text Classification+2MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networks
Heterogeneous graph neural networks (HGNNs) were proposed for representation learning on structural data with multiple types of nodes and edges. To deal with the performance degradation issue when HGNNs become deep, rese…
Computational EfficiencyGraph Neural NetworkLink PredictionNode Classification+1