paper-with-me

홈 › Papers

Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification

2021-12-13 · Yinhua Piao, Sangseon Lee, Dohoon Lee, Sun Kim

Recently, graph neural networks (GNNs) have been widely used for document classification. However, most existing methods are based on static word co-occurrence graphs without sentence-level information, which poses three challenges:(1) word ambiguity, (2) word synonymity, and (3) dynamic contextual dependency. To address these challenges, we propose a novel GNN-based sparse structure learning model for inductive document classification. Specifically, a document-level graph is initially generated by a disjoint union of sentence-level word co-occurrence graphs. Our model collects a set of trainable edges connecting disjoint words between sentences and employs structure learning to sparsely select edges with dynamic contextual dependencies. Graphs with sparse structures can jointly exploit local and global contextual information in documents through GNNs. For inductive learning, the refined document graph is further fed into a general readout function for graph-level classification and optimization in an end-to-end manner. Extensive experiments on several real-world datasets demonstrate that the proposed model outperforms most state-of-the-art results, and reveal the necessity to learn sparse structures for each document.

📄 PDF Abstract BibTeX arXiv:2112.06386

Code (1)

qkrdmsghk/textssl 공식 구현 pytorch

Tasks

ClassificationDocument ClassificationInductive LearningSentence

Similar Papers 제목 키워드 기반

Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks

2020-04-22 · ACL 2020 6 · Yufeng Zhang, Xueli Yu, Zeyu Cui, Shu Wu 외

Text classification is fundamental in natural language processing (NLP), and Graph Neural Networks (GNN) are recently applied in this task. However, the existing graph-based works can neither capture the contextual word …

ClassificationDocument EmbeddingGeneral ClassificationInductive Learning+2

Inductive Topic Variational Graph Auto-Encoder for Text Classification

2021-06-01 · NAACL 2021 4 · Qianqian Xie, Jimin Huang, Pan Du, Min Peng 외

Graph convolutional networks (GCNs) have been applied recently to text classification and produced an excellent performance. However, existing GCN-based methods do not assume an explicit latent semantic structure of docu…

ClassificationInductive LearningRepresentation LearningSemi-Supervised Text Classification+2

Word Grounded Graph Convolutional Network

2023-05-10 · Zhibin Lu, Qianqian Xie, Benyou Wang, Jian-Yun Nie

Graph Convolutional Networks (GCNs) have shown strong performance in learning text representations for various tasks such as text classification, due to its expressive power in modeling graph structure data (e.g., a lite…

text-classificationText Classification

ConTextING: Granting Document-Wise Contextual Embeddings to Graph Neural Networks for Inductive Text Classification

2022-10-01 · COLING 2022 10 · Yen-Hao Huang, Yi-Hsin Chen, Yi-Shin Chen

Graph neural networks (GNNs) have been recently applied in natural language processing. Various GNN research studies are proposed to learn node interactions within the local graph of each document that contains words, se…

text-classificationText ClassificationWord Embeddings

InducT-GCN: Inductive Graph Convolutional Networks for Text Classification

2021-10-16 · ACL ARR October 2021 10 · Anonymous

Text classification aims to assign labels to textual units by making use of global information. Recent studies have applied graph neural network (GNN) techniques to capture the global word co-occurrence in a corpus. Most…

ClassificationGraph Neural Networktext-classificationText Classification