Rethinking Graph-Based Document Classification: Learning Data-Driven Structures Beyond Heuristic Approaches
In document classification, graph-based models effectively capture document structure, overcoming sequence length limitations and enhancing contextual understanding. However, most existing graph document representations rely on heuristics, domain-specific rules, or expert knowledge. Unlike previous approaches, we propose a method to learn data-driven graph structures, eliminating the need for manual design and reducing domain dependence. Our approach constructs homogeneous weighted graphs with sentences as nodes, while edges are learned via a self-attention model that identifies dependencies between sentence pairs. A statistical filtering strategy aims to retain only strongly correlated sentences, improving graph quality while reducing the graph size. Experiments on three document classification datasets demonstrate that learned graphs consistently outperform heuristic-based graphs, achieving higher accuracy and $F_1$ score. Furthermore, our study demonstrates the effectiveness of the statistical filtering in improving classification robustness. These results highlight the potential of automatic graph generation over traditional heuristic approaches and open new directions for broader applications in NLP.
Code (0)
등록된 구현이 없습니다.
Tasks
Document ClassificationGraph GenerationSimilar Papers 제목 키워드 기반
From Global to Local: Learning Context-Aware Graph Representations for Document Classification and Summarization
Recent NLP systems commonly represent documents as linear token sequences. Although this captures sequential order, it can hinder modeling long-range dependencies and global document structure, especially for long texts.…
Document ClassificationDocument SummarizationHierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentiment Analysis
Document-level Sentiment Analysis (DSA) is more challenging due to vague semantic links and complicate sentiment information. Recent works have been devoted to leveraging text summarization and have achieved promising re…
Sentiment AnalysisSentiment ClassificationText ClassificationRethinking Kernel Methods for Node Representation Learning on Graphs
Graph kernels are kernel methods measuring graph similarity and serve as a standard tool for graph classification. However, the use of kernel methods for node classification, which is a related problem to graph represent…
ClassificationGeneral ClassificationGraph ClassificationGraph Representation Learning+4Rethinking Complex Neural Network Architectures for Document Classification
Neural network models for many NLP tasks have grown increasingly complex in recent years, making training and deployment more difficult. A number of recent papers have questioned the necessity of such architectures and f…
ClassificationDocument ClassificationGeneral ClassificationLanguage Modeling+1Rethinking Table Recognition using Graph Neural Networks
Document structure analysis, such as zone segmentation and table recognition, is a complex problem in document processing and is an active area of research. The recent success of deep learning in solving various computer…
Dataset GenerationTable Recognition