From Global to Local: Learning Context-Aware Graph Representations for Document Classification and Summarization
Recent NLP systems commonly represent documents as linear token sequences. Although this captures sequential order, it can hinder modeling long-range dependencies and global document structure, especially for long texts. This paper proposes a data-driven method to automatically construct graph-based document representations. Building upon the recent work of Bugueño and de Melo (2025), we leverage the dynamic sliding-window attention module to effectively capture local and mid-range semantic dependencies between sentences, as well as structural relations within documents. Graph Attention Networks (GATs) trained on our learned graphs achieve competitive results on document classification while requiring lower computational resources than previous approaches. We further present an exploratory evaluation of the proposed graph construction method for extractive document summarization, highlighting both its potential and current limitations. The implementation of this project can be found on GitHub.
Code (0)
등록된 구현이 없습니다.
Tasks
Document ClassificationDocument SummarizationSimilar Papers 제목 키워드 기반
Locality Preserving Dense Graph Convolutional Networks with Graph Context-Aware Node Representations
Graph convolutional networks (GCNs) have been widely used for representation learning on graph data, which can capture structural patterns on a graph via specifically designed convolution and readout operations. In many …
ClassificationDecoderGeneral ClassificationGraph Classification+1KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding
With the advent of pretrained language models (LMs), increasing research efforts have been focusing on infusing commonsense and domain-specific knowledge to prepare LMs for downstream tasks. These works attempt to levera…
document understandingKnowledge GraphsLanguage ModellingOpen-Ended Question Answering+1MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization
Robots are often required to localize in environments with unknown object classes and semantic ambiguity. However, when performing global localization using semantic objects, high semantic ambiguity intensifies object mi…
Semantic correspondencePose EstimationGraph MatchingSemi-Supervised Deep Learning for Multiplex Networks
Multiplex networks are complex graph structures in which a set of entities are connected to each other via multiple types of relations, each relation representing a distinct layer. Such graphs are used to investigate man…
Deep LearningRepresentation LearningNode-wise Localization of Graph Neural Networks
Graph neural networks (GNNs) emerge as a powerful family of representation learning models on graphs. To derive node representations, they utilize a global model that recursively aggregates information from the neighbori…
Representation Learning