paper-with-me

홈 › Papers

Global Context-enhanced Graph Convolutional Networks for Document-level Relation Extraction

2020-12-01 · COLING 2020 8 · Huiwei Zhou, Yibin Xu, Weihong Yao, Zhe Liu, Chengkun Lang, Haibin Jiang

Document-level Relation Extraction (RE) is particularly challenging due to complex semantic interactions among multiple entities in a document. Among exiting approaches, Graph Convolutional Networks (GCN) is one of the most effective approaches for document-level RE. However, traditional GCN simply takes word nodes and adjacency matrix to represent graphs, which is difficult to establish direct connections between distant entity pairs. In this paper, we propose Global Context-enhanced Graph Convolutional Networks (GCGCN), a novel model which is composed of entities as nodes and context of entity pairs as edges between nodes to capture rich global context information of entities in a document. Two hierarchical blocks, Context-aware Attention Guided Graph Convolution (CAGGC) for partially connected graphs and Multi-head Attention Guided Graph Convolution (MAGGC) for fully connected graphs, could take progressively more global context into account. Meantime, we leverage a large-scale distantly supervised dataset to pre-train a GCGCN model with curriculum learning, which is then fine-tuned on the human-annotated dataset for further improving document-level RE performance. The experimental results on DocRED show that our model could effectively capture rich global context information in the document, leading to a state-of-the-art result. Our code is available at https://github.com/Huiweizhou/GCGCN.

📄 PDF Abstract BibTeX

Code (1)

huiweizhou/gcgcn 공식 구현 pytorch

Tasks

Document-level Relation ExtractionRelationRelation Extraction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Graph Convolutional Networks 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

ME-GCN: Multi-dimensional Edge-Enhanced Graph Convolutional Networks for Semi-supervised Text Classification

2021-12-17 · ACL ARR December 2022 12 · Anonymous

Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks, including citation network analysis or …

Semi-Supervised Text Classificationtext-classificationText Classification

GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization

2022-08-21 · COLING 2022 10 · Qianqian Xie, Jimin Huang, Tulika Saha, Sophia Ananiadou

Recently, neural topic models (NTMs) have been incorporated into pre-trained language models (PLMs), to capture the global semantic information for text summarization. However, in these methods, there remain limitations …

Contrastive LearningExtractive SummarizationLanguage ModelingLanguage Modelling+2

SemSeq4FD: Integrating global semantic relationship and local sequential order to enhance text representation for fake news detection

2020-10-03 · Expert Systems with Applications 2020 10 · Yuhang Wang, Li Wang, Yanjie Yang, Tao Lian

The wide spread of fake news has caused huge losses to both governments and the public. Many existing works on fake news detection utilized spreading information like propagators profiles and the propagation structure. H…

Fake News DetectionSentence

Graph Enhanced Dual Attention Network for Document-Level Relation Extraction

2020-12-01 · COLING 2020 8 · Bo Li, Wei Ye, Zhonghao Sheng, Rui Xie 외

Document-level relation extraction requires inter-sentence reasoning capabilities to capture local and global contextual information for multiple relational facts. To improve inter-sentence reasoning, we propose to chara…

Document-level Relation ExtractionRelationRelation ExtractionSentence

ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classification

2022-04-10 · Kunze Wang, Soyeon Caren Han, Siqu Long, Josiah Poon

Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks. Most Graph Convolutional Networks are d…

Semi-Supervised Text ClassificationText Classification