paper-with-me

홈 › Papers

A sequence-to-sequence approach for document-level relation extraction

2022-04-03 · BioNLP (ACL) 2022 5 · John Giorgi, Gary D. Bader, Bo wang

Motivated by the fact that many relations cross the sentence boundary, there has been increasing interest in document-level relation extraction (DocRE). DocRE requires integrating information within and across sentences, capturing complex interactions between mentions of entities. Most existing methods are pipeline-based, requiring entities as input. However, jointly learning to extract entities and relations can improve performance and be more efficient due to shared parameters and training steps. In this paper, we develop a sequence-to-sequence approach, seq2rel, that can learn the subtasks of DocRE (entity extraction, coreference resolution and relation extraction) end-to-end, replacing a pipeline of task-specific components. Using a simple strategy we call entity hinting, we compare our approach to existing pipeline-based methods on several popular biomedical datasets, in some cases exceeding their performance. We also report the first end-to-end results on these datasets for future comparison. Finally, we demonstrate that, under our model, an end-to-end approach outperforms a pipeline-based approach. Our code, data and trained models are available at {\url{https://github.com/johngiorgi/seq2rel}}. An online demo is available at {\url{https://share.streamlit.io/johngiorgi/seq2rel/main/demo.py}}.

📄 PDF Abstract BibTeX arXiv:2204.01098

Code (2)

JohnGiorgi/seq2rel-ds 공식 구현
johngiorgi/seq2rel 공식 구현

Tasks

coreference-resolutionCoreference ResolutionDocument-level Relation ExtractionJoint Entity and Relation ExtractionRelationRelation ExtractionSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Seq2rel: A sequence-to-sequence-based approach for document-level relation extraction

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Motivated by the fact that many relations cross the sentence boundary, there has been increasing interest in document-level relation extraction (RE). Document-level RE requires integrating information within and across s…

coreference-resolutionCoreference ResolutionDocument-level Relation ExtractionJoint Entity and Relation Extraction+3

Document-level Entity-based Extraction as Template Generation

2021-09-10 · EMNLP 2021 11 · Kung-Hsiang Huang, Sam Tang, Nanyun Peng

Document-level entity-based extraction (EE), aiming at extracting entity-centric information such as entity roles and entity relations, is key to automatic knowledge acquisition from text corpora for various domains. Mos…

4-ary Relation ExtractionBinary Relation ExtractionRole-filler Entity Extraction

Entity and Evidence Guided Relation Extraction for DocRED

2020-08-27 · Kevin Huang, Guangtao Wang, Tengyu Ma, Jing Huang

Document-level relation extraction is a challenging task which requires reasoning over multiple sentences in order to predict relations in a document. In this paper, we pro-pose a joint training frameworkE2GRE(Entity and…

Document-level Relation ExtractionLanguage ModelingLanguage ModellingRelation+1

SagDRE: Sequence-Aware Graph-Based Document-Level Relation Extraction with Adaptive Margin Loss

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Relation extraction (RE) is an important task for many natural language processing applications. Document-level relation extraction aims to extract the relations within a document and poses many challenges to the RE task…

Document-level Relation ExtractionRelationRelation ExtractionSentence

Extracting N-ary Cross-sentence Relations using Constrained Subsequence Kernel

2020-06-15 · Sachin Pawar, Pushpak Bhattacharyya, Girish K. Palshikar

Most of the past work in relation extraction deals with relations occurring within a sentence and having only two entity arguments. We propose a new formulation of the relation extraction task where the relations are mor…

RelationRelation ExtractionSentencevalid