paper-with-me

홈 › Papers

Document-level Entity-based Extraction as Template Generation

2021-09-10 · EMNLP 2021 11 · Kung-Hsiang Huang, Sam Tang, Nanyun Peng

Document-level entity-based extraction (EE), aiming at extracting entity-centric information such as entity roles and entity relations, is key to automatic knowledge acquisition from text corpora for various domains. Most document-level EE systems build extractive models, which struggle to model long-term dependencies among entities at the document level. To address this issue, we propose a generative framework for two document-level EE tasks: role-filler entity extraction (REE) and relation extraction (RE). We first formulate them as a template generation problem, allowing models to efficiently capture cross-entity dependencies, exploit label semantics, and avoid the exponential computation complexity of identifying N-ary relations. A novel cross-attention guided copy mechanism, TopK Copy, is incorporated into a pre-trained sequence-to-sequence model to enhance the capabilities of identifying key information in the input document. Experiments done on the MUC-4 and SciREX dataset show new state-of-the-art results on REE (+3.26%), binary RE (+4.8%), and 4-ary RE (+2.7%) in F1 score.

📄 PDF Abstract BibTeX arXiv:2109.04901

Code (1)

PlusLabNLP/TempGen 공식 구현 pytorch

Tasks

4-ary Relation ExtractionBinary Relation ExtractionRole-filler Entity Extraction

Methods 이 논문이 사용한 방법론

TopK Copy TopK Copy is a cross-attention guided copy mechanism for entity extraction where only the Top-$k$ important attention heads are used for computing copy distributions. The…

Similar Papers 제목 키워드 기반

GRIT: Generative Role-filler Transformers for Document-level Event Entity Extraction

2020-08-21 · EACL 2021 2 · Xinya Du, Alexander M. Rush, Claire Cardie

We revisit the classic problem of document-level role-filler entity extraction (REE) for template filling. We argue that sentence-level approaches are ill-suited to the task and introduce a generative transformer-based e…

DecoderRole-filler Entity ExtractionSentence

LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documents

2024-11-22 · Hitesh Laxmichand Patel, Amit Agarwal, Bhargava Kumar, Karan Gupta 외

Accurate barcode detection and decoding in Identity documents is crucial for applications like security, healthcare, and education, where reliable data extraction and verification are essential. However, building robust …

Synthetic Data Generation

Iterative Document-level Information Extraction via Imitation Learning

2022-10-12 · Yunmo Chen, William Gantt, Weiwei Gu, Tongfei Chen 외

We present a novel iterative extraction model, IterX, for extracting complex relations, or templates (i.e., N-tuples representing a mapping from named slots to spans of text) within a document. Documents may feature zero…

4-ary Relation ExtractionImitation LearningRelation Extraction

Lightweight Spatial Modeling for Combinatorial Information Extraction From Documents

2024-05-08 · Yanfei Dong, Lambert Deng, Jiazheng Zhang, Xiaodong Yu 외

Documents that consist of diverse templates and exhibit complex spatial structures pose a challenge for document entity classification. We propose KNN-former, which incorporates a new kind of spatial bias in attention ca…

Document-Level Event Argument Extraction by Conditional Generation

2021-04-13 · NAACL 2021 4 · Sha Li, Heng Ji, Jiawei Han

Event extraction has long been treated as a sentence-level task in the IE community. We argue that this setting does not match human information-seeking behavior and leads to incomplete and uninformative extraction resul…

Document-level Event ExtractionEvent Argument ExtractionEvent ExtractionSentence+1