GraphRevisedIE: Multimodal Information Extraction with Graph-Revised Network
Key information extraction (KIE) from visually rich documents (VRD) has been a challenging task in document intelligence because of not only the complicated and diverse layouts of VRD that make the model hard to generalize but also the lack of methods to exploit the multimodal features in VRD. In this paper, we propose a light-weight model named GraphRevisedIE that effectively embeds multimodal features such as textual, visual, and layout features from VRD and leverages graph revision and graph convolution to enrich the multimodal embedding with global context. Extensive experiments on multiple real-world datasets show that GraphRevisedIE generalizes to documents of varied layouts and achieves comparable or better performance compared to previous KIE methods. We also publish a business license dataset that contains both real-life and synthesized documents to facilitate research of document KIE.
Code (1)
Tasks
Key Information ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction
Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs), in which named entity recognition (NER) is treated as a sequence-labeling task of p…
Entity LinkingKey Information ExtractionKey-value Pair Extractionnamed-entity-recognition+9Revised JNLPBA Corpus: A Revised Version of Biomedical NER Corpus for Relation Extraction Task
The advancement of biomedical named entity recognition (BNER) and biomedical relation extraction (BRE) researches promotes the development of text mining in biological domains. As a cornerstone of BRE, robust BNER system…
Event Extractionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3Multimodal Learning on Graphs for Disease Relation Extraction
Objective: Disease knowledge graphs are a way to connect, organize, and access disparate information about diseases with numerous benefits for artificial intelligence (AI). To create knowledge graphs, it is necessary to …
Knowledge GraphsRelationRelation ExtractionOn Analyzing the Role of Image for Visual-enhanced Relation Extraction
Multimodal relation extraction is an essential task for knowledge graph construction. In this paper, we take an in-depth empirical analysis that indicates the inaccurate information in the visual scene graph leads to poo…
graph constructionRelationRelation ExtractionSemi-Automatic Data Annotation, POS Tagging and Mildly Context-Sensitive Disambiguation: the eXtended Revised AraMorph (XRAM)
An extended, revised form of Tim Buckwalter's Arabic lexical and morphological resource AraMorph, eXtended Revised AraMorph (henceforth XRAM), is presented which addresses a number of weaknesses and inconsistencies of th…
POSPOS Tagging