Spatial Dependency Parsing for Semi-Structured Document Information Extraction
Information Extraction (IE) for semi-structured document images is often approached as a sequence tagging problem by classifying each recognized input token into one of the IOB (Inside, Outside, and Beginning) categories. However, such problem setup has two inherent limitations that (1) it cannot easily handle complex spatial relationships and (2) it is not suitable for highly structured information, which are nevertheless frequently observed in real-world document images. To tackle these issues, we first formulate the IE task as spatial dependency parsing problem that focuses on the relationship among text tokens in the documents. Under this setup, we then propose SPADE (SPAtial DEpendency parser) that models highly complex spatial relationships and an arbitrary number of information layers in the documents in an end-to-end manner. We evaluate it on various kinds of documents such as receipts, name cards, forms, and invoices, and show that it achieves a similar or better performance compared to strong baselines including BERT-based IOB taggger.
Code (1)
Tasks
Dependency ParsingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-Supervised Semantic Dependency Parsing Using CRF Autoencoders
Semantic dependency parsing, which aims to find rich bi-lexical relationships, allows words to have multiple dependency heads, resulting in graph-structured representations. We propose an approach to semi-supervised lear…
ARCDecoderDependency ParsingSemantic Dependency Parsing+1Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
Document parsing is essential for converting unstructured and semi-structured documents such as contracts, academic papers, and invoices into structured, machine-readable data. Document parsing reliable structured data f…
Data IntegrationKnowledge Base ConstructionSemi-Supervised Methods for Out-of-Domain Dependency Parsing
Dependency parsing is one of the important natural language processing tasks that assigns syntactic trees to texts. Due to the wider availability of dependency corpora and improved parsing and machine learning techniques…
Dependency ParsingXFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser
In the domain of Document AI, parsing semi-structured image form is a crucial Key Information Extraction (KIE) task. The advent of pre-trained multimodal models significantly empowers Document AI frameworks to extract ke…
Document AIFormKey Information ExtractionLanguage Modelling+1MindBench: A Comprehensive Benchmark for Mind Map Structure Recognition and Analysis
Multimodal Large Language Models (MLLM) have made significant progress in the field of document analysis. Despite this, existing benchmarks typically focus only on extracting text and simple layout information, neglectin…
PositionQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)