Document Structure Extraction using Prior based High Resolution Hierarchical Semantic Segmentation
Structure extraction from document images has been a long-standing research topic due to its high impact on a wide range of practical applications. In this paper, we share our findings on employing a hierarchical semantic segmentation network for this task of structure extraction. We propose a prior based deep hierarchical CNN network architecture that enables document structure extraction using very high resolution(1800 x 1000) images. We divide the document image into overlapping horizontal strips such that the network segments a strip and uses its prediction mask as prior for predicting the segmentation of the subsequent strip. We perform experiments establishing the effectiveness of our strip based network architecture through ablation methods and comparison with low-resolution variations. Further, to demonstrate our network's capabilities, we train it on only one type of documents (Forms) and achieve state-of-the-art results over other general document datasets. We introduce our new human-annotated forms dataset and show that our method significantly outperforms different segmentation baselines on this dataset in extracting hierarchical structures. Our method is currently being used in Adobe's AEM Forms for automated conversion of paper and PDF forms to modern HTML based forms.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSemantic SegmentationTable DetectionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Harvesting Events from Multiple Sources: Towards a Cross-Document Event Extraction Paradigm
Document-level event extraction aims to extract structured event information from unstructured text. However, a single document often contains limited event information and the roles of different event arguments may be b…
coreference-resolutionCoreference ResolutionDocument-level Event ExtractionEvent ExtractionInjecting Knowledge Base Information into End-to-End Joint Entity and Relation Extraction and Coreference Resolution
We consider a joint information extraction (IE) model, solving named entity recognition, coreference resolution and relation extraction jointly over the whole document. In particular, we study how to inject information f…
coreference-resolutionCoreference ResolutionEntity LinkingJoint Entity and Relation Extraction+4DTBench: A Synthetic Benchmark for Document-to-Table Extraction
Document-to-table (Doc2Table) extraction derives structured tables from unstructured documents under a target schema, enabling reliable and verifiable SQL-based data analytics. Although large language models (LLMs) have …
Information ExtractionDocument-Level Event Argument Extraction via Optimal Transport
Event Argument Extraction (EAE) is one of the sub-tasks of event extraction, aiming to recognize the role of each entity mention toward a specific event trigger. Despite the success of prior works in sentence-level EAE, …
Event Argument ExtractionEvent ExtractionSentenceMolecular Structure Extraction From Documents Using Deep Learning
Chemical structure extraction from documents remains a hard problem due to both false positive identification of structures during segmentation and errors in the predicted structures. Current approaches rely on handcraft…
ArticlesDeep LearningDiversity