Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networks
Geometric Deep Learning has recently attracted significant interest in a wide range of machine learning fields, including document analysis. The application of Graph Neural Networks (GNNs) has become crucial in various document-related tasks since they can unravel important structural patterns, fundamental in key information extraction processes. Previous works in the literature propose task-driven models and do not take into account the full power of graphs. We propose Doc2Graph, a task-agnostic document understanding framework based on a GNN model, to solve different tasks given different types of documents. We evaluated our approach on two challenging datasets for key information extraction in form understanding, invoice layout analysis and table detection. Our code is freely accessible on https://github.com/andreagemelli/doc2graph.
Code (1)
Tasks
Document Layout Analysisdocument understandingEntity LinkingKey Information ExtractionSemantic entity labelingTable DetectionSimilar Papers 제목 키워드 기반
GeoContrastNet: Contrastive Key-Value Edge Learning for Language-Agnostic Document Understanding
This paper presents GeoContrastNet, a language-agnostic framework to structured document understanding (DU) by integrating a contrastive learning objective with graph attention networks (GATs), emphasizing the significan…
Contrastive Learningdocument understandingGraph AttentionLink Prediction+2HRVDA: High-Resolution Visual Document Assistant
Leveraging vast training data, multimodal large language models (MLLMs) have demonstrated formidable general visual comprehension capabilities and achieved remarkable performance across various tasks. However, their perf…
document understandingSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding
Scientific papers require models to reason jointly over text, equations, figures, tables, code, and datasets while preserving the provenance of supporting evidence. Existing benchmarks typically evaluate these capabiliti…
Multimodal Pre-training Based on Graph Attention Network for Document Understanding
Document intelligence as a relatively new research topic supports many business applications. Its main task is to automatically read, understand, and analyze documents. However, due to the diversity of formats (invoices,…
document understandingGraph AttentionSentenceHypergraph based Understanding for Document Semantic Entity Recognition
Semantic entity recognition is an important task in the field of visually-rich document understanding. It distinguishes the semantic types of text by analyzing the position relationship between text nodes and the relatio…
document understanding