paper-with-me

홈 › Papers

Information Extraction from Visually Rich Documents Using Directed Weighted Graph Neural Network

2024-09-11 · International Conference on Document Analysis and Recognition 2024 9 · Hamza Gbada, Karim Kalti, Mohamed Ali Mahjoub

This paper presents a novel approach to information extraction (IE) from visually rich documents (VRD) by employing a directed weighted graph representation to capture relationships among various VRD components. In contrast to conventional methods relying on spatial proximity through Euclidean distance, our approach aims to enhance performance by introducing a novel representation of relationships using directed weighted graphs. The information extraction task from VRD is treated as a node classification problem, leveraging graph convolutional networks that process the VRD graphs. We conducted evaluations on five real-world datasets, showcasing notable results and performances that align with established norms.

📄 PDF Abstract BibTeX

Code (1)

HamzaGbada/direct-neighbor-vrd 공식 구현 pytorch

Tasks

Document Layout Analysisdocument understandingGraph Neural NetworkInformation RetrievalKey Information ExtractionNode Classification

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction

2023-10-17 · Chong Zhang, Ya Guo, Yi Tu, Huan Chen 외

Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs), in which named entity recognition (NER) is treated as a sequence-labeling task of p…

Entity LinkingKey Information ExtractionKey-value Pair Extractionnamed-entity-recognition+9

Multimodal weighted graph representation for information extraction from visually rich documents.

2024-01-05 · Neurocomputing 2024 1 · Hamza Gbada, Karim Kalti, Mohamed Ali Mahjoub

This paper introduces a novel system for information extraction from visually rich documents (VRD) using a weighted graph representation. The proposed method aims to improve the performance of the information extraction …

Document Layout Analysisdocument understandingGraph Neural NetworkInformation Retrieval+2

TRIE++: Towards End-to-End Information Extraction from Visually Rich Documents

2022-07-14 · Zhanzhan Cheng, Peng Zhang, Can Li, Qiao Liang 외

Recently, automatically extracting information from visually rich documents (e.g., tickets and resumes) has become a hot and vital research topic due to its widespread commercial value. Most existing methods divide this …

global-optimizationLanguage Modelling

Document Intelligence Metrics for Visually Rich Document Evaluation

2022-05-23 · Jonathan Degange, Swapnil Gupta, Zhuoyu Han, Krzysztof Wilkosz 외

The processing of Visually-Rich Documents (VRDs) is highly important in information extraction tasks associated with Document Intelligence. We introduce DI-Metrics, a Python library devoted to VRD model evaluation compri…

Document AI

Graph Convolution for Multimodal Information Extraction from Visually Rich Documents

2019-03-27 · NAACL 2019 6 · Xiaojing Liu, Feiyu Gao, Qiong Zhang, Huasha Zhao

Visually rich documents (VRDs) are ubiquitous in daily business and life. Examples are purchase receipts, insurance policy documents, custom declaration forms and so on. In VRDs, visual and layout information is critical…

document understandingEntity Extraction using GAN