paper-with-me

Papers

Table Detection for Visually Rich Document Images

2023-05-30 · Bin Xiao, Murat Simsek, Burak Kantarci, Ala Abu Alkheir

Table Detection (TD) is a fundamental task to enable visually rich document understanding, which requires the model to extract information without information loss. However, popular Intersection over Union (IoU) based evaluation metrics and IoU-based loss functions for the detection models cannot directly represent the degree of information loss for the prediction results. Therefore, we propose to decouple IoU into a ground truth coverage term and a prediction coverage term, in which the former can be used to measure the information loss of the prediction results. Besides, considering the sparse distribution of tables in document images, we use SparseR-CNN as the base model and further improve the model by using Gaussian Noise Augmented Image Size region proposals and many-to-one label assignments. Results under comprehensive experiments show that the proposed method can consistently outperform state-of-the-art methods with different IoU-based metrics under various datasets and demonstrate that the proposed decoupled IoU loss can enable the model to alleviate information loss.

📄 PDF Abstract BibTeX arXiv:2305.19181

Code (1)

uobinxiao/SparseTableDet 공식 구현 pytorch

Tasks

document understandingobject-detectionObject DetectionPredictionTable Detection

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Table Structure Recognition using Top-Down and Bottom-Up Cues

2020-10-09 · ECCV 2020 8 · Sachin Raja, Ajoy Mondal, C. V. Jawahar

Tables are information-rich structured objects in document images. While significant work has been done in localizing tables as graphic objects in document images, only limited attempts exist on table structure recogniti…

Cell DetectionOptical Character RecognitionOptical Character Recognition (OCR)Table Recognition

ColPali: Efficient Document Retrieval with Vision Language Models

2024-06-27 · Manuel Faysse, Hugues Sibille, Tony Wu, Bilel Omrani 외

Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts. Since modern retrieval systems mainly rely on the textual information they extract from …

document understandingRAGRetrievalRetrieval-augmented Generation+1

VRDU: A Benchmark for Visually-rich Document Understanding

2022-11-15 · Zilong Wang, Yichao Zhou, Wei Wei, Chen-Yu Lee 외

Understanding visually-rich business documents to extract structured data and automate business workflows has been receiving attention both in academia and industry. Although recent multi-modal language models have achie…

document understanding

LayerDoc: Layer-wise Extraction of Spatial Hierarchical Structure in Visually-Rich Documents

2023-01-07 · IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 1 · Puneet Mathur, Rajiv Jain, Ashutosh Mehra, Jiuxiang Gu 외

Digital documents often contain images and scanned text. Parsing such visually-rich documents is a core task for work-flow automation, but it remains challenging since most documents do not encode explicit layout informa…

Reading Order Detection

DAViD: Domain Adaptive Visually-Rich Document Understanding with Synthetic Insights

2024-10-02 · Yihao Ding, Soyeon Caren Han, Zechuan Li, Hyunsuk Chung

Visually-Rich Documents (VRDs), encompassing elements like charts, tables, and references, convey complex information across various fields. However, extracting information from these rich documents is labor-intensive, e…

document understandingDomain AdaptationRepresentation Learning