paper-with-me

홈 › Papers

Information Extraction from Documents: Question Answering vs Token Classification in real-world setups

2023-04-21 · Laurent Lam, Pirashanth Ratnamogan, Joël Tang, William Vanhuffel, Fabien Caspani

Research in Document Intelligence and especially in Document Key Information Extraction (DocKIE) has been mainly solved as Token Classification problem. Recent breakthroughs in both natural language processing (NLP) and computer vision helped building document-focused pre-training methods, leveraging a multimodal understanding of the document text, layout and image modalities. However, these breakthroughs also led to the emergence of a new DocKIE subtask of extractive document Question Answering (DocQA), as part of the Machine Reading Comprehension (MRC) research field. In this work, we compare the Question Answering approach with the classical token classification approach for document key information extraction. We designed experiments to benchmark five different experimental setups : raw performances, robustness to noisy environment, capacity to extract long entities, fine-tuning speed on Few-Shot Learning and finally Zero-Shot Learning. Our research showed that when dealing with clean and relatively short entities, it is still best to use token classification-based approach, while the QA approach could be a good alternative for noisy environment or long entities use-cases.

📄 PDF Abstract BibTeX arXiv:2304.10994

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationFew-Shot LearningKey Information ExtractionMachine Reading ComprehensionQuestion AnsweringReading Comprehensiontoken-classificationToken ClassificationZero-Shot Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Architecture of an Ontology-Based Domain-Specific Natural Language Question Answering System

2013-11-13 · Athira P. M., Sreeja M., P. C. Reghu Raj

Question answering (QA) system aims at retrieving precise information from a large collection of documents against a query. This paper describes the architecture of a Natural Language Question Answering (NLQA) system for…

Question Answering

Learning to Search in Long Documents Using Document Structure

2018-06-09 · COLING 2018 8 · Mor Geva, Jonathan Berant

Reading comprehension models are based on recurrent neural networks that sequentially process the document tokens. As interest turns to answering more complex questions over longer documents, sequential reading of large …

Information RetrievalQuestion AnsweringReading ComprehensionRetrieval

InteractiveIE: Towards Assessing the Strength of Human-AI Collaboration in Improving the Performance of Information Extraction

2023-05-24 · Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella 외

Learning template based information extraction from documents is a crucial yet difficult task. Prior template-based IE approaches assume foreknowledge of the domain templates; however, real-world IE do not have pre-defin…

Question AnsweringQuestion GenerationQuestion-Generation

Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset

2023-11-14 · Zafaryab Rasool, Stefanus Kurniawan, Sherwin Balugo, Scott Barnett 외

Document-based Question-Answering (QA) tasks are crucial for precise information retrieval. While some existing work focus on evaluating large language models performance on retrieving and answering questions from docume…

Answer SelectionInformation RetrievalMultiple-choiceQuestion Answering+1

Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering

2023-10-30 · Xin Su, Phillip Howard, Nagib Hakim, Steven Bethard

Answering time-sensitive questions from long documents requires temporal reasoning over the times in questions and documents. An important open question is whether large language models can perform such reasoning solely …

Question AnsweringTemporal Information Extraction