Radically Lower Data-Labeling Costs for Visually Rich Document Extraction Models
A key bottleneck in building automatic extraction models for visually rich documents like invoices is the cost of acquiring the several thousand high-quality labeled documents that are needed to train a model with acceptable accuracy. We propose Selective Labeling to simplify the labeling task to provide "yes/no" labels for candidate extractions predicted by a model trained on partially labeled documents. We combine this with a custom active learning strategy to find the predictions that the model is most uncertain about. We show through experiments on document types drawn from 3 different domains that selective labeling can reduce the cost of acquiring labeled data by $10\times$ with a negligible loss in accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningSimilar Papers 제목 키워드 기반
Cost-Accuracy Aware Adaptive Labeling for Active Learning
Conventional active learning algorithms assume a single labeler that produces noiseless label at a given, fixed cost, and aim to achieve the best generalization performance for given classifier under a budget constraint.…
Active LearningInformativenessCost-aware LLM-based Online Dataset Annotation
Recent advances in large language models (LLMs) have enabled automated dataset labeling with minimal human supervision. While majority voting across multiple LLMs can improve label reliability by mitigating individual mo…
MMLUActive Data Acquisition in Autonomous Driving Simulation
Autonomous driving algorithms rely heavily on learning-based models, which require large datasets for training. However, there is often a large amount of redundant information in these datasets, while collecting and proc…
Autonomous DrivingApplication of CTS (Computer to Screen) Machine in Printing Industries for Process Improvement & Material Optimization
The printing and labeling industries are struggling to meet the need for more complex and dynamic design requirements coming from the customers. It is now crucial to implement technological advancements to manage workflo…
Cost-Quality Adaptive Active Learning for Chinese Clinical Named Entity Recognition
Clinical Named Entity Recognition (CNER) aims to automatically identity clinical terminologies in Electronic Health Records (EHRs), which is a fundamental and crucial step for clinical research. To train a high-performan…
Active LearningInformativenessnamed-entity-recognitionNamed Entity Recognition+2