Text Classification Models for Form Entity Linking

2021-12-14 · María Villota, César Domínguez, Jónathan Heras, Eloy Mata, Vico Pascual

Forms are a widespread type of template-based document used in a great variety of fields including, among others, administration, medicine, finance, or insurance. The automatic extraction of the information included in these documents is greatly demanded due to the increasing volume of forms that are generated in a daily basis. However, this is not a straightforward task when working with scanned forms because of the great diversity of templates with different location of form entities, and the quality of the scanned documents. In this context, there is a feature that is shared by all forms: they contain a collection of interlinked entities built as key-value (or label-value) pairs, together with other entities such as headers or images. In this work, we have tacked the problem of entity linking in forms by combining image processing techniques and a text classification model based on the BERT architecture. This approach achieves state-of-the-art results with a F1-score of 0.80 on the FUNSD dataset, a 5% improvement regarding the best previous method. The code of this project is available at https://github.com/mavillot/FUNSD-Entity-Linking.

📄 PDF Abstract BibTeX arXiv:2112.07443

Code (1)

mavillot/funsd-entity-linking 공식 구현

Tasks

ClassificationDiversityEntity LinkingFormtext-classification Text Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Adam 설명 없음

Residual Connection 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Improving Fine-grained Entity Typing with Entity Linking

2019-09-26 · IJCNLP 2019 11 · Hongliang Dai, Donghong Du, Xin Li, Yangqiu Song

Fine-grained entity typing is a challenging problem since it usually involves a relatively large tag set and may require to understand the context of the entity mention. In this paper, we use entity linking to help with …

Entity Linking Entity Typing TAG

Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linking

2020-03-11 · CONLL 2019 11 · Samuel Broscheit

A typical architecture for end-to-end entity linking systems consists of three steps: mention detection, candidate generation and entity disambiguation. In this study we investigate the following questions: (a) Can all t…

Entity Disambiguation Entity Linking Machine Translation Question Answering+3

On the Temporality of Priors in Entity Linking

2021-01-14 · Renato Stoffalette Joao

Entity linking is a fundamental task in natural language processing which deals with the lexical ambiguity in texts. An important component in entity linking approaches is the mention-to-entity prior probability. Even th…

Entity Linking

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

2021-12-15 · Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong 외

Entity linking faces significant challenges such as prolific variations and prevalent ambiguities, especially in high-value domains with myriad entities. Standard classification approaches suffer from the annotation bott…

Contrastive Learning Entity Linking

SpEL: Structured Prediction for Entity Linking

2023-10-23 · Hassan S. Shavarani, Anoop Sarkar

Entity linking is a prominent thread of research focused on structured data creation by linking spans of text to an ontology or knowledge source. We revisit the use of structured prediction for entity linking which class…

Entity Linking Prediction Structured Prediction