paper-with-me

홈 › Papers

KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolution

2023-01-12 · Liri Fang, Lan Li, Yiren Liu, Vetle I. Torvik, Bertram Ludäscher

Entity resolution has been an essential and well-studied task in data cleaning research for decades. Existing work has discussed the feasibility of utilizing pre-trained language models to perform entity resolution and achieved promising results. However, few works have discussed injecting domain knowledge to improve the performance of pre-trained language models on entity resolution tasks. In this study, we propose Knowledge Augmented Entity Resolution (KAER), a novel framework named for augmenting pre-trained language models with external knowledge for entity resolution. We discuss the results of utilizing different knowledge augmentation and prompting methods to improve entity resolution performance. Our model improves on Ditto, the existing state-of-the-art entity resolution method. In particular, 1) KAER performs more robustly and achieves better results on "dirty data", and 2) with more general knowledge injection, KAER outperforms the existing baseline models on the textual dataset and dataset from the online product domain. 3) KAER achieves competitive results on highly domain-specific datasets, such as citation datasets, requiring the injection of expert knowledge in future work.

📄 PDF Abstract BibTeX arXiv:2301.04770

Code (0)

등록된 구현이 없습니다.

Tasks

Entity ResolutionGeneral KnowledgeLanguage ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

T-KAER: Transparency-enhanced Knowledge-Augmented Entity Resolution Framework

2024-09-30 · Lan Li, Liri Fang, Yiren Liu, Vetle I. Torvik 외

Entity resolution (ER) is the process of determining whether two representations refer to the same real-world entity and plays a crucial role in data curation and data cleaning. Recent studies have introduced the KAER fr…

Entity Resolution

Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

2019-04-09 · NAACL 2019 6 · Angli Liu, Jingfei Du, Veselin Stoyanov

Traditional language models are unable to efficiently model entity names observed in text. All but the most popular named entities appear infrequently in text providing insufficient context. Recent efforts have recognize…

Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+3

Automated Construction of a Knowledge Graph of Nuclear Fusion Energy for Effective Elicitation and Retrieval of Information

2025-04-10 · A. Loreti, K. Chen, R. George, R. Firth 외

In this document, we discuss a multi-step approach to automated construction of a knowledge graph, for structuring and representing domain-specific knowledge from large document corpora. We apply our method to build the …

Entity Resolutionnamed-entity-recognitionNamed Entity RecognitionNatural Language Queries+1

A Unified Knowledge Graph Augmentation Service for Boosting Domain-specific NLP Tasks

2022-12-10 · Ruiqing Ding, Xiao Han, Leye Wang

By focusing the pre-training process on domain-specific corpora, some domain-specific pre-trained language models (PLMs) have achieved state-of-the-art results. However, it is under-investigated to design a unified parad…

Knowledge GraphsLanguage ModelingLanguage Modellingtext-classification+1

DEEP: DEnoising Entity Pre-training for Neural Machine Translation

2022-01-16 · ACL ARR January 2022 1 · Anonymous

It has been shown that machine translation models usually generate poor translations for named entities that are infrequent in the training corpus. Earlier named entity translation methods mainly focus on phonetic transl…

DenoisingMachine TranslationMulti-Task LearningSentence+2