paper-with-me

홈 › Papers

Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark]

2023-04-24 · Alexandros Zeakis, George Papadakis, Dimitrios Skoutas, Manolis Koubarakis

Many recent works on Entity Resolution (ER) leverage Deep Learning techniques involving language models to improve effectiveness. This is applied to both main steps of ER, i.e., blocking and matching. Several pre-trained embeddings have been tested, with the most popular ones being fastText and variants of the BERT model. However, there is no detailed analysis of their pros and cons. To cover this gap, we perform a thorough experimental analysis of 12 popular language models over 17 established benchmark datasets. First, we assess their vectorization overhead for converting all input entities into dense embeddings vectors. Second, we investigate their blocking performance, performing a detailed scalability analysis, and comparing them with the state-of-the-art deep learning-based blocking method. Third, we conclude with their relative performance for both supervised and unsupervised matching. Our experimental results provide novel insights into the strengths and weaknesses of the main language models, facilitating researchers and practitioners to select the most suitable ones in practice.

📄 PDF Abstract BibTeX arXiv:2304.12329

Code (1)

alexZeakis/Embeddings4ER 공식 구현 pytorch

Tasks

BlockingDeep LearningEntity Resolution

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
WordPiece 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Entity-Centric Joint Modeling of Japanese Coreference Resolution and Predicate Argument Structure Analysis

2018-07-01 · ACL 2018 7 · Tomohide Shibata, Sadao Kurohashi

Predicate argument structure analysis is a task of identifying structured events. To improve this field, we need to identify a salient entity, which cannot be identified without performing coreference resolution and pred…

coreference-resolutionCoreference ResolutionReading Comprehension

Lexicon Infused Phrase Embeddings for Named Entity Resolution

2014-04-22 · WS 2014 6 · Alexandre Passos, Vineet Kumar, Andrew McCallum

Most state-of-the-art approaches for named-entity recognition (NER) use semi supervised information in the form of word clusters and lexicons. Recently neural network-based language models have been explored, as they as …

Entity ResolutionFormLearning Word Embeddingsnamed-entity-recognition+4

Robust Coreference Resolution and Entity Linking on Dialogues: Character Identification on TV Show Transcripts

2017-08-01 · CONLL 2017 8 · Henry Y. Chen, Ethan Zhou, Jinho D. Choi

This paper presents a novel approach to character identification, that is an entity linking task that maps mentions to characters in dialogues from TV show transcripts. We first augment and correct several cases of annot…

coreference-resolutionCoreference ResolutionEntity LinkingEntity Resolution+1

Analyzing how BERT performs entity matching

2022-04-01 · Proceedings of the VLDB Endowment 2022 4 · Matteo Paganelli, Francesco Del Buono, Andrea Baraldi, Francesco Guerra

State-of-the-art Entity Matching (EM) approaches rely on transformer architectures, such as BERT, for generating highly contex-tualized embeddings of terms. The embeddings are then used to predict whether pairs of entity…

Entity ResolutionSemantic SimilaritySemantic Textual Similarity

Improving Entity Linking by Modeling Latent Entity Type Information

2020-01-06 · Shuang Chen, Jinpeng Wang, Feng Jiang, Chin-Yew Lin

Existing state of the art neural entity linking models employ attention-based bag-of-words context model and pre-trained entity embeddings bootstrapped from word embeddings to assess topic level context compatibility. Ho…

Entity DisambiguationEntity EmbeddingsEntity LinkingVocal Bursts Type Prediction+1