Domain-Specific Text Embedding Models for Entity Resolution
General-purpose text embedding models are designed to capture semantic similarity but are not optimised for distinguishing entity records that represent the same real-world business or person. This limitation affects applications such as entity resolution and duplicate record retrieval, where small textual differences may either preserve or change identity. This paper investigates whether domain-specific triplet fine-tuning can adapt pretrained embedding models for identity-sensitive retrieval. A synthetic dataset of business and person records was created with identity-preserving variations and challenging non-matching examples. Two widely used embedding models were evaluated before and after fine-tuning using a margin-based similarity evaluation. The results show substantial improvements in separating true matches from highly similar non-matches, demonstrating that domain-specific triplet training can effectively reshape general-purpose embedding spaces for entity retrieval. These findings suggest that targeted fine-tuning provides a practical approach for improving embedding models in data quality management and information retrieval applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalSemantic SimilarityEntity ResolutionSimilar Papers 제목 키워드 기반
KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolution
Entity resolution has been an essential and well-studied task in data cleaning research for decades. Existing work has discussed the feasibility of utilizing pre-trained language models to perform entity resolution and a…
Entity ResolutionGeneral KnowledgeLanguage ModelingLanguage ModellingLabeling without Seeing? Blind Annotation for Privacy-Preserving Entity Resolution
The entity resolution problem requires finding pairs across datasets that belong to different owners but refer to the same entity in the real world. To train and evaluate solutions (either rule-based or machine-learning-…
Dataset GenerationEntity ResolutionPrivacy PreservingEmbeddings for Named Entity Recognition in Geoscience Portuguese Literature
This work focuses on Portuguese Named Entity Recognition (NER) in the Geology domain. The only domain-specific dataset in the Portuguese language annotated for NER is the GeoCorpus. Our approach relies on BiLSTM-CRF neur…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+3Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph Completion
Multi-domain knowledge graph completion (MKGC) aims to improve missing triple prediction in a target KG by transferring knowledge from other support KGs. Existing methods typically enforce consistency constraints on equi…
Knowledge Graph CompletionOpenEL: An Annotated Corpus for Entity Linking and Discourse in Open Domain Dialogue
Entity linking in dialogue is the task of mapping entity mentions in utterances to a target knowledge base. Prior work on entity linking has mainly focused on well-written articles such as Wikipedia, annotated newswire, …
Articlescoreference-resolutionCoreference ResolutionEntity Linking