paper-with-me

Papers

DeezyMatch: A Flexible Deep Learning Approach to Fuzzy String Matching

2020-10-01 · EMNLP 2020 11 · Kasra Hosseini, Federico Nanni, Mariona Coll Ardanuy

We present DeezyMatch, a free, open-source software library written in Python for fuzzy string matching and candidate ranking. Its pair classifier supports various deep neural network architectures for training new classifiers and for fine-tuning a pretrained model, which paves the way for transfer learning in fuzzy string matching. This approach is especially useful where only limited training examples are available. The learned DeezyMatch models can be used to generate rich vector representations from string inputs. The candidate ranker component in DeezyMatch uses these vector representations to find, for a given query, the best matching candidates in a knowledge base. It uses an adaptive searching algorithm applicable to large knowledge bases and query sets. We describe DeezyMatch{'}s functionality, design and implementation, accompanied by a use case in toponym matching and candidate ranking in realistic noisy datasets.

📄 PDF Abstract BibTeX

Code (1)

Living-with-machines/DeezyMatch 공식 구현 pytorch

Tasks

Deep LearningTransfer Learning

Similar Papers 제목 키워드 기반

Fuzzy Segmentations of a String

2022-01-31 · Armen Kostanyan, Arevik Harmandayan

This article discusses a particular case of the data clustering problem, where it is necessary to find groups of adjacent text segments of the appropriate length that match a fuzzy pattern represented as a sequence of fu…

ClusteringSegmentationText Segmentation

Leveraging Large Language Models for Fuzzy String Matching in Political Science

2024-03-27 · Yu Wang

Fuzzy string matching remains a key issue when political scientists combine data from different sources. Existing matching methods invariably rely on string distances, such as Levenshtein distance and cosine similarity. …

Fuzzy Substring Matching: On-device Fuzzy Friend Search at Snapchat

2022-11-04 · Vasyl Pihur, Scott Thompson

About 50% of all queries on Snapchat app are targeted at finding the right friend to interact with. Since everyone has a unique list of friends and that list is not very large (maximum a few thousand), it makes sense to …

Retrieval

Novel Keyword Extraction and Language Detection Approaches

2020-09-24 · Malgorzata Pikies, Andronicus Riyono, Junade Ali

Fuzzy string matching and language classification are important tools in Natural Language Processing pipelines, this paper provides advances in both areas. We propose a fast novel approach to string tokenisation for fuzz…

ClassificationGeneral ClassificationKeyword Extraction

Parallel Corpus Filtering Based on Fuzzy String Matching

2019-08-01 · WS 2019 8 · Sukanta Sen, Asif Ekbal, Pushpak Bhattacharyya

In this paper, we describe the IIT Patna{'}s submission to WMT 2019 shared task on parallel corpus filtering. This shared task asks the participants to develop methods for scoring each parallel sentence from a given nois…

NMTSentence