paper-with-me

홈 › Papers

A novel hybrid methodology of measuring sentence similarity

2021-05-03 · Yongmin Yoo, Tak-Sung Heo, Yeongjoon Park, Kyungsun Kim

The problem of measuring sentence similarity is an essential issue in the natural language processing (NLP) area. It is necessary to measure the similarity between sentences accurately. There are many approaches to measuring sentence similarity. Deep learning methodology shows a state-of-the-art performance in many natural language processing fields and is used a lot in sentence similarity measurement methods. However, in the natural language processing field, considering the structure of the sentence or the word structure that makes up the sentence is also important. In this study, we propose a methodology combined with both deep learning methodology and a method considering lexical relationships. Our evaluation metric is the Pearson correlation coefficient and Spearman correlation coefficient. As a result, the proposed method outperforms the current approaches on a KorSTS standard benchmark Korean dataset. Moreover, it performs a maximum of 65% increase than only using deep learning methodology. Experiments show that our proposed method generally results in better performance than those with only a deep learning model.

📄 PDF Abstract BibTeX arXiv:2105.00648

Code (1)

HeoTaksung/A-Novel-Hybrid-Methodology-of-Measuring-Sentence-Similarity 공식 구현 tf

Tasks

Deep LearningSentenceSentence Similarity

Similar Papers 제목 키워드 기반

Measuring Sentences Similarity: A Survey

2019-10-06 · Mamdouh Farouk

This study is to review the approaches used for measuring sentences similarity. Measuring similarity between natural language sentences is a crucial task for many Natural Language Processing applications such as text cla…

Information RetrievalQuestion AnsweringRetrievalSurvey+2

Sinhala Short Sentence Similarity Calculation using Corpus-Based and Knowledge-Based Similarity Measures

2016-12-01 · WS 2016 12 · Jcs Kadupitiya, Surangika Ranathunga, Gihan Dias

Currently, corpus based-similarity, string-based similarity, and knowledge-based similarity techniques are used to compare short phrases. However, no work has been conducted on the similarity of phrases in Sinhala langua…

Semantic SimilaritySemantic Textual SimilaritySentenceSentence Similarity+1

Evaluating Multimodal Representations on Sentence Similarity: vSTS, Visual Semantic Textual Similarity Dataset

2018-09-11 · Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre

In this paper we introduce vSTS, a new dataset for measuring textual similarity of sentences using multimodal information. The dataset is comprised by images along with its respectively textual captions. We describe the …

Semantic Textual SimilaritySentenceSentence Similarityvalid

Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures

2020-10-21 · H. Bai, L. Tan, K. Xiong, M. Li 외

Measuring sentence semantic similarity using pre-trained language models such as BERT generally yields unsatisfactory zero-shot performance, and one main reason is ineffective token aggregation methods such as mean pooli…

Semantic SimilaritySemantic Textual SimilaritySentenceSTS+1

Ferryman at SemEval-2020 Task 3: Bert with TFIDF-Weighting for Predicting the Effect of Context in Word Similarity

2020-12-01 · SEMEVAL 2020 · Weilong Chen, Xin Yuan, Sai Zhang, Jiehui Wu 외

Word similarity is widely used in machine learning applications like searching engine and recommendation. Measuring the changing meaning of the same word between two different sentences is not only a way to handle comple…

PositionSentenceWord Similarity