paper-with-me

홈 › Papers

Automatic Design of Semantic Similarity Ensembles Using Grammatical Evolution

2023-07-03 · Jorge Martinez-Gil

Semantic similarity measures are widely used in natural language processing to catalyze various computer-related tasks. However, no single semantic similarity measure is the most appropriate for all tasks, and researchers often use ensemble strategies to ensure performance. This research work proposes a method for automatically designing semantic similarity ensembles. In fact, our proposed method uses grammatical evolution, for the first time, to automatically select and aggregate measures from a pool of candidates to create an ensemble that maximizes correlation to human judgment. The method is evaluated on several benchmark datasets and compared to state-of-the-art ensembles, showing that it can significantly improve similarity assessment accuracy and outperform existing methods in some cases. As a result, our research demonstrates the potential of using grammatical evolution to automatically compare text and prove the benefits of using ensembles for semantic similarity tasks. The source code that illustrates our approach can be downloaded from https://github.com/jorge-martinez-gil/sesige.

📄 PDF Abstract BibTeX arXiv:2307.00925

Code (1)

jorge-martinez-gil/sesige 공식 구현

Tasks

Semantic SimilaritySemantic Textual Similarity

Similar Papers 제목 키워드 기반

Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change

2022-04-12 · LChange (ACL) 2022 5 · Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova

Morphological and syntactic changes in word usage (as captured, e.g., by grammatical profiles) have been shown to be good predictors of a word's meaning change. In this work, we explore whether large pre-trained contextu…

Change DetectionLanguage ModelingLanguage ModellingXLM-R

Reference-less Measure of Faithfulness for Grammatical Error Correction

2018-04-11 · NAACL 2018 6 · Leshem Choshen, Omri Abend

We propose USim, a semantic measure for Grammatical Error Correction (GEC) that measures the semantic faithfulness of the output to the source, thereby complementing existing reference-less measures (RLMs) for measuring …

Grammatical Error Correctionvalid

DSS: Text Similarity Using Lexical Alignments of Form, Distributional Semantics and Grammatical Relations

2012-06-01 · SEMEVAL 2012 6 · Diana McCarthy, Spandana Gella, Siva Reddy
FormSentenceSTStext similarity

RoMe: A Robust Metric for Evaluating Natural Language Generation

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Evaluating Natural Language Generation (NLG) systems is a challenging task. Firstly, the metric should ensure that the generated hypothesis reflects the reference's semantics. Secondly, it should consider the grammatical…

Natural Language UnderstandingSemantic SimilaritySemantic Textual SimilaritySentence+1

RoMe: A Robust Metric for Evaluating Natural Language Generation

2022-03-17 · ACL 2022 5 · Md Rashad Al Hasan Rony, Liubov Kovriguina, Debanjan Chaudhuri, Ricardo Usbeck 외

Evaluating Natural Language Generation (NLG) systems is a challenging task. Firstly, the metric should ensure that the generated hypothesis reflects the reference's semantics. Secondly, it should consider the grammatical…

Natural Language UnderstandingSemantic SimilaritySemantic Textual SimilaritySentence+1