Paraphrase Identification with Deep Learning: A Review of Datasets and Methods
The rapid progress of Natural Language Processing (NLP) technologies has led to the widespread availability and effectiveness of text generation tools such as ChatGPT and Claude. While highly useful, these technologies also pose significant risks to the credibility of various media forms if they are employed for paraphrased plagiarism -- one of the most subtle forms of content misuse in scientific literature and general text media. Although automated methods for paraphrase identification have been developed, detecting this type of plagiarism remains challenging due to the inconsistent nature of the datasets used to train these methods. In this article, we examine traditional and contemporary approaches to paraphrase identification, investigating how the under-representation of certain paraphrase types in popular datasets, including those used to train Large Language Models (LLMs), affects the ability to detect plagiarism. We introduce and validate a new refined typology for paraphrases (ReParaphrased, REfined PARAPHRASE typology definitions) to better understand the disparities in paraphrase type representation. Lastly, we propose new directions for future research and dataset development to enhance AI-based paraphrase detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Paraphrase IdentificationText GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Large-scale Paraphrase Acquisition and Generation
This paper addresses the quality issues in existing Twitter-based paraphrase datasets, and discusses the necessity of using two separate definitions of paraphrase for identification and generation tasks. We present a new…
Language ModelingLanguage ModellingParaphrase GenerationParaphrase Identification+1RuPAWS: A Russian Adversarial Dataset for Paraphrase Identification
Paraphrase identification task can be easily challenged by changing word order, e.g. as in “Can a good person become bad?”. While for English this problem was tackled by the PAWS dataset (Zhang et al., 2019), datasets fo…
Paraphrase IdentificationPARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge
We present a new benchmark dataset called PARADE for paraphrase identification that requires specialized domain knowledge. PARADE contains paraphrases that overlap very little at the lexical and syntactic level but are s…
Paraphrase IdentificationPredicate-Argument Based Bi-Encoder for Paraphrase Identification
Paraphrase identification involves identifying whether a pair of sentences express the same or similar meanings. While cross-encoders have achieved high performances across several benchmarks, bi-encoders such as SBERT h…
Paraphrase IdentificationSentencePredicate-Argument Based Bi-Encoder for Paraphrase Identification
Paraphrase identification involves identifying whether a pair of sentences express the same or similar meanings. While cross-encoders have achieved high performances across several benchmarks, bi-encoders such as SBERT h…
Paraphrase IdentificationSentence