paper-with-me

홈 › Papers

Paraphrase Detection: Human vs. Machine Content

2023-03-24 · Jonas Becker, Jan Philip Wahle, Terry Ruas, Bela Gipp

The growing prominence of large language models, such as GPT-4 and ChatGPT, has led to increased concerns over academic integrity due to the potential for machine-generated content and paraphrasing. Although studies have explored the detection of human- and machine-paraphrased content, the comparison between these types of content remains underexplored. In this paper, we conduct a comprehensive analysis of various datasets commonly employed for paraphrase detection tasks and evaluate an array of detection methods. Our findings highlight the strengths and limitations of different detection methods in terms of performance on individual datasets, revealing a lack of suitable machine-generated datasets that can be aligned with human expectations. Our main finding is that human-authored paraphrases exceed machine-generated ones in terms of difficulty, diversity, and similarity implying that automatically generated texts are not yet on par with human-level performance. Transformers emerged as the most effective method across datasets with TF-IDF excelling on semantically diverse corpora. Additionally, we identify four datasets as the most diverse and challenging for paraphrase detection.

📄 PDF Abstract BibTeX arXiv:2303.13989

Code (1)

jonas-becker/pd-human-vs-machine-content 공식 구현 pytorch

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

How Large Language Models are Transforming Machine-Paraphrased Plagiarism

2022-10-07 · Jan Philip Wahle, Terry Ruas, Frederic Kirstein, Bela Gipp

The recent success of large language models for text generation poses a severe threat to academic integrity, as plagiarists can generate realistic paraphrases indistinguishable from original work. However, the role of la…

ArticlesParaphrase GenerationText Generation

A Paraphrase and Semantic Similarity Detection System for User Generated Short-Text Content on Microblogs

2016-12-01 · COLING 2016 12 · Kuntal Dey, Ritvik Shrivastava, Saroj Kaushik

Existing systems deliver high accuracy and F1-scores for detecting paraphrase and semantic similarity on traditional clean-text corpus. For instance, on the clean-text Microsoft Paraphrase benchmark database, the existin…

Semantic SimilaritySemantic Textual Similarity

RADAR: Robust AI-Text Detection via Adversarial Learning

2023-07-07 · NeurIPS 2023 11

Recent advances in large language models (LLMs) and the intensifying popularity of ChatGPT-like applications have blurred the boundary of high-quality text generation between humans and machines. However, in addition to …

FairnessText DetectionText Generation

Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detection

2024-11-06 · Hiu Ting Lau, Arkaitz Zubiaga

Natural Language Generation has been rapidly developing with the advent of large language models (LLMs). While their usage has sparked significant attention from the general public, it is important for readers to be awar…

LLM-generated Text DetectionText DetectionText Generation

Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection

2021-03-23 · Jan Philip Wahle, Terry Ruas, Norman Meuschke, Bela Gipp

The rise of language models such as BERT allows for high-quality text paraphrasing. This is a problem to academic integrity, as it is difficult to differentiate between original and machine-generated content. We propose …

Articles