paper-with-me

홈 › Papers

Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated

2024-06-26 · Jiazhou Ji, Ruizhe Li, Shujun Li, Jie Guo, Weidong Qiu, Zheng Huang, Chiyu Chen, Xiaoyu Jiang, Xinru Lu

As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of both machines and humans. In this paper, we challenge the current practice of considering LLM-generated text detection a binary classification task of differentiating human from AI. Instead, we introduce a novel ternary text classification scheme, adding an "undecided" category for texts that could be attributed to either source, and we show that this new category is crucial to understand how to make the detection result more explainable to lay users. This research shifts the paradigm from merely classifying to explaining machine-generated texts, emphasizing need for detectors to provide clear and understandable explanations to users. Our study involves creating four new datasets comprised of texts from various LLMs and human authors. Based on new datasets, we performed binary classification tests to ascertain the most effective SOTA detection methods and identified SOTA LLMs capable of producing harder-to-detect texts. We constructed a new dataset of texts generated by two top-performing LLMs and human authors, and asked three human annotators to produce ternary labels with explanation notes. This dataset was used to investigate how three top-performing SOTA detectors behave in new ternary classification context. Our results highlight why "undecided" category is much needed from the viewpoint of explainability. Additionally, we conducted an analysis of explainability of the three best-performing detectors and the explanation notes of the human annotators, revealing insights about the complexity of explainable detection of machine-generated texts. Finally, we propose guidelines for developing future detection systems with improved explanatory power.

📄 PDF Abstract BibTeX arXiv:2406.18259

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationLLM-generated Text Detectiontext-classificationText ClassificationText Detection

Similar Papers 제목 키워드 기반

Exploring the Limitations of Detecting Machine-Generated Text

2024-06-16 · Jad Doughman, Osama Mohammed Afzal, Hawau Olamide Toyin, Shady Shehata 외

Recent improvements in the quality of the generations by large language models have spurred research into identifying machine-generated text. Such work often presents high-performing detectors. However, humans and machin…

Text Detection

Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifs

2024-02-16 · Zae Myung Kim, Kwang Hee Lee, Preston Zhu, Vipul Raheja 외

With the advent of large language models (LLM), the line between human-crafted and machine-generated texts has become increasingly blurred. This paper delves into the inquiry of identifying discernible and unique linguis…

Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection

2024-12-11 · Jiaqi Chen, Xiaoye Zhu, Tianyang Liu, Ying Chen 외

Large Language Models (LLMs) have revolutionized text generation, making detecting machine-generated text increasingly challenging. Although past methods have achieved good performance on detecting pure machine-generated…

Text DetectionText Generation

Detecting Machine-Generated Long-Form Content with Latent-Space Variables

2024-10-04 · Yufei Tian, Zeyu Pan, Nanyun Peng

The increasing capability of large language models (LLMs) to generate fluent long-form texts is presenting new challenges in distinguishing machine-generated outputs from human-written ones, which is crucial for ensuring…

Form

GigaCheck: Detecting LLM-generated Content

2024-10-31 · Irina Tolstykh, Aleksandra Tsybina, Sergey Yakubson, Aleksandr Gordeev 외

With the increasing quality and spread of LLM-based assistants, the amount of LLM-generated content is growing rapidly. In many cases and tasks, such texts are already indistinguishable from those written by humans, and …

Binary text classificationBoundary DetectionLLM-generated Text DetectionText Classification+1