paper-with-me

홈 › Papers

STADEE: STAtistics-based DEEp Detection of Machine Generated Text

2023-12-04 · Zheng Chen, Huming Liu

We present STADEE, a \textbf{STA}tistics-based \textbf{DEE}p detection method to identify machine-generated text, addressing the limitations of current methods that rely heavily on fine-tuning pre-trained language models (PLMs). STADEE integrates key statistical text features with a deep classifier, focusing on aspects like token probability and cumulative probability, crucial for handling nucleus sampling. Tested across diverse datasets and scenarios (in-domain, out-of-domain, and in-the-wild), STADEE demonstrates superior performance, achieving an 87.05% F1 score in-domain and outperforming both traditional statistical methods and fine-tuned PLMs, especially in out-of-domain and in-the-wild settings, highlighting its effectiveness and generalizability.

📄 PDF Abstract BibTeX arXiv:2312.01672

Code (1)

hmgithub111/stadee 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Applying Ensemble Methods to Model-Agnostic Machine-Generated Text Detection

2024-06-18 · Ivan Ong, Boon King Quek

In this paper, we study the problem of detecting machine-generated text when the large language model (LLM) it is possibly derived from is unknown. We do so by apply ensembling methods to the outputs from DetectGPT class…

Language ModelingLanguage ModellingLarge Language ModelText Detection

Training-free LLM-generated Text Detection by Mining Token Probability Sequences

2024-10-08 · Yihuai Xu, Yongwei Wang, Yifei Bi, Huangsen Cao 외

Large language models (LLMs) have demonstrated remarkable capabilities in generating high-quality texts across diverse domains. However, the potential misuse of LLMs has raised significant concerns, underscoring the urge…

LLM-generated Text DetectionText DetectionTime Series Analysis

When AI Settles Down: Late-Stage Stability as a Signature of AI-Generated Text Detection

2026-01-08 · Ke Sun, Guangsheng Bao, Han Cui, Yue Zhang arxiv

Zero-shot detection methods for AI-generated text typically aggregate token-level statistics across entire sequences, overlooking the temporal dynamics inherent to autoregressive generation. We analyze over 120k text sam…

Text Detection

Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection

2026-05-15 · Chenwang Wu, Yiuming Cheung, Bo Han, Shuhai Zhang 외 arxiv

Machine-generated texts (MGTs) pose risks such as disinformation and phishing, underscoring the need for reliable detection. Metric-based methods, which extract statistically distinguishable features of MGTs, are often m…

Text Detection

SemEval-2024 Task 8: Weighted Layer Averaging RoBERTa for Black-Box Machine-Generated Text Detection

2024-02-24 · Ayan Datta, Aryan Chandramania, Radhika Mamidi

This document contains the details of the authors' submission to the proceedings of SemEval 2024's Task 8: Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection Subtask A (monolingual) …

Text Detection