paper-with-me

홈 › Papers

Unsupervised Style Representation Learning for AI-Text Detection via Paraphrase Inversion

2026-06-08 · Rafael Rivera Soto, Barry Chen, Nicholas Andrews arxiv

The rapid development of large language models (LLMs) has raised concerns about misuse such as plagiarism, misinformation, and automated influence operations, motivating the need for robust detectors. Recent work has shown that neural representations of writing style are effective for detection and, crucially, robust to adversarial attacks that defeat most existing detectors. However, current style-based detectors rely on authorship labels for training, and are limited to few-shot inference for detection, requiring in-distribution samples that may not always be available. We learn discriminative style features without authorship labels by training a style encoder to reconstruct human-authored text from its machine-generated paraphrase; freezing a semantic encoder during training biases the style encoder to capture only the non-semantic features needed for reconstruction. We evaluate the learned representations via two detection strategies: a few-shot detector and a zero-shot DeepSVDD-based detector. Across benchmarks, our method matches or outperforms all baselines in the few-shot setting and, in the zero-shot regime, is competitive with fully supervised classifiers on in-distribution test data while generalizing better to unseen LLMs. Beyond detection, the learned representations generalize to unseen tasks, achieving competitive performance on authorship verification and fine-grained style discrimination despite never being trained on either objective.

📄 PDF Abstract BibTeX arXiv:2606.10099

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningText Detection

Similar Papers 제목 키워드 기반

Reformulating Unsupervised Style Transfer as Paraphrase Generation

2020-10-12 · EMNLP 2020 11 · Kalpesh Krishna, John Wieting, Mohit Iyyer

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their…

AttributeParaphrase GenerationSentenceStyle Transfer

ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer

2023-08-29 · Zachary Horvitz, Ajay Patel, Chris Callison-Burch, Zhou Yu 외

Textual style transfer is the task of transforming stylistic properties of text while preserving meaning. Target "styles" can be defined in numerous ways, ranging from single attributes (e.g, formality) to authorship (e.…

Style Transfer

Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation

2021-09-03 · Findings (EMNLP) 2021 11 · Haoran Yang, Wai Lam, Piji Li

Exemplar-Guided Paraphrase Generation (EGPG) aims to generate a target sentence which conforms to the style of the given exemplar while encapsulating the content information of the source sentence. In this paper, we prop…

Contrastive LearningDecoderParaphrase GenerationPOS+3

UNSUPERVISED SENTENCE EMBEDDING USING DOCUMENT STRUCTURE-BASED CONTEXT

2018-01-01 · ICLR 2018 1 · Taesung Lee, Youngja Park

We present a new unsupervised method for learning general-purpose sentence embeddings. Unlike existing methods which rely on local contexts, such as words inside the sentence or immediately neighboring sentences, our met…

coreference-resolutionCoreference ResolutionSentenceSentence Embedding+2

Text Detoxification using Large Pre-trained Neural Models

2021-09-18 · EMNLP 2021 11 · David Dale, Anton Voronov, Daryna Dementieva, Varvara Logacheva 외

We present two novel unsupervised methods for eliminating toxicity in text. Our first method combines two recent ideas: (1) guidance of the generation process with small style-conditional language models and (2) use of p…

Style Transfer