paper-with-me

Papers

Embarrassingly Simple Text Watermarks

2023-10-13 · Ryoma Sato, Yuki Takezawa, Han Bao, Kenta Niwa, Makoto Yamada

We propose Easymark, a family of embarrassingly simple yet effective watermarks. Text watermarking is becoming increasingly important with the advent of Large Language Models (LLM). LLMs can generate texts that cannot be distinguished from human-written texts. This is a serious problem for the credibility of the text. Easymark is a simple yet effective solution to this problem. Easymark can inject a watermark without changing the meaning of the text at all while a validator can detect if a text was generated from a system that adopted Easymark or not with high credibility. Easymark is extremely easy to implement so that it only requires a few lines of code. Easymark does not require access to LLMs, so it can be implemented on the user-side when the LLM providers do not offer watermarked LLMs. In spite of its simplicity, it achieves higher detection accuracy and BLEU scores than the state-of-the-art text watermarking methods. We also prove the impossibility theorem of perfect watermarking, which is valuable in its own right. This theorem shows that no matter how sophisticated a watermark is, a malicious user could remove it from the text, which motivate us to use a simple watermark such as Easymark. We carry out experiments with LLM-generated texts and confirm that Easymark can be detected reliably without any degradation of BLEU and perplexity, and outperform state-of-the-art watermarks in terms of both quality and reliability.

📄 PDF Abstract BibTeX arXiv:2310.08920

Code (1)

amicus-veritatis/easydemark

Similar Papers 제목 키워드 기반

HeavyWater and SimplexWater: Watermarking Low-Entropy Text Distributions

2025-06-06 · Dor Tsur, Carol Xuan Long, Claudio Mayrink Verdun, Hsiang Hsu 외

Large language model (LLM) watermarks enable authentication of text provenance, curb misuse of machine-generated text, and promote trust in AI systems. Current watermarks operate by changing the next-token predictions ou…

Large Language ModelText Generation

Do It Once: An Embarrassingly Simple Joint Matching Approach to Response Selection

2021-08-01 · Findings (ACL) 2021 8 · Linhao Zhang, Dehong Ma, Sujian Li, Houfeng Wang

Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

2026-07-07 · Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor Ionescu arxiv

Coreset selection aims to identify a small and highly representative subset of a massive dataset for efficient model training. The problem remains challenging even in the few-shot knowledge distillation (KD) setup, where…

Knowledge DistillationImage Classification

A Watermark for Low-entropy and Unbiased Generation in Large Language Models

2024-05-23 · Minjia Mao, Dongjun Wei, Zeyu Chen, Xiao Fang 외

Recent advancements in large language models (LLMs) have highlighted the risk of misusing them, raising the need for accurate detection of LLM-generated content. In response, a viable solution is to inject imperceptible …

Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategy

2026-05-16 · Maria Bulychev, Neil G. Marchant, Benjamin I. P. Rubinstein arxiv

Watermarking combines an imperceptible change to an input image that will trigger a detector, to assert provenance and protect intellectual property. The literature has shown great interest in attacks on watermarking sch…