paper-with-me

홈 › Papers

A Linguistics-Aware LLM Watermarking via Syntactic Predictability

2025-10-10 · Shinwoo Park, Hyejin Park, Hyeseon An, Yo-Sub Han arxiv

As large language models (LLMs) continue to advance rapidly, reliable governance tools have become critical. Publicly verifiable watermarking is particularly essential for fostering a trustworthy AI ecosystem. A central challenge persists: balancing text quality against detection robustness. Recent studies have sought to navigate this trade-off by leveraging signals from model output distributions (e.g., token-level entropy); however, their reliance on these model-specific signals presents a significant barrier to public verification, as the detection process requires access to the logits of the underlying model. We introduce STELA, a novel framework that aligns watermark strength with the linguistic degrees of freedom inherent in language. STELA dynamically modulates the signal using part-of-speech (POS) n-gram-modeled linguistic indeterminacy, weakening it in grammatically constrained contexts to preserve quality and strengthening it in contexts with greater linguistic flexibility to enhance detectability. Our detector operates without access to any model logits, thus facilitating publicly verifiable detection. Through extensive experiments on typologically diverse languages-analytic English, isolating Chinese, and agglutinative Korean-we show that STELA surpasses prior methods in detection robustness. Our code is available at https://github.com/Shinwoo-Park/stela_watermark.

📄 PDF Abstract BibTeX arXiv:2510.13829

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities

2022-10-21 · Suhas Arehalli, Brian Dillon, Tal Linzen

Humans exhibit garden path effects: When reading sentences that are temporarily structurally ambiguous, they slow down when the structure is disambiguated in favor of the less preferred alternative. Surprisal theory (Hal…

Language Modelling

Toward Stronger Code Watermarking: A Grammar-Driven Approach to Optimizing the Trade-off Between Quality and Detectability

2026-07-11 · Licheng Yu, Aiwei Liu, Songze Li arxiv

With the rapid development of Large Language Models (LLMs), text watermarking has emerged as a crucial technique for identifying machine-generated content. However, directly applying existing logits-based watermarking me…

Code Generation

Emergent Word Order Universals from Cognitively-Motivated Language Models

2024-02-19 · Tatsuki Kuribayashi, Ryo Ueda, Ryo Yoshida, Yohei Oseki 외

The world's languages exhibit certain so-called typological or implicational universals; for example, Subject-Object-Verb (SOV) languages typically use postpositions. Explaining the source of such biases is a key goal of…

Discourse Context Predictability Effects in Hindi Word Order

2022-10-25 · Sidharth Ranjan, Marten Van Schijndel, Sumeet Agarwal, Rajakrishnan Rajkumar

We test the hypothesis that discourse predictability influences Hindi syntactic choice. While prior work has shown that a number of factors (e.g., information status, dependency length, and syntactic surprisal) influence…

Sentence

LIMIT-BERT : Linguistics Informed Multi-Task BERT

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Junru Zhou, Zhuosheng Zhang, Hai Zhao, Shuailiang Zhang

In this paper, we present Linguistics Informed Multi-Task BERT (LIMIT-BERT) for learning language representations across multiple linguistics tasks by Multi-Task Learning. LIMIT-BERT includes five key linguistics tasks: …

Language ModelingLanguage ModellingMulti-Task LearningPOS+2