paper-with-me

Papers

$k$NNProxy: Efficient Training-Free Proxy Alignment for Black-Box Zero-Shot LLM-Generated Text Detection

2026-04-02 · Kahim Wong, Kemou Li, Haiwei Wu, Jiantao Zhou arxiv

LLM-generated text (LGT) detection is essential for reliable forensic analysis and for mitigating LLM misuse. Existing LGT detectors can generally be categorized into two broad classes: learning-based approaches and zero-shot methods. Compared with learning-based detectors, zero-shot methods are particularly promising because they eliminate the need to train task-specific classifiers. However, the reliability of zero-shot methods fundamentally relies on the assumption that an off-the-shelf proxy LLM is well aligned with the often unknown source LLM, a premise that rarely holds in real-world black-box scenarios. To address this discrepancy, existing proxy alignment methods typically rely on supervised fine-tuning of the proxy or repeated interactions with commercial APIs, thereby increasing deployment costs, exposing detectors to silent API changes, and limiting robustness under domain shift. Motivated by these limitations, we propose the $k$-nearest neighbor proxy ($k$NNProxy), a training-free and query-efficient proxy alignment framework that repurposes the $k$NN language model ($k$NN-LM) retrieval mechanism as a domain adapter for a fixed proxy LLM. Specifically, a lightweight datastore is constructed once from a target-reflective LGT corpus, either via fixed-budget querying or from existing datasets. During inference, nearest-neighbor evidence induces a token-level predictive distribution that is interpolated with the proxy output, yielding an aligned prediction without proxy fine-tuning or per-token API outputs. To improve robustness under domain shift, we extend $k$NNProxy into a mixture of proxies (MoP) that routes each input to a domain-specific datastore for domain-consistent retrieval. Extensive experiments demonstrate strong detection performance of our method.

📄 PDF Abstract BibTeX arXiv:2604.02008

Code (0)

등록된 구현이 없습니다.

Tasks

Text Detection

Similar Papers 제목 키워드 기반

Robust Guided Diffusion for Offline Black-Box Optimization

2024-10-01 · Can Sam Chen, Christopher Beckham, Zixuan Liu, Xue Liu 외

Offline black-box optimization aims to maximize a black-box function using an offline dataset of designs and their measured properties. Two main approaches have emerged: the forward approach, which learns a mapping from …

Rethinking the Role of Proxy Rewards in Language Model Alignment

2024-02-02 · Sungdong Kim, Minjoon Seo

Learning from human feedback via proxy reward modeling has been studied to align Large Language Models (LLMs) with human values. However, achieving reliable training through that proxy reward model (RM) is not a trivial …

Language ModelingLanguage ModellingReinforcement Learning (RL)

Exploring Effective Data for Surrogate Training Towards Black-Box Attack

2022-01-01 · CVPR 2022 1 · Xuxiang Sun, Gong Cheng, Hongda Li, Lei Pei 외

Without access to the training data where a black-box victim model is deployed, training a surrogate model for black-box adversarial attack is still a struggle. In terms of data, we mainly identify three key measures…

Adversarial AttackDiversity

Know2Vec: A Black-Box Proxy for Neural Network Retrieval

2024-12-20 · Zhuoyi Shang, Yanwei Liu, Jinxia Liu, Xiaoyan Gu 외

For general users, training a neural network from scratch is usually challenging and labor-intensive. Fortunately, neural network zoos enable them to find a well-performing model for directly use or fine-tuning it in the…

Model SelectionRetrieval

CPT: Consistent Proxy Tuning for Black-box Optimization

2024-07-01 · Yuanyang He, Zitong Huang, Xinxing Xu, Rick Siow Mong Goh 외

Black-box tuning has attracted recent attention due to that the structure or inner parameters of advanced proprietary models are not accessible. Proxy-tuning provides a test-time output adjustment for tuning black-box la…