Speculating LLMs' Chinese Training Data Pollution from Their Tokens
Tokens are basic elements in the datasets for LLM training. It is well-known that many tokens representing Chinese phrases in the vocabulary of GPT (4o/4o-mini/o1/o3/4.5/4.1/o4-mini) are indicating contents like pornography or online gambling. Based on this observation, our goal is to locate Polluted Chinese (PoC) tokens in LLMs and study the relationship between PoC tokens' existence and training data. (1) We give a formal definition and taxonomy of PoC tokens based on the GPT's vocabulary. (2) We build a PoC token detector via fine-tuning an LLM to label PoC tokens in vocabularies by considering each token's both semantics and related contents from the search engines. (3) We study the speculation on the training data pollution via PoC tokens' appearances (token ID). Experiments on GPT and other 23 LLMs indicate that tokens widely exist while GPT's vocabulary behaves the worst: more than 23% long Chinese tokens (i.e., a token with more than two Chinese characters) are either porn or online gambling. We validate the accuracy of our speculation method on famous pre-training datasets like C4 and Pile. Then, considering GPT-4o, we speculate that the ratio of "Yui Hatano" related webpages in GPT-4o's training data is around 0.5%.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Auditing Chinese Web-scale Corpora via Sampled BPE Token Statistics
Chinese web pollution has surfaced in LLMs, motivating audits of upstream Chinese corpora. However, auditing such corpora faces three challenges: (1) their web-scale size makes full scan costly; (2) prior analyses are of…
Are Chinese transport policies effective? A new perspective from direct pollution rebound effect, and empirical evidence from road transport sector
The air pollution has become a serious challenge in China. Emissions from motor vehicles have been found as one main source of air pollution. Although the Chinese government has taken numerous policies to mitigate the ha…
Time SeriesTime Series AnalysisCan ESG Investment and the Implementation of the New Environmental Protection Law Enhance Public Subjective Well-being?
Air pollution has emerged as a serious challenge for China, posing a threat to public health and hindering the progress of sustainable economic development. In response to air pollution and other environmental issues, th…
On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs
Evidence-enhanced detectors present remarkable abilities in identifying malicious social text with related evidence. However, the rise of large language models (LLMs) brings potential risks of evidence pollution to confu…
Mixture-of-ExpertsText DetectionMIRAGE: Defending Long-Form RAG Against Misinformation Pollution
Retrieval-Augmented Generation (RAG) improves factuality by grounding LLMs in external evidence, but real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading fr…