paper-with-me

홈 › Papers

Truthful Text Sanitization Guided by Inference Attacks

2024-12-17 · Ildikó Pilán, Benet Manzanares-Salor, David Sánchez, Pierre Lison

The purpose of text sanitization is to rewrite those text spans in a document that may directly or indirectly identify an individual, to ensure they no longer disclose personal information. Text sanitization must strike a balance between preventing the leakage of personal information (privacy protection) while also retaining as much of the document's original content as possible (utility preservation). We present an automated text sanitization strategy based on generalizations, which are more abstract (but still informative) terms that subsume the semantic content of the original text spans. The approach relies on instruction-tuned large language models (LLMs) and is divided into two stages. The LLM is first applied to obtain truth-preserving replacement candidates and rank them according to their abstraction level. Those candidates are then evaluated for their ability to protect privacy by conducting inference attacks with the LLM. Finally, the system selects the most informative replacement shown to be resistant to those attacks. As a consequence of this two-stage process, the chosen replacements effectively balance utility and privacy. We also present novel metrics to automatically evaluate these two aspects without the need to manually annotate data. Empirical results on the Text Anonymization Benchmark show that the proposed approach leads to enhanced utility, with only a marginal increase in the risk of re-identifying protected individuals compared to fully suppressing the original information. Furthermore, the selected replacements are shown to be more truth-preserving and abstractive than previous methods.

📄 PDF Abstract BibTeX arXiv:2412.12928

Code (0)

등록된 구현이 없습니다.

Tasks

Text Anonymization

Similar Papers 제목 키워드 기반

Differential Privacy for Text Analytics via Natural Text Sanitization

2021-06-02 · Findings (ACL) 2021 8 · Xiang Yue, Minxin Du, Tianhao Wang, Yaliang Li 외

Texts convey sophisticated knowledge. However, texts also convey sensitive information. Despite the success of general-purpose language models and domain-specific mechanisms with differential privacy (DP), existing text …

Language ModelingLanguage ModellingPrivacy Preserving

PromptGraph: Graph-Guided Prompt Sanitization for Balancing Privacy and Utility in LLM Inference

2026-07-12 · Chen Gu, Hui Wan, Donghui Hu, Hui Wang 외 arxiv

Large Language Model (LLM) services introduce a fundamental privacy challenge. Sensitive information may be inferred not only from explicit identifiers, such as names or phone numbers, but also from contextual associatio…

The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization

2025-08-26 · Stephen Meisenbacher, Alexandra Klymenko, Andreea-Elena Bodea, Florian Matthes arxiv

Differentially private text sanitization refers to the process of privatizing texts under the framework of Differential Privacy (DP), providing provable privacy guarantees while also empirically defending against adversa…

Stronger Data Poisoning Attacks Break Data Sanitization Defenses

2018-11-02 · Pang Wei Koh, Jacob Steinhardt, Percy Liang

Machine learning models trained on data from the outside world can be corrupted by data poisoning attacks that inject malicious points into the models' training sets. A common defense against these attacks is data saniti…

Data PoisoningSentiment AnalysisSentiment ClassificationSpam detection

Neural Multi-task Text Normalization and Sanitization with Pointer-Generator

2020-07-01 · WS 2020 7 · Hoang Nguyen, S Cavallari, ro

Text normalization and sanitization are intrinsic components of Natural Language Inferences. In Information Retrieval or Dialogue Generation, normalization of user queries or utterances enhances linguistic understanding …

Dialogue GenerationInformation RetrievalRetrievalText Generation+1