paper-with-me

Papers

Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting

2024-10-01 · Stephen Meisenbacher, Florian Matthes

The field of privacy-preserving Natural Language Processing has risen in popularity, particularly at a time when concerns about privacy grow with the proliferation of Large Language Models. One solution consistently appearing in recent literature has been the integration of Differential Privacy (DP) into NLP techniques. In this paper, we take these approaches into critical view, discussing the restrictions that DP integration imposes, as well as bring to light the challenges that such restrictions entail. To accomplish this, we focus on $\textbf{DP-Prompt}$, a recent method for text privatization leveraging language models to rewrite texts. In particular, we explore this rewriting task in multiple scenarios, both with DP and without DP. To drive the discussion on the merits of DP in NLP, we conduct empirical utility and privacy experiments. Our results demonstrate the need for more discussion on the usability of DP in NLP and its benefits over non-DP approaches.

📄 PDF Abstract BibTeX arXiv:2410.00751

Code (1)

sjmeis/DPNONDP 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingPrivacy Preserving

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

DP-SPRT: Differentially Private Sequential Probability Ratio Tests

2025-08-08 · Thomas Michel, Debabrota Basu, Emilie Kaufmann arxiv

We revisit Wald's celebrated Sequential Probability Ratio Test for sequential tests of two simple hypotheses, under privacy constraints. We propose DP-SPRT, a wrapper that can be calibrated to achieve desired error proba…

Debugging Differential Privacy: A Case Study for Privacy Auditing

2022-02-24 · Florian Tramer, Andreas Terzis, Thomas Steinke, Shuang Song 외

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which …

Differential Privacy in Natural Language Processing The Story So Far

2022-07-01 · NAACL (PrivateNLP) 2022 7 · Oleksandra Klymenko, Stephen Meisenbacher, Florian Matthes

As the tide of Big Data continues to influence the landscape of Natural Language Processing (NLP), the utilization of modern NLP methods has grounded itself in this data, in order to tackle a variety of text-based tasks.…

Differential Privacy in Natural Language Processing: The Story So Far

2022-08-17 · Oleksandra Klymenko, Stephen Meisenbacher, Florian Matthes

As the tide of Big Data continues to influence the landscape of Natural Language Processing (NLP), the utilization of modern NLP methods has grounded itself in this data, in order to tackle a variety of text-based tasks.…

Privacy-Preserving Retrieval-Augmented Generation with Differential Privacy

2024-12-06 · Tatsuki Koga, Ruihan Wu, Kamalika Chaudhuri

With the recent remarkable advancement of large language models (LLMs), there has been a growing interest in utilizing them in the domains with highly sensitive data that lies outside their training data. For this purpos…

Privacy PreservingRAGRetrievalRetrieval-augmented Generation