Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models

2023-05-10 · Aldo Gael Carranza, Rezsa Farahani, Natalia Ponomareva, Alex Kurakin, Matthew Jagielski, Milad Nasr

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable, making them difficult to directly DP-train with since common techniques require per-example gradients. To address this issue, we propose an approach that prioritizes ensuring query privacy prior to training a deep retrieval system. Our method employs DP language models (LMs) to generate private synthetic queries representative of the original data. These synthetic queries can be used in downstream retrieval system training without compromising privacy. Our approach demonstrates a significant enhancement in retrieval quality compared to direct DP-training, all while maintaining query-level privacy guarantees. This work highlights the potential of harnessing LMs to overcome limitations in standard DP-training methods.

📄 PDF Abstract BibTeX arXiv:2305.05973

Code (0)

등록된 구현이 없습니다.

Tasks

Privacy PreservingRecommendation Systems Retrieval

Differentially Private Synthetic Text Generation for Retrieval-Augmented Generation (RAG)

2025-10-08 · Junki Mori, Kazuya Kakizaki, Taiki Miyagawa, Jun Sakuma arxiv

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding them in external knowledge. However, its application in sensitive domains is limited by privacy risks. Existing private RAG methods …

Text Generation

Efficient Privacy-Preserving Retrieval Augmented Generation with Distance-Preserving Encryption

2026-01-18 · Huanyi Ye, Jiale Guo, Ziyao Liu, Kwok-Yan Lam arxiv

RAG has emerged as a key technique for enhancing response quality of LLMs without high computational cost. In traditional architectures, RAG services are provided by a single entity that hosts the dataset within a truste…

RemoteRAG: A Privacy-Preserving LLM Cloud RAG Service

2024-12-17 · Yihang Cheng, Lan Zhang, Junyang Wang, Mu Yuan 외

Retrieval-augmented generation (RAG) improves the service quality of large language models by retrieving relevant documents from credible literature and integrating them into the context of the user query. Recently, the …

Privacy Preserving RAG Retrieval Retrieval-augmented Generation

Knowledge-Guided Retrieval-Augmented Generation for Zero-Shot Psychiatric Data: Privacy Preserving Synthetic Data Generation

2026-03-26 · Adam Jakobsen, Sushant Gautam, Hugo Lewi Hammer, Susanne Olofsdotter 외 arxiv

AI systems in healthcare research have shown potential to increase patient throughput and assist clinicians, yet progress is constrained by limited access to real patient data. To address this issue, we present a zero-sh…

Synthetic Data Generation Tabular Data Generation Clinical Knowledge

Membership Inference over Diffusion-models-based Synthetic Tabular Data

2025-10-16 · Peini Cheng, Amir Bahmani arxiv

This study investigates the privacy risks associated with diffusion-based synthetic tabular data generation methods, focusing on their susceptibility to Membership Inference Attacks (MIAs). We examine two recent models, …

Synthetic Data Generation Tabular Data Generation