paper-with-me

Papers

Breaking the Quality-Privacy Tradeoff in Tabular Data Generation via In-Context Learning

2026-05-06 · Xinyan Han, Yan Lu, Xiaoyu Lin, Yuanyuan Jiang, Yuanrui Wang, Xuanyue Li, Wenchao Zou, Xingxuan Zhang arxiv

Tabular data synthesis aims to generate high-quality data while preserving privacy. However, we find that existing tabular generative models exhibit a clear tradeoff in the small-data regime: improving data quality typically comes at the cost of increased memorization of training samples, thereby weakening privacy protection. This tradeoff arises because small training sets make it difficult for dataset-specific generative models to distinguish generalizable structure from sample-specific patterns. To address this, we propose DiffICL, which formulates tabular data generation as an in-context learning problem. Instead of fitting each dataset from scratch,DiffICL leverages pretrained structural priors learned from a large collection of datasets, enabling it to infer data distributions from limited context rather than memorizing individual samples. We evaluate DiffICL on 14 real-world datasets. Results show that DiffICL improves both data quality and privacy, and generate synthetic data that provides effective data augmentation. Our findings suggest that the quality-privacy tradeoff can be improved through better training paradigms.

📄 PDF Abstract BibTeX arXiv:2605.04911

Code (0)

등록된 구현이 없습니다.

Tasks

Tabular Data GenerationData Augmentation

Similar Papers 제목 키워드 기반

Quantifying and Mitigating Privacy Risks for Tabular Generative Models

2024-03-12 · Chaoyi Zhu, Jiayi Tang, Hans Brouwer, Juan F. Pérez 외

Synthetic data from generative models emerges as the privacy-preserving data-sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. The backbone t…

Privacy Preserving

Measuring Privacy Risks and Tradeoffs in Financial Synthetic Data Generation

2026-02-10 · Michael Zuo, Inwon Kang, Stacy Patterson, Oshani Seneviratne arxiv

We explore the privacy-utility tradeoff of synthetic data generation schemes on tabular financial datasets, a domain characterized by high regulatory risk and severe class imbalance. We consider representative tabular da…

Synthetic Data Generation

Initial Exploration of Zero-Shot Privacy Utility Tradeoffs in Tabular Data Using GPT-4

2024-04-07 · Bishwas Mandal, George Amariucai, Shuangqing Wei

We investigate the application of large language models (LLMs), specifically GPT-4, to scenarios involving the tradeoff between privacy and utility in tabular data. Our approach entails prompting GPT-4 by transforming ta…

Fairness

TabMT: Generating tabular data with masked transformers

2023-12-11 · NeurIPS 2023 11 · Manbir S Gulati, Paul F Roysdon

Autoregressive and Masked Transformers are incredibly effective as generative models and classifiers. While these models are most prevalent in NLP, they also exhibit strong performance in other domains, such as vision. T…

Synthetic Data Generation

On the Utility Recovery Incapability of Neural Net-based Differential Private Tabular Training Data Synthesizer under Privacy Deregulation

2022-11-28 · Yucong Liu, Chi-Hua Wang, Guang Cheng

Devising procedures for auditing generative model privacy-utility tradeoff is an important yet unresolved problem in practice. Existing works concentrates on investigating the privacy constraint side effect in terms of u…