paper-with-me

Papers

Associative Poisoning to Generative Machine Learning

2025-11-07 · Mathias Lundteigen Mohus, Jingyue Li, Zhirong Yang arxiv

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising synthesised data typically either cause broad degradation of generated data or require control over the training process, limiting their applicability in real-world scenarios. In this paper, we introduce a novel data poisoning technique called associative poisoning, which compromises fine-grained features of the generated data without requiring control of the training process. This attack perturbs only the training data to manipulate statistical associations between specific feature pairs in the generated outputs. We provide a formal mathematical formulation of the attack and prove its theoretical feasibility and stealthiness. Empirical evaluations using two state-of-the-art generative models demonstrate that associative poisoning effectively induces or suppresses feature associations while preserving the marginal distributions of the targeted features and maintaining high-quality outputs, thereby evading visual detection. These results suggest that generative systems used in image synthesis, synthetic dataset generation, and natural language processing are susceptible to subtle, stealthy manipulations that compromise their statistical integrity. To address this risk, we examine the limitations of existing defensive strategies and propose a novel countermeasure strategy.

📄 PDF Abstract BibTeX arXiv:2511.05177

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Poisoning Attacks with Generative Adversarial Nets

2019-06-18 · Luis Muñoz-González, Bjarne Pfitzner, Matteo Russo, Javier Carnerero-Cano 외

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoni…

BIG-bench Machine LearningData Poisoning

In search of dispersed memories: Generative diffusion models are associative memory networks

2023-09-29 · Luca Ambrogioni

Uncovering the mechanisms behind long-term memory is one of the most fascinating open problems in neuroscience and artificial intelligence. Artificial associative memory networks have been used to formalize important asp…

Associative Adversarial Networks

2016-11-18 · Tarik Arici, Asli Celikyilmaz

We propose a higher-level associative memory for learning adversarial networks. Generative adversarial network (GAN) framework has a discriminator and a generator network. The generator (G) maps white noise (z) to data s…

Generative Adversarial Network

Near-Term Quantum-Classical Associative Adversarial Networks

2019-05-30 · Eric R. Anschuetz, Cristian Zanoci

We introduce a new hybrid quantum-classical adversarial machine learning architecture called a quantum-classical associative adversarial network (QAAN). This architecture consists of a classical generative adversarial ne…

Generative Adversarial Network

Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models

2023-10-20 · Shawn Shan, Wenxin Ding, Josephine Passananti, Stanley Wu 외

Data poisoning attacks manipulate training data to introduce unexpected behaviors into machine learning models at training time. For text-to-image generative models with massive training datasets, current understanding o…

Data Poisoning