paper-with-me

홈 › Papers

Mental Damage: Caption Poisoning Attacks on Retrieval-Augmented Text-to-Music Generation

2026-05-18 · Yizhu Wen, Shuhao Zhang, Nan Zhang, Long Cheng, Hanqing Guo arxiv

Retrieval-augmented text-to-music (TTM) systems augment underspecified user prompts using captions retrieved from a music caption dataset. This design introduces an integrity dependency on the music knowledge database. We show that an attacker can poison the database by injecting a small number of crafted music captions, causing the system to retrieve malicious captions that bias prompt augmentation and steer generation away from the user's intended function, without modifying the user prompt, retriever, or generator. To achieve the music caption poisoning attack, we propose a dual-layer caption poisoning strategy that preserves high-level retrieval anchors while injecting low-level acoustic descriptors to steer prompt augmentation and downstream music generation toward an attacker-chosen target intent. In a MusicCaps knowledge database, CLAP retriever, and MusicGen pipeline, poisoned generations move substantially closer to the attacker's target, while remaining comparably aligned with the original user query. These results expose a practical integrity risk for retrieval-augmented creative AI systems. Our demo can be found at: https://yizhu-wen.github.io/Mental-Damage/

📄 PDF Abstract BibTeX arXiv:2605.30365

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Music Generation

Similar Papers 제목 키워드 기반

Robust Contrastive Language-Image Pre-training against Data Poisoning and Backdoor Attacks

2023-03-13 · Wenhan Yang, Jingdong Gao, Baharan Mirzasoleiman

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive…

Backdoor AttackData PoisoningRepresentation Learningzero-shot-classification+1

Robust Contrastive Language-Image Pretraining against Data Poisoning and Backdoor Attacks

2023-09-21 · NeurIPS 2023 11

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive…

Timber! Poisoning Decision Trees

2024-10-01 · Stefano Calzavara, Lorenzo Cazzaro, Massimo Vettori

We present Timber, the first white-box poisoning attack targeting decision trees. Timber is based on a greedy attack strategy that leverages sub-tree retraining to efficiently estimate the damage caused by poisoning a gi…

Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks

2023-10-05 · Wenhan Yang, Jingdong Gao, Baharan Mirzasoleiman

Contrastive Language-Image Pre-training (CLIP) on large image-caption datasets has achieved remarkable success in zero-shot classification and enabled transferability to new domains. However, CLIP is extremely more vulne…

Contrastive LearningData Poisoningzero-shot-classificationZero-Shot Learning

Pre-training CLIP against Data Poisoning with Optimal Transport-based Matching and Alignment

2025-09-23 · Tong Zhang, Kuofeng Gao, Jiawang Bai, Leo Yu Zhang 외 arxiv

Recent studies have shown that Contrastive Language-Image Pre-training (CLIP) models are threatened by targeted data poisoning and backdoor attacks due to massive training image-caption pairs crawled from the Internet. P…