paper-with-me

홈 › Papers

Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks

2023-08-04 · Domenico Cotroneo, Cristina Improta, Pietro Liguori, Roberto Natella

AI-based code generators have become pivotal in assisting developers in writing software starting from natural language (NL). However, they are trained on large amounts of data, often collected from unsanitized online sources (e.g., GitHub, HuggingFace). As a consequence, AI models become an easy target for data poisoning, i.e., an attack that injects malicious samples into the training data to generate vulnerable code. To address this threat, this work investigates the security of AI code generators by devising a targeted data poisoning strategy. We poison the training data by injecting increasing amounts of code containing security vulnerabilities and assess the attack's success on different state-of-the-art models for code generation. Our study shows that AI code generators are vulnerable to even a small amount of poison. Notably, the attack success strongly depends on the model architecture and poisoning rate, whereas it is not influenced by the type of vulnerabilities. Moreover, since the attack does not impact the correctness of code generated by pre-trained models, it is hard to detect. Lastly, our work offers practical insights into understanding and potentially mitigating this threat.

📄 PDF Abstract BibTeX arXiv:2308.04451

Code (1)

dessertlab/targeted-data-poisoning-attacks 공식 구현

Tasks

Code GenerationData Poisoning

Similar Papers 제목 키워드 기반

BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators

2024-02-23 · Yu Tian, Xiao Yang, Yinpeng Dong, Heming Yang 외

Extremely large image generators offer significant transformative potential across diverse sectors. It allows users to design specific prompts to generate realistic images through some black-box APIs. However, some studi…

Can LLMs Generate Reliable Test Case Generators? A Study on Competition-Level Programming Problems

2025-06-07 · Yuhan Cao, Zian Chen, Kun Quan, Ziliang Zhang 외

Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation, capable of tackling complex tasks during inference. However, the extent to which LLMs can be utilized for code checking or debugg…

Code Generationvalid

Defending Against Neural Fake News

2019-05-29 · NeurIPS 2019 12 · Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk 외

Recent progress in natural language generation has raised dual-use concerns. While applications like summarization and translation are positive, the underlying technology also might enable adversaries to generate neural …

Computer SecurityFake News DetectionText Generation

Learning Controllable Content Generators

2021-05-06 · Sam Earle, Maria Edwards, Ahmed Khalifa, Philip Bontrager 외

It has recently been shown that reinforcement learning can be used to train generators capable of producing high-quality game levels, with quality defined in terms of some user-specified heuristic. To ensure that these g…

Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics

2024-11-18 · Taowen Wang, Cheng Han, James Chenhao Liang, Wenhao Yang 외

Recently in robotics, Vision-Language-Action (VLA) models have emerged as a transformative approach, enabling robots to execute complex tasks by integrating visual and linguistic inputs within an end-to-end learning fram…

Vision-Language-Action