paper-with-me

홈 › Papers

Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks

2024-07-30 · Yunfeng Diao, Naixin Zhai, Changtao Miao, Zitong Yu, Xingxing Wei, Xun Yang, Meng Wang

Recent advancements in image synthesis, particularly with the advent of GAN and Diffusion models, have amplified public concerns regarding the dissemination of disinformation. To address such concerns, numerous AI-generated Image (AIGI) Detectors have been proposed and achieved promising performance in identifying fake images. However, there still lacks a systematic understanding of the adversarial robustness of AIGI detectors. In this paper, we examine the vulnerability of state-of-the-art AIGI detectors against adversarial attack under white-box and black-box settings, which has been rarely investigated so far. To this end, we propose a new method to attack AIGI detectors. First, inspired by the obvious difference between real images and fake images in the frequency domain, we add perturbations under the frequency domain to push the image away from its original frequency distribution. Second, we explore the full posterior distribution of the surrogate model to further narrow this gap between heterogeneous AIGI detectors, e.g. transferring adversarial examples across CNNs and ViTs. This is achieved by introducing a novel post-train Bayesian strategy that turns a single surrogate into a Bayesian one, capable of simulating diverse victim models using one pre-trained surrogate, without the need for re-training. We name our method as Frequency-based Post-train Bayesian Attack, or FPBA. Through FPBA, we show that adversarial attack is truly a real threat to AIGI detectors, because FPBA can deliver successful black-box attacks across models, generators, defense methods, and even evade cross-generator detection, which is a crucial real-world detection scenario. The code will be shared upon acceptance.

📄 PDF Abstract BibTeX arXiv:2407.20836

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackAdversarial RobustnessImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Addressing Vulnerabilities in AI-Image Detection: Challenges and Proposed Solutions

2024-11-26 · Justin Jiang

The rise of advanced AI models like Generative Adversarial Networks (GANs) and diffusion models such as Stable Diffusion has made the creation of highly realistic images accessible, posing risks of misuse in misinformati…

Misinformation

Robustness in AI-Generated Detection: Enhancing Resistance to Adversarial Attacks

2025-05-06 · Sun Haoxuan, Hong Yan, Zhan Jiahui, Chen Haoxing 외

The rapid advancement of generative image technology has introduced significant security concerns, particularly in the domain of face generation detection. This paper investigates the vulnerabilities of current AI-genera…

Face DetectionFace Generation

StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model

2024-08-11 · Ziyin Zhou, Ke Sun, Zhongxi Chen, Huafeng Kuang 외

The rapid progress in generative models has given rise to the critical task of AI-Generated Content Stealth (AIGC-S), which aims to create AI-generated images that can evade both forensic detectors and human inspection. …

Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack

2024-04-02 · Ying Zhou, Ben He, Le Sun

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection …

Adversarial AttackText Detection

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems

2019-07-11 · Yulong Cao, Chaowei Xiao, Dawei Yang, Jing Fang 외

Deep neural networks (DNNs) are found to be vulnerable against adversarial examples, which are carefully crafted inputs with a small magnitude of perturbation aiming to induce arbitrarily incorrect predictions. Recent st…

Autonomous DrivingAutonomous Vehicles