paper-with-me

홈 › Papers

MMAD-Purify: A Precision-Optimized Framework for Efficient and Scalable Multi-Modal Attacks

2024-10-17 · Xinxin Liu, Zhongliang Guo, Siyuan Huang, Chun Pong Lau

Neural networks have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to adversarial perturbations, which pose significant risks in safety-critical applications. With the rise of multimodality, diffusion models have emerged as powerful tools not only for generative tasks but also for various applications such as image editing, inpainting, and super-resolution. However, these models still lack robustness due to limited research on attacking them to enhance their resilience. Traditional attack techniques, such as gradient-based adversarial attacks and diffusion model-based methods, are hindered by computational inefficiencies and scalability issues due to their iterative nature. To address these challenges, we introduce an innovative framework that leverages the distilled backbone of diffusion models and incorporates a precision-optimized noise predictor to enhance the effectiveness of our attack framework. This approach not only enhances the attack's potency but also significantly reduces computational costs. Our framework provides a cutting-edge solution for multi-modal adversarial attacks, ensuring reduced latency and the generation of high-fidelity adversarial examples with superior success rates. Furthermore, we demonstrate that our framework achieves outstanding transferability and robustness against purification defenses, outperforming existing gradient-based attack models in both effectiveness and efficiency.

📄 PDF Abstract BibTeX arXiv:2410.14089

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation

2025-11-12 · Ye Tian, Ling Yang, Jiongfan Yang, Anran Wang 외 arxiv

While thinking-aware generation aims to improve performance on complex tasks, we identify a critical failure mode where existing sequential, autoregressive approaches can paradoxically degrade performance due to error pr…

Reinforcement Learning

MMaDA: Multimodal Large Diffusion Language Models

2025-05-21 · Ling Yang, Ye Tian, Bowen Li, Xinchen Zhang 외

We introduce MMaDA, a novel class of multimodal diffusion foundation models designed to achieve superior performance across diverse domains such as textual reasoning, multimodal understanding, and text-to-image generatio…

Image GenerationReinforcement Learning (RL)Text to Image GenerationText-to-Image Generation

Precision-Scalable Microscaling Datapaths with Optimized Reduction Tree for Efficient NPU Integration

2025-11-09 · Stef Cuyckens, Xiaoling Yi, Robin Geens, Joren Dumoulin 외 arxiv

Emerging continual learning applications necessitate next-generation neural processing unit (NPU) platforms to support both training and inference operations. The promising Microscaling (MX) standard enables narrow bit-w…

Continual Learning

PersianPunc: A Large-Scale Dataset and BERT-Based Approach for Persian Punctuation Restoration

2026-03-05 · Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili, Azadeh Shakery arxiv

Punctuation restoration is essential for improving the readability and downstream utility of automatic speech recognition (ASR) outputs, yet remains underexplored for Persian despite its importance. We introduce PersianP…

Speech Recognition

UniMMAD: Unified Multi-Modal and Multi-Class Anomaly Detection via MoE-Driven Feature Decompression

2025-09-30 · Yuan Zhao, Youwei Pang, Lihe Zhang, Hanqi Liu 외 arxiv

Existing anomaly detection (AD) methods often treat the modality and class as independent factors. Although this paradigm has enriched the development of AD research branches and produced many specialized models, it has …

Multi-class Anomaly Detection