paper-with-me

Papers

Enhancing Adversarial Transferability by Balancing Exploration and Exploitation with Gradient-Guided Sampling

2025-11-01 · Zenghao Niu, Weicheng Xie, Siyang Song, Zitong Yu, Feng Liu, Linlin Shen arxiv

Adversarial attacks present a critical challenge to deep neural networks' robustness, particularly in transfer scenarios across different model architectures. However, the transferability of adversarial attacks faces a fundamental dilemma between Exploitation (maximizing attack potency) and Exploration (enhancing cross-model generalization). Traditional momentum-based methods over-prioritize Exploitation, i.e., higher loss maxima for attack potency but weakened generalization (narrow loss surface). Conversely, recent methods with inner-iteration sampling over-prioritize Exploration, i.e., flatter loss surfaces for cross-model generalization but weakened attack potency (suboptimal local maxima). To resolve this dilemma, we propose a simple yet effective Gradient-Guided Sampling (GGS), which harmonizes both objectives through guiding sampling along the gradient ascent direction to improve both sampling efficiency and stability. Specifically, based on MI-FGSM, GGS introduces inner-iteration random sampling and guides the sampling direction using the gradient from the previous inner-iteration (the sampling's magnitude is determined by a random distribution). This mechanism encourages adversarial examples to reside in balanced regions with both flatness for cross-model generalization and higher local maxima for strong attack potency. Comprehensive experiments across multiple DNN architectures and multimodal large language models (MLLMs) demonstrate the superiority of our method over state-of-the-art transfer attacks. Code is made available at https://github.com/anuin-cat/GGS.

📄 PDF Abstract BibTeX arXiv:2511.00411

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding

2024-03-02 · Ha-Thanh Nguyen, Ken Satoh

Finetuning approaches in NLP often focus on exploitation rather than exploration, which may lead to suboptimal models. Given the vast search space of natural language, this limited exploration can restrict their performa…

Logical ReasoningNegationTransfer Learning

B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners

2024-12-23 · Weihao Zeng, Yuzhen Huang, Lulu Zhao, Yijun Wang 외

In the absence of extensive human-annotated data for complex reasoning tasks, self-improvement -- where models are trained on their own outputs -- has emerged as a primary method for enhancing performance. However, the c…

Mathematical Reasoning

Breaking Information Cocoons: A Hyperbolic Graph-LLM Framework for Exploration and Exploitation in Recommender Systems

2024-11-21 · Qiyao Ma, Menglin Yang, Mingxuan Ju, Tong Zhao 외

Modern recommender systems often create information cocoons, restricting users' exposure to diverse content. A key challenge lies in balancing content exploration and exploitation while allowing users to adjust their rec…

Recommendation SystemsRepresentation Learning

Reasoning with Exploration: An Entropy Perspective

2025-06-17 · Daixuan Cheng, Shaohan Huang, Xuekai Zhu, Bo Dai 외

Balancing exploration and exploitation is a central goal in reinforcement learning (RL). Despite recent advances in enhancing language model (LM) reasoning, most methods lean toward exploitation, and increasingly encount…

Reinforcement Learning (RL)

PUL-SLAM: Path-Uncertainty Co-Optimization with Lightweight Stagnation Detection for Efficient Robotic Exploration

2025-11-06 · Yizhen Yin, Dapeng Feng, Hongbo Chen, Yuhua Qi arxiv

Existing Active SLAM methodologies face issues such as slow exploration speed and suboptimal paths. To address these limitations, we propose a hybrid framework combining a Path-Uncertainty Co-Optimization Deep Reinforcem…

Reinforcement LearningAnomaly Detection