paper-with-me

홈 › Papers

Do Deep Minds Think Alike? Selective Adversarial Attacks for Fine-Grained Manipulation of Multiple Deep Neural Networks

2020-03-26 · Zain Khan, Jirong Yi, Raghu Mudumbai, Xiaodong Wu, Weiyu Xu

Recent works have demonstrated the existence of {\it adversarial examples} targeting a single machine learning system. In this paper we ask a simple but fundamental question of "selective fooling": given {\it multiple} machine learning systems assigned to solve the same classification problem and taking the same input signal, is it possible to construct a perturbation to the input signal that manipulates the outputs of these {\it multiple} machine learning systems {\it simultaneously} in arbitrary pre-defined ways? For example, is it possible to selectively fool a set of "enemy" machine learning systems but does not fool the other "friend" machine learning systems? The answer to this question depends on the extent to which these different machine learning systems "think alike". We formulate the problem of "selective fooling" as a novel optimization problem, and report on a series of experiments on the MNIST dataset. Our preliminary findings from these experiments show that it is in fact very easy to selectively manipulate multiple MNIST classifiers simultaneously, even when the classifiers are identical in their architectures, training algorithms and training datasets except for random initialization during training. This suggests that two nominally equivalent machine learning systems do not in fact "think alike" at all, and opens the possibility for many novel applications and deeper understandings of the working principles of deep neural networks.

📄 PDF Abstract BibTeX arXiv:2003.11816

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Selective Adversarial Attacks on LLM Benchmarks

2025-10-15 · Ivan Dubrovsky, Anastasia Orlova, Illarion Iov, Nina Gubina 외 arxiv

Benchmarking outcomes increasingly govern trust, selection, and deployment of LLMs, yet these evaluations remain vulnerable to semantically equivalent adversarial perturbations. Prior work on adversarial robustness in NL…

Adversarial RobustnessGeneral Knowledge

Deviations in Representations Induced by Adversarial Attacks

2022-11-07 · Daniel Steinberg, Paul Munro

Deep learning has been a popular topic and has achieved success in many areas. It has drawn the attention of researchers and machine learning practitioners alike, with developed models deployed to a variety of settings. …

Deep Learning

Vulnerability of Face Morphing Attacks: A Case Study on Lookalike and Identical Twins

2023-03-24 · Raghavendra Ramachandra, Sushma Venkatesh, Gaurav Jaswal, Guoqiang Li

Face morphing attacks have emerged as a potential threat, particularly in automatic border control scenarios. Morphing attacks permit more than one individual to use travel documents that can be used to cross borders usi…

BenchmarkingFace Recognition

Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA

2024-10-09 · Maharshi Gor, Hal Daumé III, Tianyi Zhou, Jordan Boyd-Graber

Recent advancements of large language models (LLMs) have led to claims of AI surpassing humans in natural language processing (NLP) tasks such as textual understanding and reasoning. This work investigates these assertio…

Information RetrievalQuestion AnsweringRetrieval

Pixel is a Barrier: Diffusion Models Are More Adversarially Robust Than We Think

2024-04-20 · Haotian Xue, Yongxin Chen

Adversarial examples for diffusion models are widely used as solutions for safety concerns. By adding adversarial perturbations to personal images, attackers can not edit or imitate them easily. However, it is essential …