A Random Ensemble of Encrypted models for Enhancing Robustness against Adversarial Examples

2024-01-05 · Ryota Iijima, Sayaka Shiota, Hitoshi Kiya

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with a non-trivial probability. In previous studies, it was confirmed that the vision transformer (ViT) is more robust against the property of adversarial transferability than convolutional neural network (CNN) models such as ConvMixer, and moreover encrypted ViT is more robust than ViT without any encryption. In this article, we propose a random ensemble of encrypted ViT models to achieve much more robust models. In experiments, the proposed scheme is verified to be more robust against not only black-box attacks but also white-box ones than convention methods.

📄 PDF Abstract BibTeX arXiv:2401.02633

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Multi-Head Attention 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Residual Connection 설명 없음

Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

A Random Ensemble of Encrypted Vision Transformers for Adversarially Robust Defense

2024-02-11 · Ryota Iijima, Sayaka Shiota, Hitoshi Kiya

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but n…

Adversarial Robustness image-classification Image Classification

Enhanced Security against Adversarial Examples Using a Random Ensemble of Encrypted Vision Transformer Models

2023-07-26 · Ryota Iijima, Miki Tanaka, Sayaka Shiota, Hitoshi Kiya

A privacy-preserving method using secret key for convolutional neural network-based speech classification

2023-10-06 · Shoko Niwa, Sayaka Shiota, Hitoshi Kiya

In this paper, we propose a privacy-preserving method with a secret key for convolutional neural network (CNN)-based speech classification tasks. Recently, many methods related to privacy preservation have been developed…

Automatic Speech Recognition Automatic Speech Recognition (ASR)Classification image-classification+5

Integrating Explainable AI for Effective Malware Detection in Encrypted Network Traffic

2025-01-09 · Sileshi Nibret Zeleke, Amsalu Fentie Jember, Mario Bochicchio

Encrypted network communication ensures confidentiality, integrity, and privacy between endpoints. However, attackers are increasingly exploiting encryption to conceal malicious behavior. Detecting unknown encrypted mali…

Ensemble Learning Explainable artificial intelligence Explainable Artificial Intelligence (XAI)Malware Detection

Robustness Verification for Classifier Ensembles

2020-05-12 · Dennis Gross, Nils Jansen, Guillermo A. Pérez, Stephan Raaijmakers

We give a formal verification procedure that decides whether a classifier ensemble is robust against arbitrary randomized attacks. Such attacks consist of a set of deterministic attacks and a distribution over this set. …

image-classification Image Classification