Privacy-Preserving Image Classification Using Vision Transformer

2022-05-24 · Zheng Qi, AprilPyone MaungMaung, Yuma Kinoshita, Hitoshi Kiya

In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual information to ViT models for both training and testing but to also maintain a high classification accuracy. ViT utilizes patch embedding and position embedding for image patches, so this architecture is shown to reduce the influence of block-wise image transformation. In an experiment, the proposed method for privacy-preserving image classification is demonstrated to outperform state-of-the-art methods in terms of classification accuracy and robustness against various attacks.

📄 PDF Abstract BibTeX arXiv:2205.12041

Code (0)

등록된 구현이 없습니다.

Tasks

Classification image-classification Image ClassificationPositionPrivacy Preserving

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Residual Connection 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Privacy-Preserving Clothing Classification using Vision Transformer for Thermal Comfort Estimation

2026-04-29 · Tatsuya Chuman, Yousuke Udagawa, Hitoshi Kiya arxiv

A privacy-preserving clothing classification scheme is presented to enable secure occupant-centric control (OCC) systems. Although the utilization of camera images for HVAC control has been widely studied to optimize the…

Image Classification

Combined Use of Federated Learning and Image Encryption for Privacy-Preserving Image Classification with Vision Transformer

2023-01-23 · Teru Nagamori, Hitoshi Kiya

In recent years, privacy-preserving methods for deep learning have become an urgent problem. Accordingly, we propose the combined use of federated learning (FL) and encrypted images for privacy-preserving image classific…

Federated Learning image-classification Image Classification Privacy Preserving

Privacy-Preserving Image Classification Using Isotropic Network

2022-04-16 · AprilPyone MaungMaung, Hitoshi Kiya

In this paper, we propose a privacy-preserving image classification method that uses encrypted images and an isotropic network such as the vision transformer. The proposed method allows us not only to apply images withou…

Classification image-classification Image Classification Privacy Preserving

Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer

2024-01-10 · Teru Nagamori, Sayaka Shiota, Hitoshi Kiya

We propose a novel method for privacy-preserving deep neural networks (DNNs) with the Vision Transformer (ViT). The method allows us not only to train models and test with visually protected images but to also avoid the …

Domain Adaptation image-classification Image Classification Privacy Preserving

Effective Fine-Tuning of Vision Transformers with Low-Rank Adaptation for Privacy-Preserving Image Classification

2025-07-16 · Haiwei Lin, Shoko Imaizumi, Hitoshi Kiya arxiv

We propose a low-rank adaptation method for training privacy-preserving vision transformer (ViT) models that efficiently freezes pre-trained ViT model weights. In the proposed method, trainable rank decomposition matrice…