paper-with-me

홈 › Papers

Sensitive Image Classification by Vision Transformers

2024-12-21 · Hanxian He, Campbell Wilson, Thanh Thi Nguyen, Janis Dalins

When it comes to classifying child sexual abuse images, managing similar inter-class correlations and diverse intra-class correlations poses a significant challenge. Vision transformer models, unlike conventional deep convolutional network models, leverage a self-attention mechanism to capture global interactions among contextual local elements. This allows them to navigate through image patches effectively, avoiding incorrect correlations and reducing ambiguity in attention maps, thus proving their efficacy in computer vision tasks. Rather than directly analyzing child sexual abuse data, we constructed two datasets: one comprising clean and pornographic images and another with three classes, which additionally include images indicative of pornography, sourced from Reddit and Google Open Images data. In our experiments, we also employ an adult content image benchmark dataset. These datasets served as a basis for assessing the performance of vision transformer models in pornographic image classification. In our study, we conducted a comparative analysis between various popular vision transformer models and traditional pre-trained ResNet models. Furthermore, we compared them with established methods for sensitive image detection such as attention and metric learning based CNN and Bumble. The findings demonstrated that vision transformer networks surpassed the benchmark pre-trained models, showcasing their superior classification and detection capabilities in this task.

📄 PDF Abstract BibTeX arXiv:2412.16446

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage ClassificationMetric LearningNavigate

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Average Pooling 설명 없음
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Kaiming Initialization 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Scaling Federated Learning Solutions with Kubernetes for Synthesizing Histopathology Images

2025-04-05 · Andrei-Alexandru Preda, Iulian-Marius Tăiatu, Dumitru-Clementin Cercel

In the field of deep learning, large architectures often obtain the best performance for many tasks, but also require massive datasets. In the histological domain, tissue images are expensive to obtain and constitute sen…

Federated Learningimage-classificationImage Classification

Making Vision Transformers Truly Shift-Equivariant

2023-05-25 · CVPR 2024 1 · Renan A. Rojas-Gomez, Teck-Yian Lim, Minh N. Do, Raymond A. Yeh

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts …

image-classificationImage ClassificationSemantic Segmentation

A Comprehensive Study of Vision Transformers in Image Classification Tasks

2023-12-02 · Mahmoud Khalil, Ahmad Khalil, Alioune Ngom

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in…

Classificationimage-classificationImage Classification

Alias-Free ViT: Fractional Shift Invariance via Linear Attention

2025-10-26 · Hagay Michaeli, Daniel Soudry arxiv

Transformers have emerged as a competitive alternative to convnets in vision tasks, yet they lack the architectural inductive bias of convnets, which may hinder their potential performance. Specifically, Vision Transform…

Image Classification

Boosting vision transformers for image retrieval

2022-10-21 · Chull Hwan Song, Jooyoung Yoon, Shunghyun Choi, Yannis Avrithis

Vision transformers have achieved remarkable progress in vision tasks such as image classification and detection. However, in instance-level image retrieval, transformers have not yet shown good performance compared to c…

image-classificationImage ClassificationImage RetrievalRetrieval