paper-with-me

Papers

Exploring Vision Transformers for Fine-grained Classification

2021-06-19 · Marcos V. Conde, Kerem Turgutlu

Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by locating the most informative image regions and rely on them to classify the complete image. The most recent work, Vision Transformer (ViT), shows its strong performance in both traditional and fine-grained classification tasks. In this work, we propose a multi-stage ViT framework for fine-grained image classification tasks, which localizes the informative image regions without requiring architectural changes using the inherent multi-head self-attention mechanism. We also introduce attention-guided augmentations for improving the model's capabilities. We demonstrate the value of our approach by experimenting with four popular fine-grained benchmarks: CUB-200-2011, Stanford Cars, Stanford Dogs, and FGVC7 Plant Pathology. We also prove our model's interpretability via qualitative results.

📄 PDF Abstract BibTeX arXiv:2106.10587

Code (1)

mv-lab/ViT-FGVC8 공식 구현

Tasks

ClassificationFine-Grained Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Dynamic Grained Encoder for Vision Transformers

2023-01-10 · NeurIPS 2021 12 · Lin Song, Songyang Zhang, Songtao Liu, Zeming Li 외

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the intrinsic spatial redundancy of natural …

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+2

Focal Attention for Long-Range Interactions in Vision Transformers

2021-12-01 · NeurIPS 2021 12 · Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai 외

Recently, Vision Transformer and its variants have shown great promise on various computer vision tasks. The ability to capture local and global visual dependencies through self-attention is the key to its success. But i…

image-classificationImage Classificationobject-detectionObject Detection+1

Conviformers: Convolutionally guided Vision Transformer

2022-08-17 · Mohit Vaishnav, Thomas Fel, Ivań Felipe Rodríguez, Thomas Serre

Vision transformers are nowadays the de-facto choice for image classification tasks. There are two broad categories of classification tasks, fine-grained and coarse-grained. In fine-grained classification, the necessity …

Fine-Grained Image Classificationimage-classificationImage Classification

Performance of computer vision algorithms for fine-grained classification using crowdsourced insect images

2024-04-04 · Rita Pucci, Vincent J. Kalkman, Dan Stowell

With fine-grained classification, we identify unique characteristics to distinguish among classes of the same super-class. We are focusing on species recognition in Insecta, as they are critical for biodiversity monitori…

A Comprehensive Study of Vision Transformers in Image Classification Tasks

2023-12-02 · Mahmoud Khalil, Ahmad Khalil, Alioune Ngom

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in…

Classificationimage-classificationImage Classification