paper-with-me

Papers

Explainability of Vision Transformers: A Comprehensive Review and New Perspectives

2023-11-12 · Rojina Kashefi, Leili Barekatain, Mohammad Sabokrou, Fatemeh Aghaeipoor

Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision tasks. However, the scientific community has not fully grasped the inner workings of vision transformers, nor the basis for their decision-making, which underscores the importance of explainability methods. Understanding how these models arrive at their decisions not only improves their performance but also builds trust in AI systems. This study explores different explainability methods proposed for visual transformers and presents a taxonomy for organizing them according to their motivations, structures, and application scenarios. In addition, it provides a comprehensive review of evaluation criteria that can be used for comparing explanation results, as well as explainability tools and frameworks. Finally, the paper highlights essential but unexplored aspects that can enhance the explainability of visual transformers, and promising research directions are suggested for future investment.

📄 PDF Abstract BibTeX arXiv:2311.06786

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives

2022-06-02 · Jun Li, Junyu Chen, Yucheng Tang, Ce Wang 외

Transformer, the latest technological advance of deep learning, has gained prevalence in natural language processing or computer vision. Since medical imaging bear some resemblance to computer vision, it is natural to in…

Image SegmentationMedical Image SegmentationSemantic Segmentation

A Survey of Transformers

2021-06-08 · Tianyang Lin, Yuxin Wang, Xiangyang Liu, Xipeng Qiu

Transformers have achieved great success in many artificial intelligence fields, such as natural language processing, computer vision, and audio processing. Therefore, it is natural to attract lots of interest from acade…

Survey

Transformers in 3D Point Clouds: A Survey

2022-05-16 · Dening Lu, Qian Xie, Mingqiang Wei, Kyle Gao 외

Transformers have been at the heart of the Natural Language Processing (NLP) and Computer Vision (CV) revolutions. The significant success in NLP and CV inspired exploring the use of Transformers in point cloud processin…

object-detectionObject DetectionPoint Cloud ClassificationSurvey

Explainability of deep vision-based autonomous driving systems: Review and challenges

2021-01-13 · Éloi Zablocki, Hédi Ben-Younes, Patrick Pérez, Matthieu Cord

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a saf…

Autonomous DrivingExplainable artificial intelligenceSurvey

A Survey of Graph Transformers: Architectures, Theories and Applications

2025-02-23 · Chaohao Yuan, Kangfei Zhao, Ercan Engin Kuruoglu, Liang Wang 외

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studi…

Graph LearningSurvey