Transformers Meet Visual Learning Understanding: A Comprehensive Review
Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the current research progress of Transformer in image and video applications, which makes a comprehensive overview of Transformer in visual learning understanding. First, the attention mechanism is reviewed, which plays an essential part in Transformer. And then, the visual Transformer model and the principle of each module are introduced. Thirdly, the existing Transformer-based models are investigated, and their performance is compared in visual learning understanding applications. Three image tasks and two video tasks of computer vision are investigated. The former mainly includes image classification, object detection, and image segmentation. The latter contains object tracking and video classification. It is significant for comparing different models' performance in various tasks on several public benchmark data sets. Finally, ten general problems are summarized, and the developing prospects of the visual Transformer are given in this review.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationImage Segmentationobject-detectionObject DetectionObject TrackingSemantic SegmentationVideo ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explainability of Vision Transformers: A Comprehensive Review and New Perspectives
Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundament…
Decision MakingMultimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies
Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements…
A Comprehensive Review of Generative AI in Healthcare
The advancement of Artificial Intelligence (AI) has catalyzed revolutionary changes across various sectors, notably in healthcare. Among the significant developments in this field are the applications of generative AI mo…
DiagnosticDrug Designimage-classificationImage Classification+5Large Language Models Meet Computer Vision: A Brief Survey
Recently, the intersection of Large Language Models (LLMs) and Computer Vision (CV) has emerged as a pivotal area of research, driving significant advancements in the field of Artificial Intelligence (AI). As transformer…
SurveyWhen Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System
Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized. Geoscience foundation models (GFMs) emerge as a p…
Data IntegrationUncertainty Quantification