Semantic Segmentation using Vision Transformers: A survey
Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the architecture models for semantic segmentation. Even though ViTs have proven success in image classification, they cannot be directly applied to dense prediction tasks such as image segmentation and object detection since ViT is not a general purpose backbone due to its patch partitioning scheme. In this survey, we discuss some of the different ViT architectures that can be used for semantic segmentation and how their evolution managed the above-stated challenge. The rise of ViT and its performance with a high success rate motivated the community to slowly replace the traditional convolutional neural networks in various computer vision tasks. This survey aims to review and compare the performances of ViT architectures designed for semantic segmentation using benchmarking datasets. This will be worthwhile for the community to yield knowledge regarding the implementations carried out in semantic segmentation and to discover more efficient methodologies using ViTs.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingBenchmarkingimage-classificationImage ClassificationImage SegmentationMedical Image Analysisobject-detectionObject DetectionSegmentationSemantic SegmentationSurveySimilar Papers 제목 키워드 기반
Semantic Image Segmentation: Two Decades of Research
Semantic image segmentation (SiS) plays a fundamental role in a broad variety of computer vision applications, providing key information for the global understanding of an image. This survey is an effort to summarize two…
Domain AdaptationDomain Generalizationimage-classificationImage Classification+11A Survey of Vision Transformers in Autonomous Driving: Current Trends and Future Directions
This survey explores the adaptation of visual transformer models in Autonomous Driving, a transition inspired by their success in Natural Language Processing. Surpassing traditional Recurrent Neural Networks in tasks lik…
Autonomous DrivingDecoderLane Detectionobject-detection+4A Survey of Visual Transformers
Transformer, an attention-based encoder-decoder model, has already revolutionized the field of natural language processing (NLP). Inspired by such significant achievements, some pioneering works have recently been done o…
ArticlesSurveyA Recent Survey of Vision Transformers for Medical Image Segmentation
Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated t…
Image SegmentationInductive BiasMedical Image SegmentationSegmentation+23D Vision with Transformers: A Survey
The success of the transformer architecture in natural language processing has recently triggered attention in the computer vision field. The transformer has been used as a replacement for the widely used convolution ope…
Pose EstimationSurvey