Image Segmentation with transformers: An Overview, Challenges and Future
Image segmentation, a key task in computer vision, has traditionally relied on convolutional neural networks (CNNs), yet these models struggle with capturing complex spatial dependencies, objects with varying scales, need for manually crafted architecture components and contextual information. This paper explores the shortcomings of CNN-based models and the shift towards transformer architectures -to overcome those limitations. This work reviews state-of-the-art transformer-based segmentation models, addressing segmentation-specific challenges and their solutions. The paper discusses current challenges in transformer-based segmentation and outlines promising future trends, such as lightweight architectures and enhanced data efficiency. This survey serves as a guide for understanding the impact of transformers in advancing segmentation capabilities and overcoming the limitations of traditional models.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Vision Transformers: State of the Art and Research Challenges
Transformers have achieved great success in natural language processing. Due to the powerful capability of self-attention mechanism in transformers, researchers develop the vision transformers for a variety of computer v…
3D ReconstructionImage Segmentationobject-detectionObject Detection+3Vision Foundation Models in Medical Image Analysis: Advances and Challenges
The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models hav…
Domain AdaptationFederated LearningImage SegmentationKnowledge Distillation+5Transformers in Medical Image Analysis: A Review
Transformers have dominated the field of natural language processing, and recently impacted the computer vision area. In the field of medical image analysis, Transformers have also been successfully applied to full-stack…
Image GenerationMedical Image AnalysisTransformer-Based Visual Segmentation: A Survey
Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing…
Autonomous DrivingPoint Cloud SegmentationSegmentationSurveyA Recent Survey of Vision Transformers for Medical Image Segmentation
Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated t…
Image SegmentationInductive BiasMedical Image SegmentationSegmentation+2