paper-with-me

홈 › Papers

Fast Segment Anything

2023-06-21 · Xu Zhao, Wenchao Ding, Yongqi An, Yinglong Du, Tao Yu, Min Li, Ming Tang, Jinqiao Wang

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing. However, its huge computation costs prevent it from wider applications in industry scenarios. The computation mainly comes from the Transformer architecture at high-resolution inputs. In this paper, we propose a speed-up alternative method for this fundamental task with comparable performance. By reformulating the task as segments-generation and prompting, we find that a regular CNN detector with an instance segmentation branch can also accomplish this task well. Specifically, we convert this task to the well-studied instance segmentation task and directly train the existing instance segmentation method using only 1/50 of the SA-1B dataset published by SAM authors. With our method, we achieve a comparable performance with the SAM method at 50 times higher run-time speed. We give sufficient experimental results to demonstrate its effectiveness. The codes and demos will be released at https://github.com/CASIA-IVA-Lab/FastSAM.

📄 PDF Abstract BibTeX arXiv:2306.12156

Code (1)

casia-iva-lab/fastsam 공식 구현 pytorch

Tasks

Edge DetectionImage SegmentationInstance SegmentationObject Proposal GenerationSegmentationSemantic SegmentationVisual PromptingZero-Shot Instance Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
SAM 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Semantic-Fast-SAM: Efficient Semantic Segmenter

2026-04-22 · Byunghyun Kim arxiv

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM…

Real-Time Semantic Segmentation

FastSmoothSAM: A Fast Smooth Method For Segment Anything Model

2025-07-20 · Jiasheng Xu, Yewang Chen arxiv

Accurately identifying and representing object edges is a challenging task in computer vision and image processing. The Segment Anything Model (SAM) has significantly influenced the field of image segmentation, but suffe…

Image Segmentation

SAM 2: Segment Anything in Images and Videos

2024-08-01 · Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu 외

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect …

Image SegmentationRobot Manipulation GeneralizationSegmentationSemantic Segmentation+5

SAMJ: Fast Image Annotation on ImageJ/Fiji via Segment Anything Model

2025-06-03 · Carlos Garcia-Lopez-de-Haro, Caterina Fuster-Barcelo, Curtis T. Rueden, Jonathan Heras 외

Mask annotation remains a significant bottleneck in AI-driven biomedical image analysis due to its labor-intensive nature. To address this challenge, we introduce SAMJ, a user-friendly ImageJ/Fiji plugin leveraging the S…

Segment and Caption Anything

2023-12-01 · CVPR 2024 1 · Xiaoke Huang, JianFeng Wang, Yansong Tang, Zheng Zhang 외

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding…

Caption Generationobject-detectionObject DetectionSentence