paper-with-me

홈 › Papers

Semantic-Fast-SAM: Efficient Semantic Segmenter

2026-04-22 · Byunghyun Kim arxiv

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM is an efficient CNN-based re-implementation of the Segment Anything Model (SAM) that runs much faster than the original transformer-based SAM. Building upon FastSAM's rapid mask generation, we integrate a Semantic-Segment-Anything (SSA) labeling strategy to assign meaningful categories to each mask. The resulting SFS model produces high-quality semantic segmentation maps at a fraction of the computational cost and memory footprint of the original SAM-based approach. Experiments on Cityscapes and ADE20K benchmarks demonstrate that SFS matches the accuracy of prior SAM-based methods (mIoU ~ 70.33 on Cityscapes and 48.01 on ADE20K) while achieving approximately 20x faster inference than SSA in the closed-set setting. We also show that SFS effectively handles open-vocabulary segmentation by leveraging CLIP-based semantic heads, outperforming recent open-vocabulary models on broad class labeling. This work enables practical real-time semantic segmentation with the "segment-anything" capability, broadening the applicability of foundation segmentation models in robotics scenarios. The implementation is available at https://github.com/KBH00/Semantic-Fast-SAM.

📄 PDF Abstract BibTeX arXiv:2604.20169

Code (0)

등록된 구현이 없습니다.

Tasks

Real-Time Semantic Segmentation

Results from the Paper

RankTaskDatasetModelMetrics
#160 Semantic Segmentation ADE20K Semantic-Fast-SAM Validation mIoU: 48.01
#8 Semantic Segmentation Cityscapes Semantic-Fast-SAM mIoU: 70.33

Similar Papers 제목 키워드 기반

Background Subtraction with Real-time Semantic Segmentation

2018-11-25 · Dongdong Zeng, Xiang Chen, Ming Zhu, Michael Goesele 외

Accurate and fast foreground object extraction is very important for object tracking and recognition in video surveillance. Although many background subtraction (BGS) methods have been proposed in the recent past, it is …

Foreground SegmentationObject TrackingReal-Time Semantic SegmentationSemantic Segmentation

I-Segmenter: Integer-Only Vision Transformer for Efficient Semantic Segmentation

2025-09-12 · Jordan Sassoon, Michal Szczepanski, Martyna Poreba arxiv

Vision Transformers (ViTs) have recently achieved strong results in semantic segmentation, yet their deployment on resource-constrained devices remains limited due to their high memory footprint and computational cost. Q…

Semantic Segmentation

Diffusion Model is Secretly a Training-free Open Vocabulary Semantic Segmenter

2023-09-06 · Jinglong Wang, Xiawei Li, Jing Zhang, Qingyuan Xu 외

The pre-trained text-image discriminative models, such as CLIP, has been explored for open-vocabulary semantic segmentation with unsatisfactory results due to the loss of crucial localization information and awareness of…

Contrastive LearningDenoisingImage GenerationObject+5

No More Discrimination: Cross City Adaptation of Road Scene Segmenters

2017-04-27 · ICCV 2017 10 · Yi-Hsin Chen, Wei-Yu Chen, Yu-Ting Chen, Bo-Cheng Tsai 외

Despite the recent success of deep-learning based semantic segmentation, deploying a pre-trained road scene segmenter to a city whose images are not presented in the training set would not achieve satisfactory performanc…

SegmentationSemantic Segmentation

Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR

2023-05-28 · W. Ronny Huang, Hao Zhang, Shankar Kumar, Shuo-Yiin Chang 외

We propose a method of segmenting long-form speech by separating semantically complete sentences within the utterance. This prevents the ASR decoder from needlessly processing faraway context while also preventing it fro…

DecoderFormLanguage ModelingLanguage Modelling+2