Category Feature Transformer for Semantic Segmentation
Aggregation of multi-stage features has been revealed to play a significant role in semantic segmentation. Unlike previous methods employing point-wise summation or concatenation for feature aggregation, this study proposes the Category Feature Transformer (CFT) that explores the flow of category embedding and transformation among multi-stage features through the prevalent multi-head attention mechanism. CFT learns unified feature embeddings for individual semantic categories from high-level features during each aggregation process and dynamically broadcasts them to high-resolution features. Integrating the proposed CFT into a typical feature pyramid structure exhibits superior performance over a broad range of backbone networks. We conduct extensive experiments on popular semantic segmentation benchmarks. Specifically, the proposed CFT obtains a compelling 55.1% mIoU with greatly reduced model parameters and computations on the challenging ADE20K dataset.
Code (1)
Tasks
SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentation
Few-shot semantic segmentation aims to segment the target objects in query under the condition of a few annotated support images. Most previous works strive to mine more effective category information from the support to…
Few-Shot Semantic SegmentationSemantic SegmentationPyramid Fusion Transformer for Semantic Segmentation
The recently proposed MaskFormer gives a refreshed perspective on the task of semantic segmentation: it shifts from the popular pixel-level classification paradigm to a mask-level classification method. In essence, it ge…
DecoderSegmentationSemantic SegmentationMasked-attention Mask Transformer for Universal Image Segmentation
Image segmentation is about grouping pixels with different semantics, e.g., category or instance membership, where each choice of semantics defines a task. While only the semantics of each task differ, current research f…
2D Semantic SegmentationImage SegmentationInstance SegmentationPanoptic Segmentation+3SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentation
Open-vocabulary semantic segmentation strives to distinguish pixels into different semantic groups from an open set of categories. Most existing methods explore utilizing pre-trained vision-language models, in which the …
DecoderOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentation+1Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers
Unsupervised semantic segmentation aims to discover groupings within and across images that capture object and view-invariance of a category without external supervision. Grouping naturally has levels of granularity, cre…
ClusteringSegmentationSemantic SegmentationUnsupervised Semantic Segmentation