paper-with-me

홈 › Papers

Category Feature Transformer for Semantic Segmentation

2023-08-10 · Quan Tang, Chuanjian Liu, Fagui Liu, Yifan Liu, Jun Jiang, BoWen Zhang, Kai Han, Yunhe Wang

Aggregation of multi-stage features has been revealed to play a significant role in semantic segmentation. Unlike previous methods employing point-wise summation or concatenation for feature aggregation, this study proposes the Category Feature Transformer (CFT) that explores the flow of category embedding and transformation among multi-stage features through the prevalent multi-head attention mechanism. CFT learns unified feature embeddings for individual semantic categories from high-level features during each aggregation process and dynamically broadcasts them to high-resolution features. Integrating the proposed CFT into a typical feature pyramid structure exhibits superior performance over a broad range of backbone networks. We conduct extensive experiments on popular semantic segmentation benchmarks. Specifically, the proposed CFT obtains a compelling 55.1% mIoU with greatly reduced model parameters and computations on the challenging ADE20K dataset.

📄 PDF Abstract BibTeX arXiv:2308.05581

Code (1)

BebDong/EMOSeg 공식 구현

Tasks

SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentation

2022-10-13 · Yuanwei Liu, Nian Liu, Xiwen Yao, Junwei Han

Few-shot semantic segmentation aims to segment the target objects in query under the condition of a few annotated support images. Most previous works strive to mine more effective category information from the support to…

Few-Shot Semantic SegmentationSemantic Segmentation

Pyramid Fusion Transformer for Semantic Segmentation

2022-01-11 · Zipeng Qin, Jianbo Liu, Xiaolin Zhang, Maoqing Tian 외

The recently proposed MaskFormer gives a refreshed perspective on the task of semantic segmentation: it shifts from the popular pixel-level classification paradigm to a mask-level classification method. In essence, it ge…

DecoderSegmentationSemantic Segmentation

Masked-attention Mask Transformer for Universal Image Segmentation

2021-12-02 · CVPR 2022 1 · Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov 외

Image segmentation is about grouping pixels with different semantics, e.g., category or instance membership, where each choice of semantics defines a task. While only the semantics of each task differ, current research f…

2D Semantic SegmentationImage SegmentationInstance SegmentationPanoptic Segmentation+3

SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentation

2023-11-27 · CVPR 2024 1 · Bin Xie, Jiale Cao, Jin Xie, Fahad Shahbaz Khan 외

Open-vocabulary semantic segmentation strives to distinguish pixels into different semantic groups from an open set of categories. Most existing methods explore utilizing pre-trained vision-language models, in which the …

DecoderOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentation+1

Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers

2022-04-25 · CVPR 2022 1 · Tsung-Wei Ke, Jyh-Jing Hwang, Yunhui Guo, Xudong Wang 외

Unsupervised semantic segmentation aims to discover groupings within and across images that capture object and view-invariance of a category without external supervision. Grouping naturally has levels of granularity, cre…

ClusteringSegmentationSemantic SegmentationUnsupervised Semantic Segmentation