Prompt Categories Cluster for Weakly Supervised Semantic Segmentation

2024-12-18 · Wangyu Wu, Xianglin Qiu, Siqi Song, Xiaowei Huang, Fei Ma, Jimin Xiao

Weakly Supervised Semantic Segmentation (WSSS), which leverages image-level labels, has garnered significant attention due to its cost-effectiveness. The previous methods mainly strengthen the inter-class differences to avoid class semantic ambiguity which may lead to erroneous activation. However, they overlook the positive function of some shared information between similar classes. Categories within the same cluster share some similar features. Allowing the model to recognize these features can further relieve the semantic ambiguity between these classes. To effectively identify and utilize this shared information, in this paper, we introduce a novel WSSS framework called Prompt Categories Clustering (PCC). Specifically, we explore the ability of Large Language Models (LLMs) to derive category clusters through prompts. These clusters effectively represent the intrinsic relationships between categories. By integrating this relational information into the training network, our model is able to better learn the hidden connections between categories. Experimental results demonstrate the effectiveness of our approach, showing its ability to enhance performance on the PASCAL VOC 2012 dataset and surpass existing state-of-the-art methods in WSSS.

📄 PDF Abstract BibTeX arXiv:2412.13823

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Segmentation Weakly supervised Semantic Segmentation Weakly-Supervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Contrastive Prompt Clustering for Weakly Supervised Semantic Segmentation

2025-08-23 · Wangyu Wu, Zhenhong Chen, Xiaowen Ma, Wenqiao Zhang 외 arxiv

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained attention for its cost-effectiveness. Most existing methods emphasize inter-class separation, often neglecting the shared semantics among …

Semantic Segmentation

Semantic Prompt Learning for Weakly-Supervised Semantic Segmentation

2024-01-22 · Ci-Siang Lin, Chien-Yi Wang, Yu-Chiang Frank Wang, Min-Hung Chen

Weakly-Supervised Semantic Segmentation (WSSS) aims to train segmentation models using image data with only image-level supervision. Since precise pixel-level annotations are not accessible, existing methods typically fo…

Object Prompt Learning Segmentation Semantic Segmentation+2

Open-World Weakly-Supervised Object Localization

2023-04-17 · Jinheng Xie, Zhaochuan Luo, Yuexiang Li, Haozhe Liu 외

While remarkable success has been achieved in weakly-supervised object localization (WSOL), current frameworks are not capable of locating objects of novel categories in open-world settings. To address this issue, we are…

Object Object Localization Representation Learning Weakly-Supervised Object Localization

Robust Prompt Tuning for Vision-Language Models with Mild Semantic Noise

2025-08-06 · Yansheng Gao, Yufei Zheng, Shengsheng Wang arxiv

Prompt tuning has shown promising results, but its robustness and generalization to unseen categories remain limited. Through our experiments, we demonstrate that the complete removal of semantic noise is a key factor re…

Weakly-Supervised Semantic Segmentation via Sub-category Exploration

2020-08-03 · CVPR 2020 6 · Yu-Ting Chang, Qiaosong Wang, Wei-Chih Hung, Robinson Piramuthu 외

Existing weakly-supervised semantic segmentation methods using image-level annotations typically rely on initial responses to locate object regions. However, such response maps generated by the classification network usu…

Clustering Object Semantic Segmentation Weakly supervised Semantic Segmentation+1