paper-with-me

Papers

Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentation

2022-09-16 · Jinlong Li, Zequn Jie, Xu Wang, Xiaolin Wei, Lin Ma

Generating precise class-aware pseudo ground-truths, a.k.a, class activation maps (CAMs), is essential for weakly-supervised semantic segmentation. The original CAM method usually produces incomplete and inaccurate localization maps. To tackle with this issue, this paper proposes an Expansion and Shrinkage scheme based on the offset learning in the deformable convolution, to sequentially improve the recall and precision of the located object in the two respective stages. In the Expansion stage, an offset learning branch in a deformable convolution layer, referred as "expansion sampler" seeks for sampling increasingly less discriminative object regions, driven by an inverse supervision signal that maximizes image-level classification loss. The located more complete object in the Expansion stage is then gradually narrowed down to the final object region during the Shrinkage stage. In the Shrinkage stage, the offset learning branch of another deformable convolution layer, referred as "shrinkage sampler", is introduced to exclude the false positive background regions attended in the Expansion stage to improve the precision of the localization maps. We conduct various experiments on PASCAL VOC 2012 and MS COCO 2014 to well demonstrate the superiority of our method over other state-of-the-art methods for weakly-supervised semantic segmentation. Code will be made publicly available here https://github.com/TyroneLi/ESOL_WSSS.

📄 PDF Abstract BibTeX arXiv:2209.07761

Code (1)

tyroneli/esol_wsss 공식 구현

Tasks

ObjectSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…

Similar Papers 제목 키워드 기반

Spatial Structure Constraints for Weakly Supervised Semantic Segmentation

2024-01-20 · Tao Chen, Yazhou Yao, Xingguo Huang, Zechao Li 외

The image-level label has prevailed in weakly supervised semantic segmentation tasks due to its easy availability. Since image-level labels can only indicate the existence or absence of specific categories of objects, vi…

ObjectObject LocalizationSemantic SegmentationWeakly supervised Semantic Segmentation+1

DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation

2025-12-11 · Anh M. Vu, Khang P. Le, Trang T. K. Vo, Ha Thach 외 arxiv

Weakly supervised semantic segmentation (WSSS) in histopathology seeks to reduce annotation cost by learning from image-level labels, yet it remains limited by inter-class homogeneity, intra-class heterogeneity, and the …

Semantic SegmentationImage Segmentation

Knowledge Transfer with Simulated Inter-Image Erasing for Weakly Supervised Semantic Segmentation

2024-07-03 · Tao Chen, Xiruo Jiang, Gensheng Pei, Zeren Sun 외

Though adversarial erasing has prevailed in weakly supervised semantic segmentation to help activate integral object regions, existing approaches still suffer from the dilemma of under-activation and over-expansion due t…

ObjectObject DiscoverySemantic SegmentationTransfer Learning+2

UM-CAM: Uncertainty-weighted Multi-resolution Class Activation Maps for Weakly-supervised Fetal Brain Segmentation

2023-06-20 · Jia Fu, Tao Lu, Shaoting Zhang, Guotai Wang

Accurate segmentation of the fetal brain from Magnetic Resonance Image (MRI) is important for prenatal assessment of fetal development. Although deep learning has shown the potential to achieve this task, it requires a l…

Brain SegmentationWeakly supervised segmentation

Anti-Adversarially Manipulated Attributions for Weakly Supervised Semantic Segmentation and Object Localization

2022-04-11 · Jungbeom Lee, Eunji Kim, Jisoo Mok, Sungroh Yoon

Obtaining accurate pixel-level localization from class labels is a crucial process in weakly supervised semantic segmentation and object localization. Attribution maps from a trained classifier are widely used to provide…

Adversarial AttackObjectObject LocalizationSemantic Segmentation+4