Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach
We investigate a principle way to progressively mine discriminative object regions using classification networks to address the weakly-supervised semantic segmentation problems. Classification networks are only responsive to small and sparse discriminative regions from the object of interest, which deviates from the requirement of the segmentation task that needs to localize dense, interior and integral regions for pixel-wise inference. To mitigate this gap, we propose a new adversarial erasing approach for localizing and expanding object regions progressively. Starting with a single small object region, our proposed approach drives the classification network to sequentially discover new and complement object regions by erasing the current mined regions in an adversarial manner. These localized regions eventually constitute a dense and complete object region for learning semantic segmentation. To further enhance the quality of the discovered regions by adversarial erasing, an online prohibitive segmentation learning approach is developed to collaborate with adversarial erasing by providing auxiliary segmentation supervision modulated by the more reliable classification scores. Despite its apparent simplicity, the proposed approach achieves 55.0% and 55.7% mean Intersection-over-Union (mIoU) scores on PASCAL VOC 2012 val and test sets, which are the new state-of-the-arts.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationObjectSegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Erasing Integrated Learning: A Simple Yet Effective Approach for Weakly Supervised Object Localization
Weakly supervised object localization (WSOL) aims to localize object with only weak supervision like image-level labels. However, a long-standing problem for available techniques based on the classification network is th…
ClassificationGeneral Classificationimage-classificationImage Classification+3Self-Erasing Network for Integral Object Attention
Recently, adversarial erasing for weakly-supervised object attention has been deeply studied due to its capability in localizing integral object regions. However, such a strategy raises one key problem that attention reg…
ObjectSemantic SegmentationAdversarial Complementary Learning for Weakly Supervised Object Localization
In this work, we propose Adversarial Complementary Learning (ACoL) to automatically localize integral objects of semantic interest with weak supervision. We first mathematically prove that class localization maps can be …
General ClassificationObjectObject LocalizationWeakly-Supervised Object LocalizationKnowledge Transfer with Simulated Inter-Image Erasing for Weakly Supervised Semantic Segmentation
Though adversarial erasing has prevailed in weakly supervised semantic segmentation to help activate integral object regions, existing approaches still suffer from the dilemma of under-activation and over-expansion due t…
ObjectObject DiscoverySemantic SegmentationTransfer Learning+2Find it if You Can: End-to-End Adversarial Erasing for Weakly-Supervised Semantic Segmentation
Semantic segmentation is a task that traditionally requires a large dataset of pixel-level ground truth labels, which is time-consuming and expensive to obtain. Recent advancements in the weakly-supervised setting show t…
Semantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation