Weakly Supervised Localization Using Background Images
Weakly Supervised Object Localization (WSOL) methodsusually rely on fully convolutional networks in order to ob-tain class activation maps(CAMs) of targeted labels. How-ever, these networks always highlight the most discriminativeparts to perform the task, the located areas are much smallerthan entire targeted objects. In this work, we propose a novelend-to-end model to enlarge CAMs generated from classifi-cation models, which can localize targeted objects more pre-cisely. In detail, we add an additional module in traditionalclassification networks to extract foreground object propos-als from images without classifying them into specific cate-gories. Then we set these normalized regions as unrestrictedpixel-level mask supervision for the following classificationtask. We collect a set of images defined as Background ImageSet from the Internet. The number of them is much smallerthan the targeted dataset but surprisingly well supports themethod to extract foreground regions from different pictures.The region extracted is independent from classification task,where the extracted region in each image covers almost en-tire object rather than just a significant part. Therefore, theseregions can serve as masks to supervise the response mapgenerated from classification models to become larger andmore precise. The method achieves state-of-the-art results onCUB-200-2011 in terms of Top-1 and Top-5 localization er-ror while has a competitive result on ILSVRC2016 comparedwith other approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject LocalizationWeakly-Supervised Object LocalizationSimilar Papers 제목 키워드 기반
Background-aware Classification Activation Map for Weakly Supervised Object Localization
Weakly supervised object localization (WSOL) relaxes the requirement of dense annotations for object localization by using image-level classification masks to supervise its learning process. However, current WSOL methods…
ClassificationObjectObject LocalizationWeakly-Supervised Object LocalizationMinMaxCAM: Improving object coverage for CAM-basedWeakly Supervised Object Localization
One of the most common problems of weakly supervised object localization is that of inaccurate object coverage. In the context of state-of-the-art methods based on Class Activation Mapping, this is caused either by local…
ObjectObject LocalizationWeakly-Supervised Object LocalizationWeakly-Supervised Temporal Action Localization Through Local-Global Background Modeling
Weakly-Supervised Temporal Action Localization (WS-TAL) task aims to recognize and localize temporal starts and ends of action instances in an untrimmed video with only video-level label supervision. Due to lack of negat…
Action LocalizationTemporal Action LocalizationWeakly-supervised LearningWeakly-supervised Temporal Action LocalizationDenoising Diffusion Models for Anomaly Localization in Medical Images
This chapter explores anomaly localization in medical images using denoising diffusion models. After providing a brief methodological background of these models, including their application to image reconstruction and th…
Anomaly LocalizationDenoisingImage ReconstructionCross-Attentional Audio-Visual Fusion for Weakly-Supervised Action Localization
Temporally localizing actions in videos is one of the key components for video understanding. Learning from weakly-labelled data is seen a potential solution towards avoiding expensive frame-level annotations. Different …
Action LocalizationVideo UnderstandingWeakly Supervised Action Localization