Salvage of Supervision in Weakly Supervised Object Detection
Weakly supervised object detection~(WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoS-WSOD achieves 64.4 $m\text{AP}_{50}$ on VOC2007, 61.9 $m\text{AP}_{50}$ on VOC2012 and 16.6 $m\text{AP}_{50:95}$ on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionSemi-Supervised Object DetectionWeakly Supervised Object DetectionSimilar Papers 제목 키워드 기반
Min-Entropy Latent Model for Weakly Supervised Object Detection
Weakly supervised object detection is a challenging task when provided with image category supervision but required to learn, at the same time, object locations and object detectors. The inconsistency between the weak su…
image-classificationImage ClassificationObjectobject-detection+4Multiple Instance Detection Network with Online Instance Classifier Refinement
Of late, weakly supervised object detection is with great importance in object recognition. Based on deep learning, weakly supervised detectors have achieved many promising results. However, compared with fully supervise…
Multiple Instance LearningObjectobject-detectionObject Detection+2Object Discovery via Contrastive Learning for Weakly Supervised Object Detection
Weakly Supervised Object Detection (WSOD) is a task that detects objects in an image using a model trained only on image-level annotations. Current state-of-the-art models benefit from self-supervised instance-level supe…
Contrastive LearningObjectObject DetectionObject Discovery+1Learning Better Visual Representations for Weakly-Supervised Object Detection Using Natural Language Supervision
We present a framework to better leverage natural language supervision for a specific downstream task, namely weakly-supervised object detection (WSOD). Our framework employs a multimodal pre-training step, during which …
cross-modal alignmentobject-detectionObject DetectionRepresentation Learning+1Detecting Human-Object Interaction with Mixed Supervision
Human object interaction (HOI) detection is an important task in image understanding and reasoning. It is in a form of HOI triplet <human; verb; object>, requiring bounding boxes for human and object, and action between …
Human-Object Interaction DetectionObjectTripletWeakly-supervised Learning