CaT: Weakly Supervised Object Detection with Category Transfer
A large gap exists between fully-supervised object detection and weakly-supervised object detection. To narrow this gap, some methods consider knowledge transfer from additional fully-supervised dataset. But these methods do not fully exploit discriminative category information in the fully-supervised dataset, thus causing low mAP. To solve this issue, we propose a novel category transfer framework for weakly supervised object detection. The intuition is to fully leverage both visually-discriminative and semantically-correlated category information in the fully-supervised dataset to enhance the object-classification ability of a weakly-supervised detector. To handle overlapping category transfer, we propose a double-supervision mean teacher to gather common category information and bridge the domain gap between two datasets. To handle non-overlapping category transfer, we propose a semantic graph convolutional network to promote the aggregation of semantic features between correlated categories. Experiments are conducted with Pascal VOC 2007 as the target weakly-supervised dataset and COCO as the source fully-supervised dataset. Our category transfer framework achieves 63.5% mAP and 80.3% CorLoc with 5 overlapping categories between two datasets, which outperforms the state-of-the-art methods. Codes are avaliable at https://github.com/MediaBrain-SJTU/CaT.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionTransfer LearningWeakly Supervised Object DetectionSimilar Papers 제목 키워드 기반
Cross Pseudo Labeling For Weakly Supervised Video Anomaly Detection
Weakly supervised video anomaly detection aims to detect anomalies and identify abnormal categories with only video-level labels. We propose CPL-VAD, a dual-branch framework with cross pseudo labeling. The binary anomaly…
Video Anomaly DetectionTransfer Learning from LDA to BiLSTM-CNN for Offensive Language Detection in Twitter
We investigate different strategies for automatic offensive language classification on German Twitter data. For this, we employ a sequentially combined BiLSTM-CNN neural network. Based on this model, three transfer learn…
ClusteringGeneral ClassificationTransfer LearningPrompt3D: Random Prompt Assisted Weakly-Supervised 3D Object Detection
The prohibitive cost of annotations for fully supervised 3D indoor object detection limits its practicality. In this work we propose Random Prompt Assisted Weakly-supervised 3D Object Detection termed as Prompt3D a w…
3D Object Detectionobject-detectionObject DetectionScene GenerationMin-Entropy Latent Model for Weakly Supervised Object Detection
Weakly supervised object detection is a challenging task when provided with image category supervision but required to learn, at the same time, object locations and object detectors. The inconsistency between the weak su…
image-classificationImage ClassificationObjectobject-detection+4Weakly Supervised Object Detection with Segmentation Collaboration
Weakly supervised object detection aims at learning precise object detectors, given image category labels. In recent prevailing works, this problem is generally formulated as a multiple instance learning module guided by…
General Classificationimage-classificationImage ClassificationMultiple Instance Learning+5