StuffNet: Using 'Stuff' to Improve Object Detection
We propose a Convolutional Neural Network (CNN) based algorithm - StuffNet - for object detection. In addition to the standard convolutional features trained for region proposal and object detection [31], StuffNet uses convolutional features trained for segmentation of objects and 'stuff' (amorphous categories such as ground and water). Through experiments on Pascal VOC 2010, we show the importance of features learnt from stuff segmentation for improving object detection performance. StuffNet improves performance from 18.8% mAP to 23.9% mAP for small objects. We also devise a method to train StuffNet on datasets that do not have stuff segmentation labels. Through experiments on Pascal VOC 2007 and 2012, we demonstrate the effectiveness of this method and show that StuffNet also significantly improves object detection performance on such datasets.
Code (1)
Tasks
Objectobject-detectionObject DetectionRegion ProposalSegmentationSimilar Papers 제목 키워드 기반
COCO-Stuff: Thing and Stuff Classes in Context
Semantic classes can be either things (objects with a well-defined shape, e.g. car, person) or stuff (amorphous background regions, e.g. grass, sky). While lots of classification and detection works focus on thing classe…
Image CaptioningSemantic SegmentationSuperpixelsToward Joint Thing-and-Stuff Mining for Weakly Supervised Panoptic Segmentation
Panoptic segmentation aims to partition an image to object instances and semantic content for thing and stuff categories, respectively. To date, learning weakly supervised panoptic segmentation (WSPS) with only image…
Instance SegmentationMultiple Instance LearningObjectobject-detection+6Context-Aware Layout to Image Generation with Enhanced Object Appearance
A layout to image (L2I) generation model aims to generate a complicated image containing multiple objects (things) against natural background (stuff), conditioned on a given layout. Built upon the recent advances in gene…
Image GenerationLayout-to-Image GenerationObjectScene Parsing Through ADE20K Dataset
Scene parsing, or recognizing and segmenting objects and stuff in an image, is one of the key problems in computer vision. Despite the community's efforts in data collection, there are still few image datasets covering a…
ObjectScene ParsingSegmentationWeakly Supervised Object Localization Using Things and Stuff Transfer
We propose to help weakly supervised object localization for classes where location annotations are not available, by transferring things and stuff knowledge from a source set with available annotations. The source and t…
Multiple Instance LearningObjectObject LocalizationSegmentation+1