Object Discovery with a Copy-Pasting GAN
We tackle the problem of object discovery, where objects are segmented for a given input image, and the system is trained without using any direct supervision whatsoever. A novel copy-pasting GAN framework is proposed, where the generator learns to discover an object in one image by compositing it into another image such that the discriminator cannot tell that the resulting image is fake. After carefully addressing subtle issues, such as preventing the generator from `cheating', this game results in the generator learning to select objects, as copy-pasting objects is most likely to fool the discriminator. The system is shown to work well on four very different datasets, including large object appearance variations in challenging cluttered backgrounds.
Code (1)
Tasks
ObjectObject DiscoveryUnsupervised Object SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DeePaste -- Inpainting for Pasting
One of the challenges of supervised learning training is the need to procure an substantial amount of tagged data. A well-known method of solving this problem is to use synthetic data in a copy-paste fashion, so that we …
Foreground SegmentationSimple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation
Building instance segmentation models that are data-efficient and can handle rare object categories is an important challenge in computer vision. Leveraging data augmentations is a promising direction towards addressing …
Data AugmentationImage AugmentationInstance SegmentationObject Detection+2Improving Crowded Object Detection via Copy-Paste
Crowdedness caused by overlapping among similar objects is a ubiquitous challenge in the field of 2D visual object detection. In this paper, we first underline two main effects of the crowdedness issue: 1) IoU-confidence…
Data AugmentationObjectobject-detectionObject DetectionAugmentation for small object detection
In recent years, object detection has experienced impressive progress. Despite these improvements, there is still a significant gap in the performance between the detection of small and large objects. We analyze the curr…
Instance SegmentationObjectobject-detectionObject Detection+2Learning Co-segmentation by Segment Swapping for Retrieval and Discovery
The goal of this work is to efficiently identify visually similar patterns in images, e.g. identifying an artwork detail copied between an engraving and an oil painting, or recognizing parts of a night-time photograph vi…
Graph ClusteringObject DiscoveryRetrievalSpectral Graph Clustering+1