Generative Modeling for Small-Data Object Detection
This paper explores object detection in the small data regime, where only a limited number of annotated bounding boxes are available due to data rarity and annotation expense. This is a common challenge today with machine learning being applied to many new tasks where obtaining training data is more challenging, e.g. in medical images with rare diseases that doctors sometimes only see once in their life-time. In this work we explore this problem from a generative modeling perspective by learning to generate new images with associated bounding boxes, and using these for training an object detector. We show that simply training previously proposed generative models does not yield satisfactory performance due to them optimizing for image realism rather than object detection accuracy. To this end we develop a new model with a novel unrolling mechanism that jointly optimizes the generative model and a detector such that the generated images improve the performance of the detector. We show this method outperforms the state of the art on two challenging datasets, disease detection and small data pedestrian detection, improving the average precision on NIH Chest X-ray by a relative 20% and localization accuracy by a relative 50%.
Code (1)
Tasks
Objectobject-detectionObject DetectionPedestrian DetectionRolling Shutter CorrectionSmall Data Image ClassificationSimilar Papers 제목 키워드 기반
Perceptual Generative Adversarial Networks for Small Object Detection
Detecting small objects is notoriously challenging due to their low resolution and noisy representation. Existing object detection pipelines usually detect small objects through learning representations of all the object…
Generative Adversarial NetworkObjectobject-detectionObject Detection+1Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
Small CNN-based models usually require transferring knowledge from a large model before they are deployed in computationally resource-limited edge devices. Masked image modeling (MIM) methods achieve great success in var…
image-classificationImage ClassificationKnowledge Distillationobject-detection+2SOD-MTGAN: Small Object Detection via Multi-Task Generative Adversarial Network
Object detection is a fundamental and important problem in computer vision. Although impressive results have been achieved on large/medium sized objects on large-scale detection benchmarks (e.g. the COCO dataset), the pe…
Generative Adversarial NetworkObjectobject-detectionObject Detection+3Deep Generative Model using Unregularized Score for Anomaly Detection with Heterogeneous Complexity
Accurate and automated detection of anomalous samples in a natural image dataset can be accomplished with a probabilistic model for end-to-end modeling of images. Such images have heterogeneous complexity, however, and a…
Anomaly DetectionMitigate Target-level Insensitivity of Infrared Small Target Detection via Posterior Distribution Modeling
Infrared Small Target Detection (IRSTD) aims to segment small targets from infrared clutter background. Existing methods mainly focus on discriminative approaches, i.e., a pixel-level front-background binary segmentation…
Noise Estimation