Object Detection using Domain Randomization and Generative Adversarial Refinement of Synthetic Images
In this work, we present an application of domain randomization and generative adversarial networks (GAN) to train a near real-time object detector for industrial electric parts, entirely in a simulated environment. Large scale availability of labelled real world data is typically rare and difficult to obtain in many industrial settings. As such here, only a few hundred of unlabelled real images are used to train a Cyclic-GAN network, in combination with various degree of domain randomization procedures. We demonstrate that this enables robust translation of synthetic images to the real world domain. We show that a combination of the original synthetic (simulation) and GAN translated images, when used for training a Mask-RCNN object detection network achieves greater than 0.95 mean average precision in detecting and classifying a collection of industrial electric parts. We evaluate the performance across different combinations of training data.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionTranslationSimilar Papers 제목 키워드 기반
Adversarial Domain Randomization
Domain Randomization (DR) is known to require a significant amount of training data for good performance. We argue that this is due to DR's strategy of random data generation using a uniform distribution over simulation …
Domain Adaptationimage-classificationImage Classificationobject-detection+1Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data
We present structured domain randomization (SDR), a variant of domain randomization (DR) that takes into account the structure and context of the scene. In contrast to DR, which places objects and distractors randomly ac…
Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Study
This paper addresses key aspects of domain randomization in generating synthetic data for manufacturing object detection applications. To this end, we present a comprehensive data generation pipeline that reflects differ…
Objectobject-detectionObject DetectionObject Detection Using Sim2Real Domain Randomization for Robotic Applications
Robots working in unstructured environments must be capable of sensing and interpreting their surroundings. One of the main obstacles of deep-learning-based models in the field of robotics is the lack of domain-specific …
GPUobject-detectionObject DetectionTransfer LearningDistributionally Robust Policy Learning via Adversarial Environment Generation
Our goal is to train control policies that generalize well to unseen environments. Inspired by the Distributionally Robust Optimization (DRO) framework, we propose DRAGEN - Distributionally Robust policy learning via Adv…