SynPlay: Importing Real-world Diversity for a Synthetic Human Dataset
We introduce Synthetic Playground (SynPlay), a new synthetic human dataset that aims to bring out the diversity of human appearance in the real world. We focus on two factors to achieve a level of diversity that has not yet been seen in previous works: i) realistic human motions and poses and ii) multiple camera viewpoints towards human instances. We first use a game engine and its library-provided elementary motions to create games where virtual players can take less-constrained and natural movements while following the game rules (i.e., rule-guided motion design as opposed to detail-guided design). We then augment the elementary motions with real human motions captured with a motion capture device. To render various human appearances in the games from multiple viewpoints, we use seven virtual cameras encompassing the ground and aerial views, capturing abundant aerial-vs-ground and dynamic-vs-static attributes of the scene. Through extensive and carefully-designed experiments, we show that using SynPlay in model training leads to enhanced accuracy over existing synthetic datasets for human detection and segmentation. The benefit of SynPlay becomes even greater for tasks in the data-scarce regime, such as few-shot and cross-domain learning tasks. These results clearly demonstrate that SynPlay can be used as an essential dataset with rich attributes of complex human appearances and poses suitable for model pretraining. SynPlay dataset comprising over 73k images and 6.5M human instances, is available for download at https://synplaydataset.github.io/.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityHuman DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ModTrans: Translating Real-world Models for Distributed Training Simulator
Large-scale distributed training has been a research hot spot in machine learning systems for industry and academia in recent years. However, conducting experiments without physical machines and corresponding resources i…
Exploring Precision and Recall to assess the quality and diversity of LLMs
We introduce a novel evaluation framework for Large Language Models (LLMs) such as \textsc{Llama-2} and \textsc{Mistral}, focusing on importing Precision and Recall metrics from image generation to text generation. This …
DiversityImage GenerationText GenerationWind Turbine Feature Detection Using Deep Learning and Synthetic Data
For the autonomous drone-based inspection of wind turbine (WT) blades, accurate detection of the WT and its key features is essential for safe drone positioning and collision avoidance. Existing deep learning methods typ…
Collision AvoidanceBridging the Gap: Enhancing the Utility of Synthetic Data via Post-Processing Techniques
Acquiring and annotating suitable datasets for training deep learning models is challenging. This often results in tedious and time-consuming efforts that can hinder research progress. However, generative models have eme…
DiversityLearning to Import through Production Networks
Using administrative data on the universe of inter-firm transactions in Spain, we show that firms learn to import from their domestic suppliers and customers. Our identification strategy exploits the panel structure of t…