ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data
This work introduces a novel strategy for generating synthetic training data for 2D and 3D pose estimation of animals using keyframe animations. With the objective to automate the process of creating animations for wildlife, we train several 2D and 3D pose estimation models with synthetic data, and put in place an end-to-end pipeline called ZooBuilder. The pipeline takes as input a video of an animal in the wild, and generates the corresponding 2D and 3D coordinates for each joint of the animal's skeleton. With this approach, we produce motion capture data that can be used to create animations for wildlife.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Prior-Aware Synthetic Data to the Rescue: Animal Pose Estimation with Very Limited Real Data
Accurately annotated image datasets are essential components for studying animal behaviors from their poses. Compared to the number of species we know and may exist, the existing labeled pose datasets cover only a small …
Animal Pose EstimationKeypoint EstimationPose EstimationSemantic Segmentation+2An adaptive hierarchical control framework for quadrupedal robots in planetary exploration
Planetary exploration missions require robots capable of navigating extreme and unknown environments. While wheeled rovers have dominated past missions, their mobility is limited to traversable surfaces. Legged robots, e…
Generative Zoo
The model-based estimation of 3D animal pose and shape from images enables computational modeling of animal behavior. Training models for this purpose requires large amounts of labeled image data with precise pose and sh…
Conditional Image GenerationImage GenerationSynthetic Data GenerationRGBD-Dog: Predicting Canine Pose from RGBD Sensors
The automatic extraction of animal \reb{3D} pose from images without markers is of interest in a range of scientific fields. Most work to date predicts animal pose from RGB images, based on 2D labelling of joint position…
Pose EstimationPose PredictionAniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer
In the era of foundation models, achieving a unified understanding of different dynamic objects through a single network has the potential to empower stronger spatial intelligence. Moreover, accurate estimation of animal…
Conditional Image Generation