Shape2Animal: Creative Animal Generation from Natural Silhouettes
Humans possess a unique ability to perceive meaningful patterns in ambiguous stimuli, a cognitive phenomenon known as pareidolia. This paper introduces Shape2Animal framework to mimics this imaginative capacity by reinterpreting natural object silhouettes, such as clouds, stones, or flames, as plausible animal forms. Our automated framework first performs open-vocabulary segmentation to extract object silhouette and interprets semantically appropriate animal concepts using vision-language models. It then synthesizes an animal image that conforms to the input shape, leveraging text-to-image diffusion model and seamlessly blends it into the original scene to generate visually coherent and spatially consistent compositions. We evaluated Shape2Animal on a diverse set of real-world inputs, demonstrating its robustness and creative potential. Our Shape2Animal can offer new opportunities for visual storytelling, educational content, digital art, and interactive media design. Our project page is here: https://shape2image.github.io
Code (0)
등록된 구현이 없습니다.
Tasks
Visual StorytellingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Lions and Tigers and Bears: Capturing Non-Rigid, 3D, Articulated Shape From Images
Animals are widespread in nature and the analysis of their shape and motion is important in many fields and industries. Modeling 3D animal shape, however, is difficult because the 3D scanning methods used to capture huma…
C3DAG: Controlled 3D Animal Generation using 3D pose guidance
Recent advancements in text-to-3D generation have demonstrated the ability to generate high quality 3D assets. However while generating animals these methods underperform, often portraying inaccurate anatomy and geometry…
3D GenerationAnatomyNeRFText to 3DThree-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"
We present the first method to perform automatic 3D pose, shape and texture capture of animals from images acquired in-the-wild. In particular, we focus on the problem of capturing 3D information about Grevy's zebras fro…
Pose EstimationTexture SynthesisDessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images
In recent years, 3D parametric animal models have been developed to aid in estimating 3D shape and pose from images and video. While progress has been made for humans, it's more challenging for animals due to limited ann…
DisentanglementPose EstimationSynthetic Data GenerationTexture SynthesisAnimal3D: A Comprehensive Dataset of 3D Animal Pose and Shape
Accurately estimating the 3D pose and shape is an essential step towards understanding animal behavior, and can potentially benefit many downstream applications, such as wildlife conservation. However, research in this a…
Animal Pose EstimationPose Estimation