Birth and Death of a Rose
We study the problem of generating temporal object intrinsics -- temporally evolving sequences of object geometry, reflectance, and texture, such as a blooming rose -- from pre-trained 2D foundation models. Unlike conventional 3D modeling and animation techniques that require extensive manual effort and expertise, we introduce a method that generates such assets with signals distilled from pre-trained 2D diffusion models. To ensure the temporal consistency of object intrinsics, we propose Neural Templates for temporal-state-guided distillation, derived automatically from image features from self-supervised learning. Our method can generate high-quality temporal object intrinsics for several natural phenomena and enable the sampling and controllable rendering of these dynamic objects from any viewpoint, under any environmental lighting conditions, at any time of their lifespan. Project website: https://chen-geng.com/rose4d
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Dynamics of advantageous mutant spread in spatial death-birth and birth-death Moran models
The spread of an advantageous mutation through a population is of fundamental interest in population genetics. While the classical Moran model is formulated for a well-mixed population, it has long been recognized that i…
Inferring birth versus death dynamics for ecological interactions in stochastic heterogeneous populations
In this paper, we study the significance of ecological interactions and separation of birth and death dynamics in stochastic heterogeneous populations via general birth-death processes. Interactions can manifest through …
Time SeriesAmplifiers of selection for the Moran process with both Birth-death and death-Birth updating
Populations evolve by accumulating advantageous mutations. Every population has some spatial structure that can be modeled by an underlying network. The network then influences the probability that new advantageous mutat…
Exact steady-state distributions of multispecies birth-death-immigration processes: effects of mutations and carrying capacity on diversity
Stochastic models that incorporate birth, death and immigration (also called birth-death and innovation models) are ubiquitous and applicable to many research topics such as quantifying species sizes in ecological popula…
DiversityUnderstanding the rift between update rules in Evolutionary Graph Theory: The intrinsic death rate drives star graphs from amplifying to suppressing natural selection
Evolutionary graph theory is the study of evolutionary dynamics in structured populations. A well-known problem in evolutionary graph theory is that the spread of mutation (measured by fixation probability) is impacted b…