paper-with-me

Papers

YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals

2024-06-24 · Sandeep Mishra, Oindrila Saha, Alan C. Bovik

3D generation guided by text-to-image diffusion models enables the creation of visually compelling assets. However previous methods explore generation based on image or text. The boundaries of creativity are limited by what can be expressed through words or the images that can be sourced. We present YouDream, a method to generate high-quality anatomically controllable animals. YouDream is guided using a text-to-image diffusion model controlled by 2D views of a 3D pose prior. Our method generates 3D animals that are not possible to create using previous text-to-3D generative methods. Additionally, our method is capable of preserving anatomic consistency in the generated animals, an area where prior text-to-3D approaches often struggle. Moreover, we design a fully automated pipeline for generating commonly found animals. To circumvent the need for human intervention to create a 3D pose, we propose a multi-agent LLM that adapts poses from a limited library of animal 3D poses to represent the desired animal. A user study conducted on the outcomes of YouDream demonstrates the preference of the animal models generated by our method over others. Turntable results and code are released at https://youdream3d.github.io/

📄 PDF Abstract BibTeX arXiv:2406.16273

Code (0)

등록된 구현이 없습니다.

Tasks

3D GenerationText to 3D

Methods 이 논문이 사용한 방법론

Library 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation

2026-03-23 · Delin An, Chaoli Wang arxiv

Diffusion probabilistic models have demonstrated significant potential in generating high-quality, realistic medical images, providing a promising solution to the persistent challenge of data scarcity in the medical fiel…

AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation

2026-08-24 · Huiwen Han, Lulin Liu, Bangya Liu, Yuanhao Cai 외 arxiv

3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis. However, existing generative models typically synthesize 3D volumes monolithically, often overlo…

Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling

2026-06-08 · Yiheng Cao, Gustavo Andrade-Miranda, Jiatian Zhang, Guillaume Sallé 외 arxiv

Cine cardiac magnetic resonance is the gold standard for assessing cardiac function, but the scarcity of public datasets limits the development of advanced data-driven models. To address this limitation, we propose a gen…

Video Generation

CLAIM: Clinically-Guided LGE Augmentation for Realistic and Diverse Myocardial Scar Synthesis and Segmentation

2025-06-18 · Farheen Ramzan, Yusuf Kiberu, Nikesh Jathanna, Shahnaz Jamil-Copley 외

Deep learning-based myocardial scar segmentation from late gadolinium enhancement (LGE) cardiac MRI has shown great potential for accurate and timely diagnosis and treatment planning for structural cardiac diseases. Howe…

Clinical KnowledgeSegmentation

Controllable Video Generation by Learning the Underlying Dynamical System with Neural ODE

2023-03-09 · Yucheng Xu, Li Nanbo, Arushi Goel, Zijian Guo 외

Videos depict the change of complex dynamical systems over time in the form of discrete image sequences. Generating controllable videos by learning the dynamical system is an important yet underexplored topic in the comp…

Video Generation