paper-with-me

Papers

$E^{3}$Gen: Efficient, Expressive and Editable Avatars Generation

2024-05-29 · Weitian Zhang, Yichao Yan, Yunhui Liu, Xingdong Sheng, Xiaokang Yang

This paper aims to introduce 3D Gaussian for efficient, expressive, and editable digital avatar generation. This task faces two major challenges: (1) The unstructured nature of 3D Gaussian makes it incompatible with current generation pipelines; (2) the expressive animation of 3D Gaussian in a generative setting that involves training with multiple subjects remains unexplored. In this paper, we propose a novel avatar generation method named $E^3$Gen, to effectively address these challenges. First, we propose a novel generative UV features plane representation that encodes unstructured 3D Gaussian onto a structured 2D UV space defined by the SMPL-X parametric model. This novel representation not only preserves the representation ability of the original 3D Gaussian but also introduces a shared structure among subjects to enable generative learning of the diffusion model. To tackle the second challenge, we propose a part-aware deformation module to achieve robust and accurate full-body expressive pose control. Extensive experiments demonstrate that our method achieves superior performance in avatar generation and enables expressive full-body pose control and editing. Our project page is https://olivia23333.github.io/E3Gen.

📄 PDF Abstract BibTeX arXiv:2405.19203

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

AttriHuman-3D: Editable 3D Human Avatar Generation with Attribute Decomposition and Indexing

2023-12-03 · CVPR 2024 1 · Fan Yang, Tianyi Chen, Xiaosheng He, Zhongang Cai 외

Editable 3D-aware generation, which supports user-interacted editing, has witnessed rapid development recently. However, existing editable 3D GANs either fail to achieve high-accuracy local editing or suffer from huge co…

AttributeDisentanglement

GenEAva: Generating Cartoon Avatars with Fine-Grained Facial Expressions from Realistic Diffusion-based Faces

2025-04-10 · Hao Yu, Rupayan Mallick, Margrit Betke, Sarah Adel Bargal

Cartoon avatars have been widely used in various applications, including social media, online tutoring, and gaming. However, existing cartoon avatar datasets and generation methods struggle to present highly expressive a…

TADA! Text to Animatable Digital Avatars

2023-08-21 · Tingting Liao, Hongwei Yi, Yuliang Xiu, Jiaxaing Tang 외

We introduce TADA, a simple-yet-effective approach that takes textual descriptions and produces expressive 3D avatars with high-quality geometry and lifelike textures, that can be animated and rendered with traditional g…

DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion

2024-09-25 · Yukun Huang, Jianan Wang, Ailing Zeng, Zheng-Jun Zha 외

Leveraging pretrained 2D diffusion models and score distillation sampling (SDS), recent methods have shown promising results for text-to-3D avatar generation. However, generating high-quality 3D avatars capable of expres…

Text to 3D

Generating Editable Head Avatars with 3D Gaussian GANs

2024-12-26 · Guohao Li, Hongyu Yang, Yifang Men, Di Huang 외

Generating animatable and editable 3D head avatars is essential for various applications in computer vision and graphics. Traditional 3D-aware generative adversarial networks (GANs), often using implicit fields like Neur…

3DGSNeRF