paper-with-me

Papers

Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute

2024-01-01 · Chaoqun Gong, Yuqin Dai, Ronghui Li, Achun Bao, Jun Li, Jian Yang, Yachao Zhang, Xiu Li

Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and the scarcity of realistic 3D human avatar datasets. To address these issues, we propose Text2Avatar, which can generate realistic-style 3D avatars based on the coupled text prompts. Text2Avatar leverages a discrete codebook as an intermediate feature to establish a connection between text and avatars, enabling the disentanglement of features. Furthermore, to alleviate the scarcity of realistic style 3D human avatar data, we utilize a pre-trained unconditional 3D human avatar generation model to obtain a large amount of 3D avatar pseudo data, which allows Text2Avatar to achieve realistic style generation. Experimental results demonstrate that our method can generate realistic 3D avatars from coupled textual data, which is challenging for other existing methods in this field.

📄 PDF Abstract BibTeX arXiv:2401.00711

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeDisentanglementText to 3Dtext-to-3d-human

Similar Papers 제목 키워드 기반

MagicAvatar: Multimodal Avatar Generation and Animation

2023-08-28 · Jianfeng Zhang, Hanshu Yan, Zhongcong Xu, Jiashi Feng 외

This report presents MagicAvatar, a framework for multimodal video generation and animation of human avatars. Unlike most existing methods that generate avatar-centric videos directly from multimodal inputs (e.g., text p…

Video Generation

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars

2022-05-17 · Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai 외

3D avatar creation plays a crucial role in the digital age. However, the whole production process is prohibitively time-consuming and labor-intensive. To democratize this technology to a larger audience, we propose Avata…

3D geometryLanguage ModellingMotion SynthesisTexture Synthesis

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation

2023-06-16 · Yifei Zeng, Yuanxun Lu, Xinya Ji, Yao Yao 외

We introduce AvatarBooth, a novel method for generating high-quality 3D avatars using text prompts or specific images. Unlike previous approaches that can only synthesize avatars based on simple text descriptions, our me…

Text to 3D

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models

2023-04-03 · CVPR 2024 1 · Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan 외

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common obje…

NeRF

SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance

2023-12-13 · Yuanyou Xu, Zongxin Yang, Yi Yang

Powered by large-scale text-to-image generation models, text-to-3D avatar generation has made promising progress. However, most methods fail to produce photorealistic results, limited by imprecise geometry and low-qualit…

Image GenerationPrompt EngineeringText to 3DText to Image Generation+1