paper-with-me

Papers

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation

2023-06-16 · Yifei Zeng, Yuanxun Lu, Xinya Ji, Yao Yao, Hao Zhu, Xun Cao

We introduce AvatarBooth, a novel method for generating high-quality 3D avatars using text prompts or specific images. Unlike previous approaches that can only synthesize avatars based on simple text descriptions, our method enables the creation of personalized avatars from casually captured face or body images, while still supporting text-based model generation and editing. Our key contribution is the precise avatar generation control by using dual fine-tuned diffusion models separately for the human face and body. This enables us to capture intricate details of facial appearance, clothing, and accessories, resulting in highly realistic avatar generations. Furthermore, we introduce pose-consistent constraint to the optimization process to enhance the multi-view consistency of synthesized head images from the diffusion model and thus eliminate interference from uncontrolled human poses. In addition, we present a multi-resolution rendering strategy that facilitates coarse-to-fine supervision of 3D avatar generation, thereby enhancing the performance of the proposed system. The resulting avatar model can be further edited using additional text descriptions and driven by motion sequences. Experiments show that AvatarBooth outperforms previous text-to-3D methods in terms of rendering and geometric quality from either text prompts or specific images. Please check our project website at https://zeng-yifei.github.io/avatarbooth_page/.

📄 PDF Abstract BibTeX arXiv:2306.09864

Code (0)

등록된 구현이 없습니다.

Tasks

Text to 3D

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion

2024-05-18 · Zeyu Zhang, Yiran Wang, Biao Wu, Shuo Chen 외

In recent years, there has been significant interest in creating 3D avatars and motions, driven by their diverse applications in areas like film-making, video games, AR/VR, and human-robot interaction. However, current e…

Motion Generation

SmartAvatar: Text- and Image-Guided Human Avatar Generation with VLM AI Agents

2025-06-05 · Alexander Huang-Menders, Xinhang Liu, Andy Xu, Yuyao Zhang 외

SmartAvatar is a vision-language-agent-driven framework for generating fully rigged, animation-ready 3D human avatars from a single photo or textual prompt. While diffusion-based methods have made progress in general 3D …

Attribute

NECA: Neural Customizable Human Avatar

2024-03-15 · CVPR 2024 1 · Junjin Xiao, Qing Zhang, Zhan Xu, Wei-Shi Zheng

Human avatar has become a novel type of 3D asset with various applications. Ideally, a human avatar should be fully customizable to accommodate different settings and environments. In this work, we introduce NECA, an app…

Learning Locally Editable Virtual Humans

2023-04-28 · CVPR 2023 1 · Hsuan-I Ho, Lixin Xue, Jie Song, Otmar Hilliges

In this paper, we propose a novel hybrid representation and end-to-end trainable network architecture to model fully editable and customizable neural avatars. At the core of our work lies a representation that combines t…

Decoder

Customizable Avatars with Dynamic Facial Action Coded Expressions (CADyFACE) for Improved User Engagement

2024-03-12 · Megan A. Witherow, Crystal Butler, Winston J. Shields, Furkan Ilgin 외

Customizable 3D avatar-based facial expression stimuli may improve user engagement in behavioral biomarker discovery and therapeutic intervention for autism, Alzheimer's disease, facial palsy, and more. However, there is…

Feature Correlation