paper-with-me

홈 › Papers

EasyCraft: A Robust and Efficient Framework for Automatic Avatar Crafting

2025-03-03 · CVPR 2025 1 · Suzhen Wang, WeiJie Chen, Wei zhang, Minda Zhao, Lincheng Li, Rongsheng Zhang, Zhipeng Hu, Xin Yu

Character customization, or 'face crafting,' is a vital feature in role-playing games (RPGs), enhancing player engagement by enabling the creation of personalized avatars. Existing automated methods often struggle with generalizability across diverse game engines due to their reliance on the intermediate constraints of specific image domain and typically support only one type of input, either text or image. To overcome these challenges, we introduce EasyCraft, an innovative end-to-end feedforward framework that automates character crafting by uniquely supporting both text and image inputs. Our approach employs a translator capable of converting facial images of any style into crafting parameters. We first establish a unified feature distribution in the translator's image encoder through self-supervised learning on a large-scale dataset, enabling photos of any style to be embedded into a unified feature representation. Subsequently, we map this unified feature distribution to crafting parameters specific to a game engine, a process that can be easily adapted to most game engines and thus enhances EasyCraft's generalizability. By integrating text-to-image techniques with our translator, EasyCraft also facilitates precise, text-based character crafting. EasyCraft's ability to integrate diverse inputs significantly enhances the versatility and accuracy of avatar creation. Extensive experiments on two RPG games demonstrate the effectiveness of our method, achieving state-of-the-art results and facilitating adaptability across various avatar engines.

📄 PDF Abstract BibTeX arXiv:2503.01158

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

HeadSculpt: Crafting 3D Head Avatars with Text

2023-06-05 · NeurIPS 2023 11

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. Howeve…

Reality's Canvas, Language's Brush: Crafting 3D Avatars from Monocular Video

2023-12-08 · Yuchen Rao, Eduardo Perez Pellitero, Benjamin Busam, Yiren Zhou 외

Recent advancements in 3D avatar generation excel with multi-view supervision for photorealistic models. However, monocular counterparts lag in quality despite broader applicability. We propose ReCaLaB to close this gap.…

Image GenerationNeRF

X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation

2024-05-02 · Yiwei Ma, Zhekai Lin, Jiayi Ji, Yijun Fan 외

Recent advancements in automatic 3D avatar generation guided by text have made significant progress. However, existing methods have limitations such as oversaturation and low-quality output. To address these challenges, …

Text to 3D

AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridging

2022-11-15 · Shen Sang, Tiancheng Zhi, Guoxian Song, Minghao Liu 외

Stylized 3D avatars have become increasingly prominent in our modern life. Creating these avatars manually usually involves laborious selection and adjustment of continuous and discrete parameters and is time-consuming f…

Self-Supervised Learning

InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation

2024-05-24 · Yuchi Wang, Junliang Guo, Jianhong Bai, Runyi Yu 외

Recent talking avatar generation models have made strides in achieving realistic and accurate lip synchronization with the audio, but often fall short in controlling and conveying detailed expressions and emotions of the…