paper-with-me

홈 › Papers

DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters

2024-11-26 · CVPR 2025 1 · Mingze Sun, JunHao Chen, Junting Dong, Yurun Chen, Xinyu Jiang, Shiwei Mao, Puhua Jiang, Jingbo Wang, Bo Dai, Ruqi Huang

Recent advances in generative models have enabled high-quality 3D character reconstruction from multi-modal. However, animating these generated characters remains a challenging task, especially for complex elements like garments and hair, due to the lack of large-scale datasets and effective rigging methods. To address this gap, we curate AnimeRig, a large-scale dataset with detailed skeleton and skinning annotations. Building upon this, we propose DRiVE, a novel framework for generating and rigging 3D human characters with intricate structures. Unlike existing methods, DRiVE utilizes a 3D Gaussian representation, facilitating efficient animation and high-quality rendering. We further introduce GSDiff, a 3D Gaussian-based diffusion module that predicts joint positions as spatial distributions, overcoming the limitations of regression-based approaches. Extensive experiments demonstrate that DRiVE achieves precise rigging results, enabling realistic dynamics for clothing and hair, and surpassing previous methods in both quality and versatility. The code and dataset will be made public for academic use upon acceptance.

📄 PDF Abstract BibTeX arXiv:2411.17423

Code (1)

DRiVEAvatar/DRiVEAvatar.github.io 공식 구현

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Harnessing Frequency Spectrum Insights for Image Copyright Protection Against Diffusion Models

2025-03-14 · CVPR 2025 1 · Zhenguang Liu, Chao Shuai, Shaojing Fan, Ziping Dong 외

Diffusion models have achieved remarkable success in novel view synthesis, but their reliance on large, diverse, and often untraceable Web datasets has raised pressing concerns about image copyright protection. Current m…

Image GenerationNovel View Synthesis

HumanRig: Learning Automatic Rigging for Humanoid Character in a Large Scale Dataset

2024-12-03 · CVPR 2025 1 · Zedong Chu, Feng Xiong, Meiduo Liu, Jinzhi Zhang 외

With the rapid evolution of 3D generation algorithms, the cost of producing 3D humanoid character models has plummeted, yet the field is impeded by the lack of a comprehensive dataset for automatic rigging, which is a pi…

3D Generation

ARMO: Autoregressive Rigging for Multi-Category Objects

2025-03-26 · Mingze Sun, Shiwei Mao, Keyi Chen, Yurun Chen 외

Recent advancements in large-scale generative models have significantly improved the quality and diversity of 3D shape generation. However, most existing methods focus primarily on generating static 3D models, overlookin…

3D Shape GenerationConnectivity Estimation

AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model

2026-08-17 · Kwan Yun, Serin Yoon, Sunjin Jung, Jung Eun Yoo 외 arxiv

We present AnyTalk, a novel method for generating 3D speech animations for arbitrary characters without requiring any animation data. While existing audio-driven 3D speech animation methods rely on character-specific tra…

Video Generation

Anymate: A Dataset and Baselines for Learning 3D Object Rigging

2025-05-09 · Yufan Deng, Yuhao Zhang, Chen Geng, Shangzhe Wu 외

Rigging and skinning are essential steps to create realistic 3D animations, often requiring significant expertise and manual effort. Traditional attempts at automating these processes rely heavily on geometric heuristics…