paper-with-me

홈 › Papers

Joint2Human: High-quality 3D Human Generation via Compact Spherical Embedding of 3D Joints

2023-12-14 · CVPR 2024 1 · Muxin Zhang, Qiao Feng, Zhuo Su, Chao Wen, Zhou Xue, Kun Li

3D human generation is increasingly significant in various applications. However, the direct use of 2D generative methods in 3D generation often results in losing local details, while methods that reconstruct geometry from generated images struggle with global view consistency. In this work, we introduce Joint2Human, a novel method that leverages 2D diffusion models to generate detailed 3D human geometry directly, ensuring both global structure and local details. To achieve this, we employ the Fourier occupancy field (FOF) representation, enabling the direct generation of 3D shapes as preliminary results with 2D generative models. With the proposed high-frequency enhancer and the multi-view recarving strategy, our method can seamlessly integrate the details from different views into a uniform global shape. To better utilize the 3D human prior and enhance control over the generated geometry, we introduce a compact spherical embedding of 3D joints. This allows for an effective guidance of pose during the generation process. Additionally, our method can generate 3D humans guided by textual inputs. Our experimental results demonstrate the capability of our method to ensure global structure, local details, high resolution, and low computational cost simultaneously. More results and the code can be found on our project page at http://cic.tju.edu.cn/faculty/likun/projects/Joint2Human.

📄 PDF Abstract BibTeX arXiv:2312.08591

Code (0)

등록된 구현이 없습니다.

Tasks

3D Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation

2026-08-19 · Yinming Huang, Shuyuan Tu, Xi Yan, Zihan Yang 외 arxiv

Using reinforcement learning to post-train joint video-audio generation models requires a reward signal. Existing methods construct this reward by combining metrics for individual quality dimensions, including audio qual…

Reinforcement LearningVideo GenerationAudio Generation

EchoMotion: Unified Human Video and Motion Generation via Dual-Modality Diffusion Transformer

2025-12-21 · Yuxiao Yang, Hualian Sheng, Sijia Cai, Jing Lin 외 arxiv

Video generation models have advanced significantly, yet they still struggle to synthesize complex human movements due to the high degrees of freedom in human articulation. This limitation stems from the intrinsic constr…

Video Generation

ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis

2026-04-21 · Zhengwentai Sun, Keru Zheng, Chenghong Li, Hongjie Liao 외 arxiv

Human video generation remains challenging due to the difficulty of jointly modeling human appearance, motion, and camera viewpoint under limited multi-view data. Existing methods often address these factors separately, …

Video GenerationImage Generation

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models

2023-04-03 · CVPR 2024 1 · Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan 외

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common obje…

NeRF

Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation

2026-04-26 · Chunyu Li, Jiaye Li, Ruiqiao Mei, Haoyuan Xia 외 arxiv

Real-time text-driven joint audio-video avatar generation requires jointly synthesizing portrait video and speech with high fidelity and precise synchronization, yet existing audio-visual diffusion models remain too slow…