paper-with-me

홈 › Papers

Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets

2025-09-25 · Team Hunyuan3D, :, Bowen Zhang, Chunchao Guo, Haolin Liu, Hongyu Yan, Huiwen Shi, Jingwei Huang, Junlin Yu, Kunhong Li, Linus, Penghao Wang, Qingxiang Lin, Sicong Liu, Xianghui Yang, Yixuan Tang, Yunfei Zhao, Zeqiang Lai, Zhihao Liang, Zibo Zhao arxiv

Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits controllability and practical adoption. To address this gap, we present Hunyuan3D-Omni, a unified framework for fine-grained, controllable 3D asset generation built on Hunyuan3D 2.1. In addition to images, Hunyuan3D-Omni accepts point clouds, voxels, bounding boxes, and skeletal pose priors as conditioning signals, enabling precise control over geometry, topology, and pose. Instead of separate heads for each modality, our model unifies all signals in a single cross-modal architecture. We train with a progressive, difficulty-aware sampling strategy that selects one control modality per example and biases sampling toward harder signals (e.g., skeletal pose) while downweighting easier ones (e.g., point clouds), encouraging robust multi-modal fusion and graceful handling of missing inputs. Experiments show that these additional controls improve generation accuracy, enable geometry-aware transformations, and increase robustness for production workflows.

📄 PDF Abstract BibTeX arXiv:2509.21245

Code (0)

등록된 구현이 없습니다.

Tasks

Point Clouds

Similar Papers 제목 키워드 기반

Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing

2026-08-03 · Junliang Ye, Kenkun Liu, Guocun Wang, Yang Li 외 hf

Recent advances in image generation have demonstrated the potential of unified multimodal models that integrate understanding, generation, and editing. However, unified 3D modeling remains constrained by scarce multimoda…

Image Generation3D Generation

Omni-Effects: Unified and Spatially-Controllable Visual Effects Generation

2025-08-11 · Fangyuan Mao, Aiming Hao, Jintao Chen, Dongxia Liu 외 arxiv

Visual effects (VFX) are essential visual enhancements fundamental to modern cinematic production. Although video generation models offer cost-efficient solutions for VFX production, current methods are constrained by pe…

Video GenerationImage Editing

Unified Personalized Understanding, Generating and Editing

2026-01-11 · Yu Zhong, Tianwei Lin, Ruike Zhu, Yuqian Yuan 외 arxiv

Unified large multimodal models (LMMs) have achieved remarkable progress in general-purpose multimodal understanding and generation. However, they still operate under a ``one-size-fits-all'' paradigm and struggle to mode…

Image Editing

OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding

2025-04-15 · Dianbing Xi, Jiepeng Wang, Yuanzhi Liang, Xi Qiu 외

In this paper, we propose a novel framework for controllable video diffusion, OmniVDiff, aiming to synthesize and comprehend multiple video visual content in a single diffusion model. To achieve this, OmniVDiff treats al…

Semantic SegmentationVideo GenerationVideo Understanding

MGM-Omni: Scaling Omni LLMs to Personalized Long-Horizon Speech

2025-09-29 · Chengyao Wang, Zhisheng Zhong, Bohao Peng, Senqiao Yang 외 arxiv

We present MGM-Omni, a unified Omni LLM for omni-modal understanding and expressive, long-horizon speech generation. Unlike cascaded pipelines that isolate speech synthesis, MGM-Omni adopts a "brain-mouth" design with a …

Multimodal ReasoningSpeech Synthesis