paper-with-me

홈 › Papers

Controllable Mesh Generation Through Sparse Latent Point Diffusion Models

2023-03-14 · CVPR 2023 1 · Zhaoyang Lyu, Jinyi Wang, Yuwei An, Ya zhang, Dahua Lin, Bo Dai

Mesh generation is of great value in various applications involving computer graphics and virtual content, yet designing generative models for meshes is challenging due to their irregular data structure and inconsistent topology of meshes in the same category. In this work, we design a novel sparse latent point diffusion model for mesh generation. Our key insight is to regard point clouds as an intermediate representation of meshes, and model the distribution of point clouds instead. While meshes can be generated from point clouds via techniques like Shape as Points (SAP), the challenges of directly generating meshes can be effectively avoided. To boost the efficiency and controllability of our mesh generation method, we propose to further encode point clouds to a set of sparse latent points with point-wise semantic meaningful features, where two DDPMs are trained in the space of sparse latent points to respectively model the distribution of the latent point positions and features at these latent points. We find that sampling in this latent space is faster than directly sampling dense point clouds. Moreover, the sparse latent points also enable us to explicitly control both the overall structures and local details of the generated meshes. Extensive experiments are conducted on the ShapeNet dataset, where our proposed sparse latent point diffusion model achieves superior performance in terms of generation quality and controllability when compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2303.07938

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

GetMesh: A Controllable Model for High-quality Mesh Generation and Manipulation

2024-03-18 · Zhaoyang Lyu, Ben Fei, Jinyi Wang, Xudong Xu 외

Mesh is a fundamental representation of 3D assets in various industrial applications, and is widely supported by professional softwares. However, due to its irregular structure, mesh creation and manipulation is often ti…

Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control

2025-02-23 · Jinbo Yan, Alan Zhao, Yixin Hu

Single-image 3D generation has emerged as a prominent research topic, playing a vital role in virtual reality, 3D modeling, and digital content creation. However, existing methods face challenges such as a lack of multi-…

3D Generation3DGS

MeshCraft: Exploring Efficient and Controllable Mesh Generation with Flow-based DiTs

2025-03-29 · Xianglong He, Junyi Chen, Di Huang, Zexiang Liu 외

In the domain of 3D content creation, achieving optimal mesh topology through AI models has long been a pursuit for 3D artists. Previous methods, such as MeshGPT, have explored the generation of ready-to-use 3D objects v…

Fishbone: From One 3D Asset to a Million Controllable Edits

2026-05-24 · Yumeng He, Xiaoying Wang, Peihao Li, Yanjia Huang 외 arxiv

Large-scale controllable 3D assets are critical for computer graphics, embodied AI, robotics, and interactive content creation, yet creating diverse 3D assets remains challenging due to the high cost of manual modeling a…

Data Augmentation3D Generation

AttentionHand: Text-driven Controllable Hand Image Generation for 3D Hand Reconstruction in the Wild

2024-07-25 · Junho Park, Kyeongbo Kong, Suk-Ju Kang

Recently, there has been a significant amount of research conducted on 3D hand reconstruction to use various forms of human-computer interaction. However, 3D hand reconstruction in the wild is challenging due to extreme …

3D Hand Pose Estimation3D Interacting Hand Pose EstimationText-to-Image Generation