paper-with-me

홈 › Papers

TEXGen: a Generative Diffusion Model for Mesh Textures

2024-11-22 · Xin Yu, Ze Yuan, Yuan-Chen Guo, Ying-Tian Liu, Jianhui Liu, Yangguang Li, Yan-Pei Cao, Ding Liang, Xiaojuan Qi

While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of relying on pre-trained 2D diffusion models for test-time optimization of 3D textures. Instead, we focus on the fundamental problem of learning in the UV texture space itself. For the first time, we train a large diffusion model capable of directly generating high-resolution texture maps in a feed-forward manner. To facilitate efficient learning in high-resolution UV spaces, we propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. Leveraging this architectural design, we train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images. Once trained, our model naturally supports various extended applications, including text-guided texture inpainting, sparse-view texture completion, and text-driven texture synthesis. Project page is at http://cvmi-lab.github.io/TEXGen/.

📄 PDF Abstract BibTeX arXiv:2411.14740

Code (1)

CVMI-Lab/TEXGen 공식 구현 pytorch

Tasks

modelTexture Synthesis

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling

2024-08-02 · Dong Huo, Zixin Guo, Xinxin Zuo, Zhihao Shi 외

Given a 3D mesh, we aim to synthesize 3D textures that correspond to arbitrary textual descriptions. Current methods for generating and assembling textures from sampled views often result in prominent seams or excessive …

DenoisingTexture Synthesis

Single Mesh Diffusion Models with Field Latents for Texture Generation

2023-12-14 · CVPR 2024 1 · Thomas W. Mitchel, Carlos Esteves, Ameesh Makadia

We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes, with the goal of synthesizing high-quality textures. Our approach is underpinned by two contributions: field…

Texture Synthesis

DragTex: Generative Point-Based Texture Editing on 3D Mesh

2024-03-04 · Yudi Zhang, Qi Xu, Lei Zhang

Creating 3D textured meshes using generative artificial intelligence has garnered significant attention recently. While existing methods support text-based generative texture generation or editing on 3D meshes, they ofte…

DecoderTexture Synthesis

UV-free Texture Generation with Denoising and Geodesic Heat Diffusions

2024-08-29 · Simone Foti, Stefanos Zafeiriou, Tolga Birdal

Seams, distortions, wasted UV space, vertex-duplication, and varying resolution over the surface are the most prominent issues of the standard UV-based texturing of meshes. These issues are particularly acute when automa…

DenoisingTexture Synthesis

DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes

2025-01-06 · Xuyang Wang, Ziang Cheng, Zhenyu Li, Jiayu Yang 외

This paper addresses the problem of generating textures for 3D mesh assets. Existing approaches often rely on image diffusion models to generate multi-view image observations, which are then transformed onto the mesh sur…

3D Surface GenerationGeometry-based operator learningLatent Diffusion Model for 3DTexture Synthesis