paper-with-me

Papers

Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image

2024-05-30 · Kailu Wu, Fangfu Liu, Zhihan Cai, Runjie Yan, HanYang Wang, Yating Hu, Yueqi Duan, Kaisheng Ma

In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based on Score Distillation Sampling (SDS) can produce diversified 3D results by distilling 3D knowledge from large 2D diffusion models, but they usually suffer from long per-case optimization time with inconsistent issues. Recent works address the problem and generate better 3D results either by finetuning a multi-view diffusion model or training a fast feed-forward model. However, they still lack intricate textures and complex geometries due to inconsistency and limited generated resolution. To simultaneously achieve high fidelity, consistency, and efficiency in single image-to-3D, we propose a novel framework Unique3D that includes a multi-view diffusion model with a corresponding normal diffusion model to generate multi-view images with their normal maps, a multi-level upscale process to progressively improve the resolution of generated orthographic multi-views, as well as an instant and consistent mesh reconstruction algorithm called ISOMER, which fully integrates the color and geometric priors into mesh results. Extensive experiments demonstrate that our Unique3D significantly outperforms other image-to-3D baselines in terms of geometric and textural details.

📄 PDF Abstract BibTeX arXiv:2405.20343

Code (1)

AiuniAI/Unique3D 공식 구현 jax

Tasks

Image to 3DSingle-View 3D ReconstructionSingle-View 3D Reconstruction on ShapeNet

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

VertexRegen: Mesh Generation with Continuous Level of Detail

2025-08-12 · Xiang Zhang, Yawar Siddiqui, Armen Avetisyan, Chris Xie 외 arxiv

We introduce VertexRegen, a novel mesh generation framework that enables generation at a continuous level of detail. Existing autoregressive methods generate meshes in a partial-to-complete manner and thus intermediate s…

FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh Generation

2026-03-02 · Hanxiao Wang, Yuan-Chen Guo, Ying-Tian Liu, Zi-Xin Zou 외 arxiv

Autoregressive models for 3D mesh generation suffer from a fundamental limitation: they flatten meshes into long vertex-coordinate sequences. This results in prohibitive computational costs, hindering the efficient synth…

SRL-Assisted AFM: Generating Planar Unstructured Quadrilateral Meshes with Supervised and Reinforcement Learning-Assisted Advancing Front Method

2023-04-30 · Hua Tong, Kuanren Qian, Eni Halilaj, Yongjie Jessica Zhang

High-quality mesh generation is the foundation of accurate finite element analysis. Due to the vast interior vertices search space and complex initial boundaries, mesh generation for complicated domains requires substant…

reinforcement-learningReinforcement Learning

XSpecMesh: Quality-Preserving Auto-Regressive Mesh Generation Acceleration via Multi-Head Speculative Decoding

2025-07-31 · Dian Chen, Yansong Qu, Xinyang Li, Ming Li 외 arxiv

Current auto-regressive models can generate high-quality, topologically precise meshes; however, they necessitate thousands-or even tens of thousands-of next-token predictions during inference, resulting in substantial l…

AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animation

2026-04-29 · Zijie Wu, Chaohui Yu, Fan Wang, Xiang Bai arxiv

Recent advances in 4D content generation have attracted increasing attention, yet creating high-quality animated 3D models remains challenging due to the complexity of modeling spatio-temporal distributions and the scarc…