paper-with-me

홈 › Papers

Few-shot 3D Shape Generation

2023-05-19 · Jingyuan Zhu, Huimin Ma, Jiansheng Chen, Jian Yuan

Realistic and diverse 3D shape generation is helpful for a wide variety of applications such as virtual reality, gaming, and animation. Modern generative models, such as GANs and diffusion models, learn from large-scale datasets and generate new samples following similar data distributions. However, when training data is limited, deep neural generative networks overfit and tend to replicate training samples. Prior works focus on few-shot image generation to produce high-quality and diverse results using a few target images. Unfortunately, abundant 3D shape data is typically hard to obtain as well. In this work, we make the first attempt to realize few-shot 3D shape generation by adapting generative models pre-trained on large source domains to target domains using limited data. To relieve overfitting and keep considerable diversity, we propose to maintain the probability distributions of the pairwise relative distances between adapted samples at feature-level and shape-level during domain adaptation. Our approach only needs the silhouettes of few-shot target samples as training data to learn target geometry distributions and achieve generated shapes with diverse topology and textures. Moreover, we introduce several metrics to evaluate the quality and diversity of few-shot 3D shape generation. The effectiveness of our approach is demonstrated qualitatively and quantitatively under a series of few-shot 3D shape adaptation setups.

📄 PDF Abstract BibTeX arXiv:2305.11664

Code (0)

등록된 구현이 없습니다.

Tasks

3D Shape GenerationDiversityDomain AdaptationImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Few-Part-Shot Font Generation

2025-09-12 · Masaki Akiba, Shumpei Takezaki, Daichi Haraguchi, Seiichi Uchida arxiv

This paper proposes a novel model of few-part-shot font generation, which designs an entire font based on a set of partial design elements, i.e., partial shapes. Unlike conventional few-shot font generation, which requir…

CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation

2021-10-06 · CVPR 2022 1 · Aditya Sanghi, Hang Chu, Joseph G. Lambourne, Ye Wang 외

Generating shapes using natural language can enable new ways of imagining and creating the things around us. While significant recent progress has been made in text-to-image generation, text-to-shape generation remains a…

Image GenerationText to Image GenerationText-to-Image GenerationText-to-Shape Generation+1

ZeroForge: Feedforward Text-to-Shape Without 3D Supervision

2023-06-14 · Kelly O. Marshall, Minh Pham, Ameya Joshi, Anushrut Jignasu 외

Current state-of-the-art methods for text-to-shape generation either require supervised training using a labeled dataset of pre-defined 3D shapes, or perform expensive inference-time optimization of implicit neural repre…

Text-to-Shape Generation

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars

2022-05-17 · Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai 외

3D avatar creation plays a crucial role in the digital age. However, the whole production process is prohibitively time-consuming and labor-intensive. To democratize this technology to a larger audience, we propose Avata…

3D geometryLanguage ModellingMotion SynthesisTexture Synthesis

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models

2022-12-28 · CVPR 2023 1 · Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao 외

Recent CLIP-guided 3D optimization methods, such as DreamFields and PureCLIPNeRF, have achieved impressive results in zero-shot text-to-3D synthesis. However, due to scratch training and random initialization without pri…

Image GenerationText to 3DText-to-Shape Generation