paper-with-me

홈 › Papers

Diverse Score Distillation

2024-12-09 · Yanbo Xu, Jayanth Srinivasa, Gaowen Liu, Shubham Tulsiani

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation formulations, however, is that the outputs of the (mode-seeking) optimization are limited in diversity despite the underlying diffusion model being capable of generating diverse samples. In this work, inspired by the sampling process in denoising diffusion, we propose a score formulation that guides the optimization to follow generation paths defined by random initial seeds, thus ensuring diversity. We then present an approximation to adopt this formulation for scenarios where the optimization may not precisely follow the generation paths (\eg a 3D representation whose renderings evolve in a co-dependent manner). We showcase the applications of our `Diverse Score Distillation' (DSD) formulation across tasks such as 2D optimization, text-based 3D inference, and single-view reconstruction. We also empirically validate DSD against prior score distillation formulations and show that it significantly improves sample diversity while preserving fidelity.

📄 PDF Abstract BibTeX arXiv:2412.06780

Code (0)

등록된 구현이 없습니다.

Tasks

3D GenerationDenoisingDiversity

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching

2025-06-16 · Weimin Bai, Yubo Li, Wenzheng Chen, Weijian Luo 외

Distilling pre-trained 2D diffusion models into 3D assets has driven remarkable advances in text-to-3D synthesis. However, existing methods typically rely on Score Distillation Sampling (SDS) loss, which involves asymmet…

3D GenerationDiversityText to 3D

RewardSDS: Aligning Score Distillation via Reward-Weighted Sampling

2025-03-12 · Itay Chachy, Guy Yariv, Sagie Benaim

Score Distillation Sampling (SDS) has emerged as an effective technique for leveraging 2D diffusion priors for tasks such as text-to-3D generation. While powerful, SDS struggles with achieving fine-grained alignment to u…

3D GenerationText to 3D

PlacidDreamer: Advancing Harmony in Text-to-3D Generation

2024-07-19 · Shuo Huang, Shikun Sun, Zixuan Wang, Xiaoyu Qin 외

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusio…

3D GenerationText to 3D

Restoration Score Distillation: From Corrupted Diffusion Pretraining to One-Step High-Quality Generation

2025-05-19 · Yasi Zhang, Tianyu Chen, Zhendong Wang, Ying Nian Wu 외

Learning generative models from corrupted data is a fundamental yet persistently challenging task across scientific disciplines, particularly when access to clean data is limited or expensive. Denoising Score Distillatio…

Denoising

Flow Score Distillation for Diverse Text-to-3D Generation

2024-05-16 · Runjie Yan, Kailu Wu, Kaisheng Ma

Recent advancements in Text-to-3D generation have yielded remarkable progress, particularly through methods that rely on Score Distillation Sampling (SDS). While SDS exhibits the capability to create impressive 3D assets…

3D GenerationDiversityText to 3D