Structural Energy Guidance for View-Consistent Text-to-3D Generation

2026-05-19 · Qing Zhang, Jinguang Tong, Jing Zhang, Jie Hong, Xuesong Li arxiv

Text-to-3D generation based on diffusion models often suffers from the Janus problem, leading to inconsistent geometry across viewpoints. This work identifies viewpoint bias in 2D diffusion priors as the main cause and proposes Structural Energy-Guided Sampling (SEGS), a training-free and plug-and-play framework to improve multi-view consistency. SEGS constructs a structural energy in the PCA subspace of U-Net features and injects its gradient into the denoising process. It can be easily integrated into SDS/VSD pipelines without retraining. Experiments show that SEGS reduces the Janus Rate by about 10% on average and improves View-CS scores across multiple baselines, including DreamFusion, Magic3D, and LucidDreamer. This method effectively alleviates viewpoint artifacts while preserving appearance fidelity, providing a flexible solution for high-quality text-to-3D content generation.

📄 PDF Abstract BibTeX arXiv:2605.19876

Code (0)

등록된 구현이 없습니다.

Tasks

3D Generation

Structural Energy-Guided Sampling for View-Consistent Text-to-3D

2025-08-23 · Qing Zhang, Jinguang Tong, Jie Hong, Jing Zhang 외 arxiv

Text-to-3D generation often suffers from the Janus problem, where objects look correct from the front but collapse into duplicated or distorted geometry from other angles. We attribute this failure to viewpoint bias in 2…

3D Generation

3DSwapping: Texture Swapping For 3D Object From Single Reference Image

2025-03-24 · Xiao Cao, Beibei Lin, Bo wang, Zhiyong Huang 외

3D texture swapping allows for the customization of 3D object textures, enabling efficient and versatile visual transformations in 3D editing. While no dedicated method exists, adapted 2D editing and text-driven 3D editi…

Manifold-Optimal Guidance: A Unified Riemannian Control View of Diffusion Guidance

2026-03-12 · Zexi Jia, Pengcheng Luo, Zhengyao Fang, Jinchao Zhang 외 arxiv

Classifier-Free Guidance (CFG) serves as the de facto control mechanism for conditional diffusion, yet high guidance scales notoriously induce oversaturation, texture artifacts, and structural collapse. We attribute this…

View-Consistent 3D Scene Editing via Dual-Path Structural Correspondense and Semantic Continuity

2026-04-20 · Pufan Li, Bi'an Du, Shenghe Zheng, Junyi Yao 외 arxiv

Text-driven 3D scene editing has recently attracted increasing attention. Most existing methods follow a render-edit-optimize pipeline, where multi-view images are rendered from a 3D scene, edited with 2D image editors, …

3D scene Editing

Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Models

2026-04-29 · Haosen Li, Wenshuo Chen, Lei Wang, Shaofeng Liang 외 arxiv

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning genera…