paper-with-me

홈 › Papers

DVD: Discrete Voxel Diffusion for 3D Generation and Editing

2026-05-08 · Zhengrui Xiang, Jiaqi Wu, Fupeng Sun, Heliang Zheng, Yingzhen Li arxiv

We introduce Discrete Voxel Diffusion (DVD), a discrete diffusion framework to generate, assess, and edit sparse voxels for SLat (Structured LATent) based 3D generative pipelines. Although discrete diffusion has not generally displaced continuous diffusion in image-like generation, we show that it can be an effective first-stage prior for sparse voxel scaffolds. By treating voxel occupancy as a native discrete variable, DVD avoids continuous-to-discrete thresholding and provides a simple framework for voxel generation, uncertainty estimation, and editing. Beyond quality gains, DVD provides more interpretable generation dynamics through explicit categorical modeling. Furthermore, we leverage the predictive entropy as a robust uncertainty metric to identify ambiguous voxel regions and complicated samples, facilitating tasks such as data filtering and quality assessment. Finally, we propose a lightweight fine-tuning strategy using block-structured perturbation patterns. This approach empowers the model to inpaint and edit voxels within a single sampling round, requiring negligible auxiliary computation and no additional model evaluations. Code is available at https://github.com/TeCai/DVD.

📄 PDF Abstract BibTeX arXiv:2605.07971

Code (0)

등록된 구현이 없습니다.

Tasks

3D Generation

Similar Papers 제목 키워드 기반

Scaffold Diffusion: Sparse Multi-Category Voxel Structure Generation with Discrete Diffusion

2025-08-26 · Justin Jung arxiv

Generating realistic sparse multi-category 3D voxel structures is difficult due to the cubic memory scaling of voxel structures and moreover the significant class imbalance caused by sparsity. We introduce Scaffold Diffu…

DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Models

2024-10-10 · Xiaoxiao He, Ligong Han, Quan Dao, Song Wen 외

Discrete diffusion models have achieved success in tasks like image generation and masked language modeling but face limitations in controlled content editing. We introduce DICE (Discrete Inversion for Controllable Editi…

Image GenerationLanguage ModelingLanguage ModellingMasked Language Modeling

VoxScene: Anchor-Conditioned Voxel Diffusion for Indoor Scene Arrangement

2026-05-16 · Haotian Mao, Yuhan Huang, Jiatao Lin, Yang Zhao 외 arxiv

We present VoxScene, a novel anchor-conditioned voxel diffusion framework tailored for 3D scene synthesis. Current data-driven layout generation techniques typically rely on bounding proxies or implicit representations, …

MammothModa2: A Unified AR-Diffusion Framework for Multimodal Understanding and Generation

2025-11-23 · Tao Shen, Xin Wan, Taicai Chen, Rui Zhang 외 arxiv

Unified multimodal models aim to integrate understanding and generation within a single framework, yet bridging the gap between discrete semantic reasoning and high-fidelity visual synthesis remains challenging. We prese…

Reinforcement Learning

GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editing

2026-03-22 · Zifeng Zhu, Jiaming Han, Jiaxiang Zhao, Minnan Luo 외 arxiv

While Diffusion Large Language Models (DLLMs) have demonstrated remarkable capabilities in multi-modal generation, performing precise, training-free image editing remains an open challenge. Unlike continuous diffusion mo…

Image Editing