paper-with-me

Papers

Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment

2026-06-05 · Yibo Liu, Ziwei Zhang, Haozhou Pang, Menghao Li, Lanshan He, Gan Qi arxiv

This paper presents Native3D, the first end-to-end 3D scene generation framework that completely bypasses 2D intermediate representations. Traditional approaches typically require adapting 3D representations to the 2D domain to leverage pre-trained diffusion models, which inevitably introduces domain adaptation issues including geometric structural distortion and texture detail degradation. To address these limitations, we design a unified mesh-texture joint representation that simultaneously models both geometric structures and texture features through a Transformer-based scene encoder, effectively maintaining spatial relationships and visual consistency among objects within scenes. We further propose the 3D Representation Alignment Loss (3D REPA Loss), which employs an improved contrastive learning mechanism to align multi-level semantic representations in the latent space, significantly enhancing geometric and textural fidelity. Experimental results demonstrate that Native3D outperforms existing methods in both generation quality and editing flexibility, providing a novel solution for 3D scene editing.

📄 PDF Abstract BibTeX arXiv:2606.07117

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDomain AdaptationScene Generation3D scene Editing

Similar Papers 제목 키워드 기반

Programmable-Room: Interactive Textured 3D Room Meshes Generation Empowered by Large Language Models

2025-06-21 · Jihyun Kim, Junho Park, Kyeongbo Kong, Suk-Ju Kang

We present Programmable-Room, a framework which interactively generates and edits a 3D room mesh, given natural language instructions. For precise control of a room's each attribute, we decompose the challenging task int…

AttributeImage GenerationLarge Language Model

Self-Evolving 3D Scene Generation from a Single Image

2025-12-09 · Kaizhi Zheng, Yue Fan, Jing Gu, Zishuo Xu 외 arxiv

Generating high-quality, textured 3D scenes from a single image remains a fundamental challenge in vision and graphics. Recent image-to-3D generators recover reasonable geometry from single views, but their object-centri…

Scene GenerationVideo Generation3D Generation

Mesh-Learner: Texturing Mesh with Spherical Harmonics

2025-04-28 · Yunfei Wan, Jianheng Liu, Jiarong Lin, Fu Zhang

In this paper, we present a 3D reconstruction and rendering framework termed Mesh-Learner that is natively compatible with traditional rasterization pipelines. It integrates mesh and spherical harmonic (SH) texture (i.e.…

3D ReconstructionCPUGPU

SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors

2023-11-28 · CVPR 2024 1 · Dave Zhenyu Chen, Haoxuan Li, Hsin-Ying Lee, Sergey Tulyakov 외

We propose SceneTex, a novel method for effectively generating high-quality and style-consistent textures for indoor scenes using depth-to-image diffusion priors. Unlike previous methods that either iteratively warp 2D v…

DecoderTexture Synthesis

DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes

2025-01-06 · Xuyang Wang, Ziang Cheng, Zhenyu Li, Jiayu Yang 외

This paper addresses the problem of generating textures for 3D mesh assets. Existing approaches often rely on image diffusion models to generate multi-view image observations, which are then transformed onto the mesh sur…

3D Surface GenerationGeometry-based operator learningLatent Diffusion Model for 3DTexture Synthesis