paper-with-me

Papers

SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis

2026-01-12 · Jeongjun Choi, Yeonsoo Park, H. Jin Kim arxiv

We present SceneNAT, a single-stage masked non-autoregressive Transformer that synthesizes complete 3D indoor scenes from natural language instructions through only a few parallel decoding passes, offering improved performance and efficiency compared to prior state-of-the-art approaches. SceneNAT is trained via masked modeling over fully discretized representations of both semantic and spatial attributes. By applying a masking strategy at both the attribute level and the instance level, the model can better capture intra-object and inter-object structure. To boost relational reasoning, SceneNAT employs a dedicated triplet predictor for modeling the scene's layout and object relationships by mapping a set of learnable relation queries to a sparse set of symbolic triplets (subject, predicate, object). Extensive experiments on the 3D-FRONT dataset demonstrate that SceneNAT achieves superior performance compared to state-of-the-art autoregressive and diffusion baselines in both semantic compliance and spatial arrangement accuracy, while operating with substantially lower computational cost.

📄 PDF Abstract BibTeX arXiv:2601.07218

Code (0)

등록된 구현이 없습니다.

Tasks

Indoor Scene SynthesisRelational Reasoning

Similar Papers 제목 키워드 기반

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling

2026-05-22 · Jean-Marie Lemercier, Tomas Geffner, Karsten Kreis, Morteza Mardani 외 arxiv

Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput. To solve this issue, we propose DiLaDiff, a variant o…

Discovering Crystal Structure Prediction Algorithms with an AI Co-Scientist

2026-06-22 · Kiyoung Seong, Nayoung Kim, Sungsoo Ahn arxiv

We introduce Human-AI Co-discovery system (HACO) for scientific algorithm discovery through cross-domain search and sparse human steering. Starting from the goal of generating crystal structures from chemical composition…

VL-BEiT: Generative Vision-Language Pretraining

2022-06-02 · Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei

We introduce a vision-language foundation model called VL-BEiT, which is a bidirectional multimodal Transformer learned by generative pretraining. Our minimalist solution conducts masked prediction on both monomodal and …

image-classificationImage ClassificationImage-text RetrievalLanguage Modeling+9

Partition Generative Modeling: Masked Modeling Without Masks

2025-05-24 · Justin Deschenaux, Lan Tran, Caglar Gulcehre

We introduce ``Partition Generative Models'' (PGMs), a novel approach to masked generative modeling (MGMs), particularly effective for masked diffusion language modeling (MDLMs). PGM divides tokens into two distinct grou…

Computational EfficiencyLanguage ModelingLanguage Modelling

MMHMR: Generative Masked Modeling for Hand Mesh Recovery

2024-12-18 · Muhammad Usama Saleem, Ekkasit Pinyoanuntapong, Mayur Jagdishbhai Patel, Hongfei Xue 외

Reconstructing a 3D hand mesh from a single RGB image is challenging due to complex articulations, self-occlusions, and depth ambiguities. Traditional discriminative methods, which learn a deterministic mapping from a 2D…

3D Hand Pose Estimation