paper-with-me

홈 › Papers

HiddenObjects: Scalable Diffusion-Distilled Spatial Priors for Object Placement

2026-04-12 · Marco Schouten, Ioannis Siglidis, Serge Belongie, Dim P. Papadopoulos arxiv

We propose a method to learn explicit, class-conditioned spatial priors for object placement in natural scenes by distilling the implicit placement knowledge encoded in text-conditioned diffusion models. Prior work relies either on manually annotated data, which is inherently limited in scale, or on inpainting-based object-removal pipelines, whose artifacts promote shortcut learning. To address these limitations, we introduce a fully automated and scalable framework that evaluates dense object placements on high-quality real backgrounds using a diffusion-based inpainting pipeline. With this pipeline, we construct HiddenObjects, a large-scale dataset comprising 27M placement annotations, evaluated across 27k distinct scenes, with ranked bounding box insertions for different images and object categories. Experimental results show that our spatial priors outperform sparse human annotations on a downstream image editing task (3.90 vs. 2.68 VLM-Judge), and significantly surpass existing placement baselines and zero-shot Vision-Language Models for object placement. Furthermore, we distill these priors into a lightweight model for fast practical inference (230,000x faster).

📄 PDF Abstract BibTeX arXiv:2604.10675

Code (0)

등록된 구현이 없습니다.

Tasks

Image Editing

Similar Papers 제목 키워드 기반

Object-Aware 4D Human Motion Generation

2025-10-31 · Shurui Gui, Deep Anil Patel, Xiner Li, Martin Renqiang Min arxiv

Recent advances in video diffusion models have enabled the generation of high-quality videos. However, these videos still suffer from unrealistic deformations, semantic violations, and physical inconsistencies that are l…

Diffusion Models as Dataset Distillation Priors

2025-10-20 · Duo Su, Huyu Wu, Huanran Chen, Yiming Shi 외 arxiv

Dataset distillation aims to synthesize compact yet informative datasets from large ones. A significant challenge in this field is achieving a trifecta of diversity, generalization, and representativeness in a single dis…

STeP: A General and Scalable Framework for Solving Video Inverse Problems with Spatiotemporal Diffusion Priors

2025-04-10 · Bingliang Zhang, Zihui Wu, Berthy T. Feng, Yang song 외

We study how to solve general Bayesian inverse problems involving videos using diffusion model priors. While it is desirable to use a video diffusion prior to effectively capture complex temporal relationships, due to th…

Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion

2024-11-15 · Haoran Wei, Wencheng Han, Xingping Dong, Jianbing Shen

Recent diffusion-based Single-image 3D portrait generation methods typically employ 2D diffusion models to provide multi-view knowledge, which is then distilled into 3D representations. However, these methods usually str…

AttributeTexture Synthesis

GVD: Guiding Video Diffusion Model for Scalable Video Distillation

2025-07-30 · Kunyang Li, Jeffrey A Chan Santiago, Sarinda Dhanesh Samarasinghe, Gaowen Liu 외 arxiv

To address the larger computation and storage requirements associated with large video datasets, video dataset distillation aims to capture spatial and temporal information in a significantly smaller dataset, such that t…

Video Generation