paper-with-me

홈 › Papers

ORIGEN: Zero-Shot 3D Orientation Grounding in Text-to-Image Generation

2025-03-28 · Yunhong Min, Daehyeon Choi, Kyeongmin Yeo, Jihyun Lee, Minhyuk Sung

We introduce ORIGEN, the first zero-shot method for 3D orientation grounding in text-to-image generation across multiple objects and diverse categories. While previous work on spatial grounding in image generation has mainly focused on 2D positioning, it lacks control over 3D orientation. To address this, we propose a reward-guided sampling approach using a pretrained discriminative model for 3D orientation estimation and a one-step text-to-image generative flow model. While gradient-ascent-based optimization is a natural choice for reward-based guidance, it struggles to maintain image realism. Instead, we adopt a sampling-based approach using Langevin dynamics, which extends gradient ascent by simply injecting random noise--requiring just a single additional line of code. Additionally, we introduce adaptive time rescaling based on the reward function to accelerate convergence. Our experiments show that ORIGEN outperforms both training-based and test-time guidance methods across quantitative metrics and user studies.

📄 PDF Abstract BibTeX arXiv:2503.22194

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here

Similar Papers 제목 키워드 기반

P2DNav: Panorama-to-Downview Reasoning for Zero-shot Vision-and-Language Navigation

2026-05-19 · Kai Sheng, Liuyi Wang, Haojie Dai, Jinlong Li 외 arxiv

Vision-and-language navigation (VLN) requires an embodied agent to ground natural-language instructions into executable navigation actions in unseen environments. Existing zero-shot methods typically rely on additional w…

iFinder: Structured Zero-Shot Vision-Based LLM Grounding for Dash-Cam Video Reasoning

2025-09-23 · Manyi Yao, Bingbing Zhuang, Sparsh Garg, Amit Roy-Chowdhury 외 arxiv

Grounding large language models (LLMs) in domain-specific tasks like post-hoc dash-cam driving video analysis is challenging due to their general-purpose training and lack of structured inductive biases. As vision is oft…

Spatial ReasoningCausal Inference

GRILL: Grounded Vision-language Pre-training via Aligning Text and Image Regions

2023-05-24 · Woojeong Jin, Subhabrata Mukherjee, Yu Cheng, Yelong Shen 외

Generalization to unseen tasks is an important ability for few-shot learners to achieve better zero-/few-shot performance on diverse tasks. However, such generalization to vision-language tasks including grounding and ge…

ObjectQuestion AnsweringVisual Commonsense ReasoningVisual Question Answering

VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders

2023-09-03 · Xuyang Liu, Siteng Huang, Yachen Kang, Honggang Chen 외

Large-scale text-to-image diffusion models have shown impressive capabilities for generative tasks by leveraging strong vision-language alignment from pre-training. However, most vision-language discriminative tasks requ…

Visual Grounding

Zero-Shot Visual Grounding in 3D Gaussians via View Retrieval

2025-09-19 · Liwei Liao, Xufeng Li, Xiaoyun Zheng, Boning Liu 외 arxiv

3D Visual Grounding (3DVG) aims to locate objects in 3D scenes based on text prompts, which is essential for applications such as robotics. However, existing 3DVG methods encounter two main challenges: first, they strugg…

Visual Grounding