Griffin: Generative Reference and Layout Guided Image Composition
Text-to-image models have achieved a level of realism that enables the generation of highly convincing images. However, text-based control can be a limiting factor when more explicit guidance is needed. Defining both the content and its precise placement within an image is crucial for achieving finer control. In this work, we address the challenge of multi-image layout control, where the desired content is specified through images rather than text, and the model is guided on where to place each element. Our approach is training-free, requires a single image per reference, and provides explicit and simple control for object and part-level composition. We demonstrate its effectiveness across various image composition tasks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
MaskPLAN: Masked Generative Layout Planning from Partial Input
Layout planning spanning from architecture to interior design is a slow iterative exploration of ill-defined problems adopting a "I'll know it when I see it" approach to potential solutions. Recent advances in genera…
AttributeDesign SynthesisLayout GenerationGLA-Grad++: An Improved Griffin-Lim Guided Diffusion Model for Speech Synthesis
Recent advances in diffusion models have positioned them as powerful generative frameworks for speech synthesis, demonstrating substantial improvements in audio quality and stability. Nevertheless, their effectiveness in…
Speech SynthesisSpatial Diffusion for Cell Layout Generation
Generative models, such as GANs and diffusion models, have been used to augment training sets and boost performances in different tasks. We focus on generative models for cell detection instead, i.e., locating and classi…
Cell DetectionLayout GenerationConsistCompose: Unified Multimodal Layout Control for Image Composition
Unified multimodal models that couple visual understanding with image generation have advanced rapidly, yet most systems still focus on visual grounding-aligning language with image regions-while their generative counter…
Visual GroundingImage GenerationDiffX: Guide Your Layout to Cross-Modal Generative Modeling
Diffusion models have made significant strides in language-driven and layout-driven image generation. However, most diffusion models are limited to visible RGB image generation. In fact, human perception of the world is …
DenoisingImage CaptioningImage Generation