Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation
This paper proposes an image-vector dual diffusion model for generative layout design. Distinct from prior efforts that mostly ignore element-level visual information our approach integrates the power of a pre-trained large image diffusion model to guide layout composition in a vector diffusion model by providing enhanced salient region understanding and high-level inter-element relationship reasoning. Our proposed model simultaneously operates in two domains: it generates the overall design appearance in the image domain while optimizing the size and position of each design element in the vector domain. The proposed method achieves the state-of-the-art results on several datasets and enables new layout design applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Layout DesignLayout GenerationPositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pano3DComposer: Feed-Forward Compositional 3D Scene Generation from Single Panoramic Image
Current compositional image-to-3D scene generation approaches construct 3D scenes by time-consuming iterative layout optimization or inflexible joint object-layout generation. Moreover, most methods rely on limited field…
Scene GenerationComposer Vector: Style-steering Symbolic Music Generation in a Latent Space
Symbolic music generation has made significant progress, yet achieving fine-grained and flexible control over composer style remains challenging. Existing training-based methods for composer style conditioning depend on …
Music GenerationInternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD
The Large Vision-Language Model (LVLM) field has seen significant advancements, yet its progression has been hindered by challenges in comprehending fine-grained visual content due to limited resolution. Recent efforts h…
4kLanguage ModelingLanguage ModellingVisual Question AnsweringAdvancing Aesthetic Image Generation via Composition Transfer
Composition is a cornerstone of visual aesthetics, influencing the appeal of an image. While its principles operate independently of specific content, in practice, composition is often coupled with semantics. As a result…
Image GenerationComposer: Creative and Controllable Image Synthesis with Composable Conditions
Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability. This work offers a new generation paradigm that allows flexible control of t…
Image ColorizationImage GenerationImage-to-Image TranslationPose Transfer+3