paper-with-me

Papers

Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models

2024-10-30 · Arash Marioriyad, Parham Rezaei, Mahdieh Soleymani Baghshah, Mohammad Hossein Rohban

Text-to-image (T2I) generative models, such as Stable Diffusion and DALL-E, have shown remarkable proficiency in producing high-quality, realistic, and natural images from textual descriptions. However, these models sometimes fail to accurately capture all the details specified in the input prompts, particularly concerning entities, attributes, and spatial relationships. This issue becomes more pronounced when the prompt contains novel or complex compositions, leading to what are known as compositional generation failure modes. Recently, a new open-source diffusion-based T2I model, FLUX, has been introduced, demonstrating strong performance in high-quality image generation. Additionally, autoregressive T2I models like LlamaGen have claimed competitive visual quality performance compared to diffusion-based models. In this study, we evaluate the compositional generation capabilities of these newly introduced models against established models using the T2I-CompBench benchmark. Our findings reveal that LlamaGen, as a vanilla autoregressive model, is not yet on par with state-of-the-art diffusion models for compositional generation tasks under the same criteria, such as model size and inference time. On the other hand, the open-source diffusion-based model FLUX exhibits compositional generation capabilities comparable to the state-of-the-art closed-source model DALL-E3.

📄 PDF Abstract BibTeX arXiv:2410.22775

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

UNCAGE: Contrastive Attention Guidance for Masked Generative Transformers in Text-to-Image Generation

2025-08-07 · Wonjun Kang, Byeongkeun Ahn, Minjae Lee, Kevin Galim 외 arxiv

Text-to-image (T2I) generation has been actively studied using Diffusion Models and Autoregressive Models. Recently, Masked Generative Transformers have gained attention as an alternative to Autoregressive Models to over…

Text-to-Image Generation

X-Dancer: Expressive Music to Human Dance Video Generation

2025-02-24 · Zeyuan Chen, Hongyi Xu, Guoxian Song, You Xie 외

We present X-Dancer, a novel zero-shot music-driven image animation pipeline that creates diverse and long-range lifelike human dance videos from a single static image. As its core, we introduce a unified transformer-dif…

Image AnimationVideo Generation

DiffCollage: Parallel Generation of Large Content with Diffusion Models

2023-03-30 · CVPR 2023 1 · Qinsheng Zhang, Jiaming Song, Xun Huang, Yongxin Chen 외

We present DiffCollage, a compositional diffusion model that can generate large content by leveraging diffusion models trained on generating pieces of the large content. Our approach is based on a factor graph representa…

Image GenerationInfinite Image GenerationMotion Generation

Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modeling

2025-07-23 · Yi Xin, Juncheng Yan, Qi Qin, Zhen Li 외 arxiv

We present Lumina-mGPT 2.0, a stand-alone, decoder-only autoregressive model that revisits and revitalizes the autoregressive paradigm for high-quality image generation and beyond. Unlike existing approaches that rely on…

multimodal generationImage GenerationImage Editing

DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling

2021-07-05 · ACL 2021 5 · Lanqing Xue, Kaitao Song, Duocai Wu, Xu Tan 외

Rap generation, which aims to produce lyrics and corresponding singing beats, needs to model both rhymes and rhythms. Previous works for rap generation focused on rhyming lyrics but ignored rhythmic beats, which are impo…

Language ModelingLanguage ModellingRhythm