paper-with-me

홈 › Papers

CART: Compositional Auto-Regressive Transformer for Image Generation

2024-11-15 · Siddharth Roheda

In recent years, image synthesis has achieved remarkable advancements, enabling diverse applications in content creation, virtual reality, and beyond. We introduce a novel approach to image generation using Auto-Regressive (AR) modeling, which leverages a next-detail prediction strategy for enhanced fidelity and scalability. While AR models have achieved transformative success in language modeling, replicating this success in vision tasks has presented unique challenges due to the inherent spatial dependencies in images. Our proposed method addresses these challenges by iteratively adding finer details to an image compositionally, constructing it as a hierarchical combination of base and detail image factors. This strategy is shown to be more effective than the conventional next-token prediction and even surpasses the state-of-the-art next-scale prediction approaches. A key advantage of this method is its scalability to higher resolutions without requiring full model retraining, making it a versatile solution for high-resolution image generation.

📄 PDF Abstract BibTeX arXiv:2411.10180

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationLanguage ModelingLanguage ModellingPrediction

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Harnessing Dataset Cartography for Improved Compositional Generalization in Transformers

2023-10-18 · Osman Batur İnce, Tanin Zeraati, Semih Yagcioglu, Yadollah Yaghoobzadeh 외

Neural networks have revolutionized language modeling and excelled in various downstream tasks. However, the extent to which these models achieve compositional generalization comparable to human cognitive abilities remai…

Language ModelingLanguage Modelling

UNCAGE: Contrastive Attention Guidance for Masked Generative Transformers in Text-to-Image Generation

2025-08-07 · Wonjun Kang, Byeongkeun Ahn, Minjae Lee, Kevin Galim 외 arxiv

Text-to-image (T2I) generation has been actively studied using Diffusion Models and Autoregressive Models. Recently, Masked Generative Transformers have gained attention as an alternative to Autoregressive Models to over…

Text-to-Image Generation

Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks

2023-11-21 · Rahul Ramesh, Ekdeep Singh Lubana, Mikail Khona, Robert P. Dick 외

Transformers trained on huge text corpora exhibit a remarkable set of capabilities, e.g., performing basic arithmetic. Given the inherent compositional nature of language, one can expect the model to learn to compose the…

Knee Cartilage Segmentation Using Diffusion-Weighted MRI

2019-12-04 · Alejandra Duarte, Chaitra V. Hegde, Aakash Kaku, Sreyas Mohan 외

The integrity of articular cartilage is a crucial aspect in the early diagnosis of osteoarthritis (OA). Many novel MRI techniques have the potential to assess compositional changes of the cartilage extracellular matrix. …

Segmentation

Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models

2024-10-30 · Arash Marioriyad, Parham Rezaei, Mahdieh Soleymani Baghshah, Mohammad Hossein Rohban

Text-to-image (T2I) generative models, such as Stable Diffusion and DALL-E, have shown remarkable proficiency in producing high-quality, realistic, and natural images from textual descriptions. However, these models some…

Image Generation