paper-with-me

Papers

CPC-VAR:Continual Personalized and Compositional Generation in Visual Autoregressive Models

2026-05-19 · Junhao Li, Xinhao Zhong, Yi sun, Yuxia Qiao, Bin Chen, Shu-Tao Xia, Yaowei Wang arxiv

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings, failing to accommodate evolving user demands. In particular, sequential concept learning leads to severe catastrophic forgetting, while multi-concept synthesis often suffers from feature entanglement and attribute inconsistency. In this work, we present the first systematic study of continual personalized generation in VAR models. We identify two key challenges: (i) preserving previously learned concepts during sequential customization, and (ii) composing multiple personalized concepts in a controllable manner. To address these issues, we propose a unified framework with two core components. For continual single-concept learning, we introduce Gradient-based Concept Neuron Selection (GCNS), which identifies concept-relevant neurons and constrains only conflicting parameters across tasks, effectively mitigating forgetting without additional model expansion. For multi-concept synthesis, we propose a context-aware composition strategy that performs multi-branch feature modeling and localized cross-attention fusion guided by spatial conditions, enabling precise and disentangled concept composition. Extensive experiments demonstrate that our method significantly improves performance in long-sequence continual personalization while achieving superior results in multi-concept image synthesis compared to existing baselines. These findings highlight the potential of VAR models for scalable and controllable personalized generation.

📄 PDF Abstract BibTeX arXiv:2605.19750

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models

2024-10-30 · Arash Marioriyad, Parham Rezaei, Mahdieh Soleymani Baghshah, Mohammad Hossein Rohban

Text-to-image (T2I) generative models, such as Stable Diffusion and DALL-E, have shown remarkable proficiency in producing high-quality, realistic, and natural images from textual descriptions. However, these models some…

Image Generation

Visually Grounded Continual Learning of Compositional Phrases

2020-05-02 · EMNLP 2020 11 · Xisen Jin, Junyi Du, Arka Sadhu, Ram Nevatia 외

Humans acquire language continually with much more limited access to data samples at a time, as compared to contemporary NLP systems. To study this human-like language acquisition ability, we present VisCOLL, a visually …

Continual LearningGrounded language learningLanguage AcquisitionLanguage Modelling

Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control

2026-06-26 · Haoyuan Wang, Yabo Chen, Haibin Huang, Chi Zhang 외 arxiv

Building interactive world models requires generating realistic videos while maintaining controllable dynamics over long horizons. Autoregressive video generation offers a scalable foundation, but suffers from error accu…

Video Generation

Continual Sequence Generation with Adaptive Compositional Modules

2022-03-20 · ACL 2022 5 · Yanzhe Zhang, Xuezhi Wang, Diyi Yang

Continual learning is essential for real-world deployment when there is a need to quickly adapt the model to new tasks without forgetting knowledge of old tasks. Existing work on continual sequence generation either alwa…

Continual LearningTransfer Learning

Chimera: Compositional Image Generation using Part-based Concepting

2025-10-20 · Shivam Singh, Yiming Chen, Agneet Chatterjee, Amit Raj 외 arxiv

Personalized image generative models are highly proficient at synthesizing images from text or a single image, yet they lack explicit control for composing objects from specific parts of multiple source images without us…

Personalized Image Generation