paper-with-me

Papers

SCALAR: Scale-wise Controllable Visual Autoregressive Learning

2025-07-26 · Ryan Xu, Dongyang Jin, Yancheng Bai, Rui Lan, Xu Duan, Lei Sun, Xiangxiang Chu arxiv

Controllable image synthesis, which enables fine-grained control over generated outputs, has emerged as a key focus in visual generative modeling. However, controllable generation remains challenging for Visual Autoregressive (VAR) models due to their hierarchical, next-scale prediction style. Existing VAR-based methods often suffer from inefficient control encoding and disruptive injection mechanisms that compromise both fidelity and efficiency. In this work, we present SCALAR, a controllable generation method based on VAR, incorporating a novel Scale-wise Conditional Decoding mechanism. SCALAR leverages a pretrained image encoder to extract semantic control signal encodings, which are projected into scale-specific representations and injected into the corresponding layers of the VAR backbone. This design provides persistent and structurally aligned guidance throughout the generation process. Building on SCALAR, we develop SCALAR-Uni, a unified extension that aligns multiple control modalities into a shared latent space, supporting flexible multi-conditional guidance in a single model. Extensive experiments show that SCALAR achieves superior generation quality and control precision across various tasks. The code is released at https://github.com/AMAP-ML/SCALAR.

📄 PDF Abstract BibTeX arXiv:2507.19946

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CAR: Controllable Autoregressive Modeling for Visual Generation

2024-10-07 · Ziyu Yao, Jialin Li, Yifeng Zhou, Yong liu 외

Controllable generation, which enables fine-grained control over generated outputs, has emerged as a critical focus in visual generative models. Currently, there are two primary technical approaches in visual generation:…

TRACE: Training and Inference-Time Interpretability Analysis for Language Models

2025-07-04 · Nura Aljaafari, Danilo S. Carvalho, André Freitas arxiv

Understanding when and how linguistic knowledge emerges during language model training remains a central challenge for interpretability. Most existing tools are post hoc, rely on scalar metrics, or require nontrivial int…

ScaleWeaver: Weaving Efficient Controllable T2I Generation with Multi-Scale Reference Attention

2025-10-16 · Keli Liu, Zhendong Wang, Wengang Zhou, Shaodong Xu 외 arxiv

Text-to-image generation with visual autoregressive~(VAR) models has recently achieved impressive advances in generation fidelity and inference efficiency. While control mechanisms have been explored for diffusion models…

parameter-efficient fine-tuningText-to-Image Generation

Fractal Autoregressive Depth Estimation with Continuous Token Diffusion

2026-03-16 · Jinchang Zhang, Xinrou Kang, Guoyu Lu arxiv

Monocular depth estimation can benefit from autoregressive (AR) generation, but direct AR modeling is hindered by the modality gap between RGB and depth, inefficient pixel-wise generation, and instability in continuous d…

Monocular Depth EstimationComputational Efficiency

ICAS: Detecting Training Data from Autoregressive Image Generative Models

2025-07-07 · Hongyao Yu, Yixiang Qiu, Yiheng Yang, Hao Fang 외 arxiv

Autoregressive image generation has witnessed rapid advancements, with prominent models such as scale-wise visual auto-regression pushing the boundaries of visual synthesis. However, these developments also raise signifi…

Image Generation