paper-with-me

Papers

FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Models

2025-12-18 · Senmao Li, Kai Wang, Salman Khan, Fahad Shahbaz Khan, Jian Yang, Yaxing Wang arxiv

Visual Autoregressive (VAR) modeling departs from the next-token prediction paradigm of traditional Autoregressive (AR) models through next-scale prediction, enabling high-quality image generation. However, the VAR paradigm suffers from sharply increased computational complexity and running time at large-scale steps. Although existing acceleration methods reduce runtime for large-scale steps, but rely on manual step selection and overlook the varying importance of different stages in the generation process. To address this challenge, we present FasterVAR, a systematic study and plug-and-play acceleration framework for VAR models. Our analysis shows that early steps are critical for preserving semantic and structural consistency and should remain intact,while later steps mainly refine details and can be pruned or approximated for acceleration. Building on these insights, FasterVAR introduces a plug-and-play acceleration strategy that exploits semantic irrelevance and low-rank properties in late-stage computations, without requiring additional training. Our proposed FasterVAR achieves up to 3.4x speedup with almost no performance loss. consistently outperforming existing acceleration baselines.These results highlight stage-aware design as a powerful principle for efficient visual autoregressive image generation.

📄 PDF Abstract BibTeX arXiv:2512.16483

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis

2025-07-28 · Zhuokun Chen, Jugang Fan, Zhuowei Yu, Bohan Zhuang 외 arxiv

Visual autoregressive modeling, based on the next-scale prediction paradigm, exhibits notable advantages in image quality and model scalability over traditional autoregressive and diffusion models. It generates images by…

Image Generation

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules

2023-10-24 · Chaojun Xiao, Yuqi Luo, Wenbin Zhang, Pengle Zhang 외

Pre-trained language models (PLMs) have achieved remarkable results on NLP tasks but at the expense of huge parameter sizes and the consequent computational costs. In this paper, we propose Variator, a parameter-efficien…

Computational Efficiency

BiTA: Bi-Directional Tuning for Lossless Acceleration in Large Language Models

2024-01-23 · Feng Lin, Hanling Yi, Hongbin Li, Yifan Yang 외

Large language models (LLMs) commonly employ autoregressive generation during inference, leading to high memory bandwidth demand and consequently extended latency. To mitigate this inefficiency, we present Bi-directional…

Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models

2025-05-20 · Xuyang Liu, Yiyu Wang, Junpeng Ma, Linfeng Zhang

Video large language models (VideoLLM) excel at video understanding, but face efficiency challenges due to the quadratic complexity of abundant visual tokens. Our systematic analysis of token compression methods for Vide…

Video CompressionVideo Understanding

Visual Self-Refinement for Autoregressive Models

2025-10-01 · Jiamian Wang, Ziqi Zhou, Chaithanya Kumar Mummadi, Sohail Dianat 외 arxiv

Autoregressive models excel in sequential modeling and have proven to be effective for vision-language data. However, the spatial nature of visual signals conflicts with the sequential dependencies of next-token predicti…