paper-with-me

홈 › Papers

EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models

2025-06-11 · Yantai Yang, Yuhao Wang, Zichen Wen, Luo Zhongwei, Chang Zou, Zhipeng Zhang, Chuan Wen, Linfeng Zhang

Vision-Language-Action (VLA) models, particularly diffusion-based architectures, demonstrate transformative potential for embodied intelligence but are severely hampered by high computational and memory demands stemming from extensive inherent and inference-time redundancies. While existing acceleration efforts often target isolated inefficiencies, such piecemeal solutions typically fail to holistically address the varied computational and memory bottlenecks across the entire VLA pipeline, thereby limiting practical deployability. We introduce EfficientVLA, a structured and training-free inference acceleration framework that systematically eliminates these barriers by cohesively exploiting multifaceted redundancies. EfficientVLA synergistically integrates three targeted strategies: (1) pruning of functionally inconsequential layers from the language module, guided by an analysis of inter-layer redundancies; (2) optimizing the visual processing pathway through a task-aware strategy that selects a compact, diverse set of visual tokens, balancing task-criticality with informational coverage; and (3) alleviating temporal computational redundancy within the iterative diffusion-based action head by strategically caching and reusing key intermediate features. We apply our method to a standard VLA model CogACT, yielding a 1.93X inference speedup and reduces FLOPs to 28.9%, with only a 0.6% success rate drop in the SIMPLER benchmark.

📄 PDF Abstract BibTeX arXiv:2506.10100

Code (0)

등록된 구현이 없습니다.

Tasks

Vision-Language-Action

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

VisionTrim: Unified Vision Token Compression for Training-Free MLLM Acceleration

2026-01-30 · Hanxun Yu, Wentong Li, Xuan Qu, Song Wang 외 arxiv

Multimodal large language models (MLLMs) suffer from high computational costs due to excessive visual tokens, particularly in high-resolution and video-based scenarios. Existing token reduction methods typically focus on…

Token Transforming: A Unified and Training-Free Token Compression Framework for Vision Transformer Acceleration

2025-06-06 · Fanhu Zeng, Deli Yu, Zhenglun Kong, Hao Tang

Vision transformers have been widely explored in various vision tasks. Due to heavy computational cost, much interest has aroused for compressing vision transformer dynamically in the aspect of tokens. Current methods ma…

Depth Estimationobject-detectionObject DetectionToken Reduction

AdaMerge: Salience-Aware Adaptive Token Merging for Training-Free Acceleration of Vision Transformers

2026-05-26 · Semi Lee, Hyejin Go, Hyesong Choi arxiv

The quadratic cost of self-attention in Vision Transformers (ViTs) constitutes a fundamental bottleneck for practical deployment, motivating a vibrant line of research on token reduction. Among existing approaches, token…

PixelPrune: Pixel-Level Adaptive Visual Token Reduction via Predictive Coding

2026-04-01 · Nan Wang, Zhiwei Jin, Chen Chen, Haonan Lu arxiv

Document understanding and GUI interaction are among the highest-value applications of Vision-Language Models (VLMs), yet they impose exceptionally heavy computational burden: fine-grained text and small UI elements dema…

SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models

2025-09-11 · Hengyu Fang, Yijiang Liu, Yuan Du, Li Du 외 arxiv

Vision-Language-Action (VLA) models exhibit unprecedented capabilities for embodied intelligence. However, their extensive computational and memory costs hinder their practical deployment. Existing VLA compression and ac…

Computational Efficiency