paper-with-me

Papers

VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model

2025-09-11 · Yihao Wang, Pengxiang Ding, Lingxiao Li, Can Cui, Zirui Ge, Xinyang Tong, Wenxuan Song, Han Zhao, Wei Zhao, Pengxu Hou, Siteng Huang, Yifan Tang, Wenhui Wang, Ru Zhang, Jianyi Liu, Donglin Wang arxiv

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs significant training costs. In this paper, we investigate how to effectively bridge vision-language (VL) representations to action (A). We introduce VLA-Adapter, a novel paradigm designed to reduce the reliance of VLA models on large-scale VLMs and extensive pre-training. To this end, we first systematically analyze the effectiveness of various VL conditions and present key findings on which conditions are essential for bridging perception and action spaces. Based on these insights, we propose a lightweight Policy module with Bridge Attention, which autonomously injects the optimal condition into the action space. In this way, our method achieves high performance using only a 0.5B-parameter backbone, without any robotic data pre-training. Extensive experiments on both simulated and real-world robotic benchmarks demonstrate that VLA-Adapter not only achieves state-of-the-art level performance, but also offers the fast inference speed reported to date. Furthermore, thanks to the proposed advanced bridging paradigm, VLA-Adapter enables the training of a powerful VLA model in just 8 hours on a single consumer-grade GPU, greatly lowering the barrier to deploying the VLA model. Project page: https://vla-adapter.github.io/.

📄 PDF Abstract BibTeX arXiv:2509.09372

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters

2022-10-18 · Hongyu Zhao, Hao Tan, Hongyuan Mei

Adapter-tuning is a paradigm that transfers a pretrained language model to downstream tasks by adding and tuning a small number of new parameters. Previously proposed adapter architectures are all feed-forward neural net…

Language ModelingLanguage ModellingMixture-of-ExpertsTransfer Learning

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves

2024-12-16 · CVPR 2025 1 · Shihan Wu, Ji Zhang, Pengpeng Zeng, Lianli Gao 외

Prompt tuning (PT) has long been recognized as an effective and efficient paradigm for transferring large pre-trained vision-language models (VLMs) to downstream tasks by learning a tiny set of context vectors. Neverthel…

Transfer Learning

1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions

2023-01-01 · CVPR 2023 1 · Dongshuo Yin, Yiran Yang, Zhechao Wang, Hongfeng Yu 외

Fine-tuning large-scale pre-trained vision models to downstream tasks is a standard technique for achieving state-of-the-art performance on computer vision benchmarks. However, fine-tuning the whole model with millio…

Instance Segmentationobject-detectionObject DetectionSegmentation+1

Conv-Adapter: Exploring Parameter Efficient Transfer Learning for ConvNets

2022-08-15 · Hao Chen, Ran Tao, Han Zhang, Yidong Wang 외

While parameter efficient tuning (PET) methods have shown great potential with transformer architecture on Natural Language Processing (NLP) tasks, their effectiveness with large-scale ConvNets is still under-studied on …

Transfer Learning

Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling

2021-11-06 · Renrui Zhang, Rongyao Fang, Wei zhang, Peng Gao 외

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot kno…

Language ModelingLanguage ModellingTransfer Learning