paper-with-me

Papers

Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference

2026-07-14 · Yuzhou Wu, Yuxin Zheng, Muchun Niu, Yishan Yang, Tianhao Liu, hanwen kang, Jiajian Jing, Linfeng Zhang, Chuan Wen arxiv

Vision-Language-Action (VLA) models exhibit strong generalization for robotic manipulation, yet their high inference latency limits real time deployment. We identify two primary sources of temporal redundancy in existing VLA pipelines: repeated visual encoding of highly similar consecutive frames and multi step iterative sampling in diffusion based policies. To address this, we propose a system level acceleration strategy that reduces computation in both perception and action generation. On the perception side, we incrementally update only tokens corresponding to dynamic scene regions instead of re-encoding entire frames. On the policy side, we compress diffusion sampling into a compact 2-step schedule through efficiency oriented training while preserving action precision. Experiments on Libero, RobotWin, and Real Robot Platforms demonstrate over 2 times speedup while maintaining high performance, achieving up to 98% success rate on general manipulation benchmarks. Our codes will be released on Github.

📄 PDF Abstract BibTeX arXiv:2607.12287

Code (2)

BaiShuanghao/my_arXiv_daily ★ 201
arxivsub/arXivSub_daily_arxiv ★ 3

Similar Papers 제목 키워드 기반

InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models

2026-06-01 · Xinxin Liu, Shiwei Gan, Xiao Liu, Yafeng Yin 외 arxiv

Video Large Language Models (Video-LLMs) achieve strong performance in video understanding, but their excessive visual tokens bring substantial computational overhead. Existing training-free compression methods improve i…

HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving

2026-02-11 · Yiru Wang, Zichong Gu, Yu Gao, Anqing Jiang 외 arxiv

Vision-Language-Action (VLA) models offer promising capabilities for autonomous driving through multimodal understanding. However, their utilization in safety-critical scenarios is constrained by inherent limitations, in…

Computational EfficiencyAutonomous Driving

$R^2$-dLLM: Accelerating Diffusion Large Language Models via Spatio-Temporal Redundancy Reduction

2026-04-21 · Zhenbang Du, Kejing Xia, Xinrui Zhong, Yonggan Fu 외 arxiv

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to autoregressive generation by enabling parallel token prediction. However, practical dLLM decoding still suffers from high inference laten…

ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding

2024-12-29 · Xiao Wang, Qingyi Si, Jianlong Wu, Shiyu Zhu 외

Video Large Language Models (VideoLLMs) have made significant strides in video understanding but struggle with long videos due to the limitations of their backbone LLMs. Existing solutions rely on length extrapolation, w…

Video CompressionVideo Understanding

Listen to Look: Action Recognition by Previewing Audio

2019-12-10 · CVPR 2020 6 · Ruohan Gao, Tae-Hyun Oh, Kristen Grauman, Lorenzo Torresani

In the face of the video data deluge, today's expensive clip-level classifiers are increasingly impractical. We propose a framework for efficient action recognition in untrimmed video that uses audio as a preview mechani…

Action Recognition