paper-with-me

Papers

History-Conditioned Spatio-Temporal Visual Token Pruning for Efficient Vision-Language Navigation

2026-03-06 · Qitong Wang, Yijun Liang, Ming Li, Tianyi Zhou, Christopher Rasmussen arxiv

Vision-Language Navigation (VLN) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems. Recent Vision-Language-Action (VLA) models have demonstrated strong navigation performance, but their high computational cost introduces latency that limits real-time deployment. We propose a training-free spatio-temporal vision token pruning framework tailored to VLA-based VLN. We apply spatial token selection to the current view, alongside spatio-temporal compression for historical memories, enabling efficient long-horizon inference while reducing redundant computation. Leveraging attention-based token importance and query-guided spatio-temporal filtering, the proposed approach preserves navigation-relevant information without retraining or modifying pretrained models, allowing plug-and-play integration into existing VLA systems. Through experiments on standard VLN benchmarks, we confirm that our method significantly outperforms existing pruning strategies. It successfully preserves superior navigation accuracy under extreme pruning scenarios, all while maintaining the highly competitive inference efficiency. Real-world deployment on a Unitree Go2 quadruped robot further validates reliable and low-latency instruction-following navigation under practical robotic constraints. We hope this work helps bridge the gap between large-scale multimodal modeling and efficient, real-time embodied deployment in robotic navigation systems. Project Page: https://wqtwjt1996.github.io/publications/2026-vln.html

📄 PDF Abstract BibTeX arXiv:2603.06480

Code (0)

등록된 구현이 없습니다.

Tasks

Vision-Language Navigation

Similar Papers 제목 키워드 기반

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens

2024-12-13 · Zhuqiang Lu, Zhenfei Yin, Mengwei He, Zhihui Wang 외

Recently, Vision Large Language Models (VLLMs) integrated with vision encoders have shown promising performance in vision understanding. The key of VLLMs is to encode visual content into sequences of visual tokens, enabl…

Language ModelingLanguage ModellingLarge Language ModelVideo Understanding

Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition

2026-05-22 · Yerim So, Jiyeong Kim, Jiwon Yoon, Dongbo Min arxiv

Recent Open-Vocabulary Action Recognition (OVAR) methods typically aggregate visual features into a global representation before computing text alignment, a process that obscures local patch information and fine-grained …

Action Recognition

Physics-Guided Spatiotemporal State Space Modeling for Lookahead Molten Pool Segmentation in Laser Wire-Feed Welding

2026-06-22 · Sen Li, Haichao Cui, Changhao Yin, Chendong Shao 외 arxiv

Real-time weld-pool perception is critical for closed-loop control in laser wire-feed welding, where sensing, computation, and actuator response introduce unavoidable delay. This paper presents a physics-guided spatiotem…

TubeRMC: Tube-conditioned Reconstruction with Mutual Constraints for Weakly-supervised Spatio-Temporal Video Grounding

2025-11-13 · Jinxuan Li, Yi Zhang, Jian-Fang Hu, Chaolei Tan 외 arxiv

Spatio-Temporal Video Grounding (STVG) aims to localize a spatio-temporal tube that corresponds to a given language query in an untrimmed video. This is a challenging task since it involves complex vision-language unders…

Spatio-Temporal Video GroundingVisual Grounding

CaST-POI: Candidate-Conditioned Spatiotemporal Modeling for Next POI Recommendation

2026-02-10 · Zhenyu Yu, Chunlei Meng, Yangchen Zeng, Mohd Yamani Idna Idris 외 arxiv

Next Point-of-Interest (POI) recommendation plays a crucial role in location-based services by predicting users' future mobility patterns. Existing methods typically compute a single user representation from historical t…