paper-with-me

Papers

LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer

2026-02-11 · Lihan Zha, Asher J. Hancock, Mingtong Zhang, Tenny Yin, Yixuan Huang, Dhruv Shah, Allen Z. Ren, Anirudha Majumdar arxiv

A long-standing goal in robotics is a generalist policy that can be deployed zero-shot on new robot embodiments without per-embodiment adaptation. Despite large-scale multi-embodiment pre-training, existing Vision-Language-Action models (VLAs) remain tightly coupled to their training embodiments and typically require costly fine-tuning. We introduce Language-Action Pre-training (LAP), a simple recipe that represents low-level robot actions directly in natural language, aligning action supervision with the pre-trained vision-language model's input-output distribution. LAP requires no learned tokenizer, no costly annotation, and no embodiment-specific architectural design. Based on LAP, we present LAP-3B, which to the best of our knowledge is the first VLA to achieve substantial zero-shot transfer to previously unseen robot embodiments without any embodiment-specific fine-tuning. Across multiple novel robots and manipulation tasks, LAP-3B attains over 50% average zero-shot success, delivering roughly a 2x improvement over the strongest prior VLAs. We further show that LAP enables efficient adaptation and favorable scaling, while unifying action prediction and VQA in a shared language-action format that yields additional gains through co-training.

📄 PDF Abstract BibTeX arXiv:2602.10556

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Telling Stories for Common Sense Zero-Shot Action Recognition

2023-09-29 · Shreyank N Gowda, Laura Sevilla-Lara

Video understanding has long suffered from reliance on large labeled datasets, motivating research into zero-shot learning. Recent progress in language modeling presents opportunities to advance zero-shot video analysis,…

Action RecognitionArticlesCommon Sense ReasoningLanguage Modeling+6

Tree-of-Traversals: A Zero-Shot Reasoning Algorithm for Augmenting Black-box Language Models with Knowledge Graphs

2024-07-31 · Elan Markowitz, Anil Ramakrishna, Jwala Dhamala, Ninareh Mehrabi 외

Knowledge graphs (KGs) complement Large Language Models (LLMs) by providing reliable, structured, domain-specific, and up-to-date external knowledge. However, KGs and LLMs are often developed separately and must be integ…

Knowledge GraphsQuestion Answering

MASTE: A Multi-Agent Pipeline for Zero-Shot Aspect Sentiment Triplet Extraction

2026-07-09 · Ao Hong, Lehang Wang, Zhirun Yue, Mingxin Wang 외 arxiv

Aspect Sentiment Triplet Extraction (ASTE) requires jointly identifying (aspect, opinion, sentiment) triples from a given review sentence. While large language models (LLMs) achieve strong zero-shot performance on many N…

Aspect Sentiment Triplet Extraction

MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge

2023-03-15 · ICCV 2023 1 · Wei Lin, Leonid Karlinsky, Nina Shvetsova, Horst Possegger 외

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing,…

Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionImage Generation+4

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation

2021-09-23 · EMNLP 2021 11 · Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong 외

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-…

Factual probeLanguage ModelingLanguage ModellingOpen Information Extraction+2