paper-with-me

홈 › Papers

Semi-Supervised Vision-Language-Action Model

2026-06-19 · Hongyang He, Jiuming Liu, Victor Sanchez arxiv

Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10\% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0\% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.

📄 PDF Abstract BibTeX arXiv:2606.21493

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction

2020-10-14 · EMNLP 2020 11 · Xu Zhao, ZiHao Wang, Hao Wu, Yong Zhang

Semi-supervision is a promising paradigm for Bilingual Lexicon Induction (BLI) with limited annotations. However, previous semisupervised methods do not fully utilize the knowledge hidden in annotated and nonannotated da…

Bilingual Lexicon InductionVocal Bursts Valence Prediction

SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidance

2023-11-27 · Lukas Hoyer, David Joseph Tan, Muhammad Ferjad Naeem, Luc van Gool 외

In semi-supervised semantic segmentation, a model is trained with a limited number of labeled images along with a large corpus of unlabeled images to reduce the high annotation effort. While previous methods are able to …

DecoderSegmentationSemantic SegmentationSemi-Supervised Semantic Segmentation

Learning Temporal Action Proposals With Fewer Labels

2019-10-03 · ICCV 2019 10 · Jingwei Ji, Kaidi Cao, Juan Carlos Niebles

Temporal action proposals are a common module in action detection pipelines today. Most current methods for training action proposal modules rely on fully supervised approaches that require large amounts of annotated tem…

Action DetectionSemi-Supervised Action Detection

Vision-Language Enhanced Foundation Model for Semi-supervised Medical Image Segmentation

2025-11-24 · Jiaqi Guo, Mingzhen Li, Hanyu Su, Santiago López 외 arxiv

Semi-supervised learning (SSL) has emerged as an effective paradigm for medical image segmentation, reducing the reliance on extensive expert annotations. Meanwhile, vision-language models (VLMs) have demonstrated strong…

Semi-supervised Medical Image Segmentation

SelfPrompt: Confidence-Aware Semi-Supervised Tuning for Robust Vision-Language Model Adaptation

2025-01-24 · Shuvendu Roy, Ali Etemad

We present SelfPrompt, a novel prompt-tuning approach for vision-language models (VLMs) in a semi-supervised learning setup. Existing methods for tuning VLMs in semi-supervised setups struggle with the negative impact of…

Language ModelingLanguage ModellingPseudo LabelWeakly-supervised Learning