paper-with-me

Papers

Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models

2026-05-08 · Meng Zheng, Samhita Marri, Anwesa Choudhuri, Benjamin Planche, Zhongpai Gao, Van Nguyen Nguyen, Terrence Chen, Girish Chowdhary, Ziyan Wu arxiv

Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors rapidly compound into unrecoverable, out-of-distribution failures. To address this limitation, we propose Adaptive Failure-Informed Learning (AFIL), an end-to-end framework that leverages failure trajectories as adaptive negative guidance for diffusion- and flow-based VLA policies. AFIL uses a pretrained VLA to generate failure rollouts online, avoiding the need for handcrafted failure-mode design or human-in-the-loop recovery. It then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone, enabling efficient failure-aware policy learning with limited parameter overhead. During sampling, the failure generator adaptively steers action generation away from failure-prone regions and toward more reliable success modes, with guidance strength determined by the per-diffusion-step distance between success and failure distributions. Experiments across in-domain and out-of-domain robotic manipulation tasks, covering both short- and long-horizon settings, show that AFIL consistently improves task success rates and robustness over existing VLA baselines, demonstrating its effectiveness, efficiency, and generality.

📄 PDF Abstract BibTeX arXiv:2605.08434

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation

2026-08-30 · Run Yang, Runpeng Dai, Jie Sun, Jielei Zhang 외 hf

Sampled-token on-policy distillation (OPD) efficiently transfers capabilities from teacher to student using student-generated tokens, requiring teacher probabilities only for sampled tokens. Yet it frequently suffers fro…

Failure-informed adaptive sampling for PINNs

2022-10-01 · Zhiwei Gao, Liang Yan, Tao Zhou

Physics-informed neural networks (PINNs) have emerged as an effective technique for solving PDEs in a wide range of domains. It is noticed, however, the performance of PINNs can vary dramatically with different sampling …

Failure-informed adaptive sampling for PINNs, Part II: combining with re-sampling and subset simulation

2023-02-03 · Zhiwei Gao, Tao Tang, Liang Yan, Tao Zhou

This is the second part of our series works on failure-informed adaptive sampling for physic-informed neural networks (FI-PINNs). In our previous work \cite{gao2022failure}, we have presented an adaptive sampling framewo…

Label Propagation Training Schemes for Physics-Informed Neural Networks and Gaussian Processes

2024-04-08 · Ming Zhong, Dehao Liu, Raymundo Arroyave, Ulisses Braga-Neto

This paper proposes a semi-supervised methodology for training physics-informed machine learning methods. This includes self-training of physics-informed neural networks and physics-informed Gaussian processes in isolati…

Gaussian ProcessesPhysics-informed machine learning

Failing to See or Failing to Know? Attributing Errors in Vision-Language Models

2026-07-06 · Khang Nhat Hoang Vo, Artem Vazhentsev, Artem Shelmanov, Timothy Baldwin 외 arxiv

Vision-language models (VLMs) can recognize entities in clear images yet still fail when answering questions that require factual knowledge beyond what is directly observable. Prior work has either examined individual fa…

Visual Question Answering