paper-with-me

Papers

AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment

2026-05-17 · Weijie Kong, Zhian Su, Wei Yu, Huixu Dong arxiv

Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle to focus on task-relevant functional interaction regions, which limits their robustness in unstructured environments. Existing affordance-based methods typically rely on explicit mask injection or external perception modules, requiring additional annotations while introducing cascading perception errors and inference overhead. To address these limitations, we propose AffordVLA, an affordance-enhanced VLA framework that internalizes manipulation-centric affordance perception into VLA visual representations through implicit representation alignment. Specifically, we construct a zero-shot affordance teacher to extract task-conditioned affordance visual representations from RGB observations and language instructions. AffordVLA aligns the intermediate visual representations of the VLA with the affordance visual representations extracted by the teacher, thereby implicitly injecting manipulation-centric affordance perception into VLA visual representations and improving action accuracy. Extensive simulation and real-world experiments demonstrate that AffordVLA and its affordance teacher achieve state-of-the-art performance and outperform strong baselines. Ablation analyses show that AffordVLA effectively reshapes VLA visual representations while preserving inference efficiency, leading to improved manipulation success rates and training efficiency.

📄 PDF Abstract BibTeX arXiv:2605.17517

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

PartAfford: Part-level Affordance Discovery from 3D Objects

2022-02-28 · Chao Xu, Yixin Chen, He Wang, Song-Chun Zhu 외

Understanding what objects could furnish for humans-namely, learning object affordance-is the crux to bridge perception and action. In the vision community, prior work primarily focuses on learning object affordance with…

Object

VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection

2026-05-02 · Haowen Sun, Shaolong Zhang, Mingyang Li, Chengzhong Ma 외 arxiv

Open-vocabulary 3D affordance detection requires localizing interaction regions on point clouds given novel affordance descriptions. Recent methods extend multimodal large language models (MLLMs) with special output toke…

Affordance DetectionPoint Clouds

HRP: Human Affordances for Robotic Pre-Training

2024-07-26 · Mohan Kumar Srirama, Sudeep Dasari, Shikhar Bahl, Abhinav Gupta

In order to *generalize* to various tasks in the wild, robotic agents will need a suitable representation (i.e., vision network) that enables the robot to predict optimal actions given high dimensional vision inputs. How…

RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulation

2024-11-05 · Soroush Nasiriany, Sean Kirmani, Tianli Ding, Laura Smith 외

We explore how intermediate policy representations can facilitate generalization by providing guidance on how to perform manipulation tasks. Existing representations such as language, goal images, and trajectory sketches…

Robot Manipulation

AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding

2026-06-04 · Qize Yu, Jiadi You, Yuran Wang, Jiaqi Liang 외 arxiv

Vision-Language-Action (VLA) models leverage the rich world knowledge of pretrained vision-language models (VLMs) to enable instruction-following robotic manipulation. However, the structural mismatch between VLM semanti…

Data Augmentation