VBT-MPC: Vision-Based Tactile MPC for Contour Following

2026-05-19 · Edison Velasco-Sanchez, Luis F. Recalde, Guanrui Li, Pablo Gil arxiv

Tactile sensing plays a key role in robotic manipulation, particularly in tasks like surface inspection. Successful execution requires maintaining contact while accurately tracking object contours. In this work, we propose a Vision-Based Tactile Model Predictive Control (VBT-MPC) framework for robotic contour following using a Vision-Based Tactile Sensor (VBTS) mounted in an eye-in-hand configuration. The proposed controller operates directly in contour features space, thereby avoiding the need for separate pose-estimation modules or complex force-control architectures. We further compare our VBT-MPC with visual-servoing strategies adapted to tactile features, and evaluate contour tracking on objects with diverse geometries and materials in both simulation and real-world experiments.

📄 PDF Abstract BibTeX arXiv:2605.20392

Code (0)

등록된 구현이 없습니다.

Transparent Fragments Contour Estimation via Visual-Tactile Fusion for Autonomous Reassembly

2026-03-18 · Qihao Lin, Borui Chen, Yuping Zhou, Jianing Wu 외 arxiv

The contour estimation of transparent fragments is very important for autonomous reassembly, especially in the fields of precision optical instrument repair, cultural relic restoration, and identification of other precio…

Synthetic Data Generation

Visual-Tactile Multimodality for Following Deformable Linear Objects Using Reinforcement Learning

2022-03-31 · Leszek Pecyna, Siyuan Dong, Shan Luo

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile in…

reinforcement-learning Reinforcement Learning (RL)

Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalization

2025-07-12 · Jialei Huang, Shuo Wang, Fanqi Lin, Yihang Hu 외 arxiv

Vision-Language-Action (VLA) models have shown remarkable achievements, driven by the rich implicit knowledge of their vision-language components. However, achieving generalist robotic agents demands precise grounding in…

Zero-shot Generalization Instruction Following

TacShade A New 3D-printed Soft Optical Tactile Sensor Based on Light, Shadow and Greyscale for Shape Reconstruction

2024-06-01 · Zhenyu Lu, Jialong Yang, Haoran Li, YiFan Li 외

In this paper, we present the TacShade a newly designed 3D-printed soft optical tactile sensor. The sensor is developed for shape reconstruction under the inspiration of sketch drawing that uses the density of sketch lin…

Whisker-based Tactile Flight for Tiny Drones

2025-10-03 · Chaoxiang Ye, Guido de Croon, Salua Hamaza arxiv

Tiny flying robots hold great potential for search-and-rescue, safety inspections, and environmental monitoring, but their small size limits conventional sensing-especially with poor-lighting, smoke, dust or reflective o…

Depth Estimation