paper-with-me

홈 › Papers

Action Conditioned Tactile Prediction: case study on slip prediction

2022-05-19 · Willow Mandil, Kiyanoush Nazari, Amir Ghalamzan E

Tactile predictive models can be useful across several robotic manipulation tasks, e.g. robotic pushing, robotic grasping, slip avoidance, and in-hand manipulation. However, available tactile prediction models are mostly studied for image-based tactile sensors and there is no comparison study indicating the best performing models. In this paper, we presented two novel data-driven action-conditioned models for predicting tactile signals during real-world physical robot interaction tasks (1) action condition tactile prediction and (2) action conditioned tactile-video prediction models. We use a magnetic-based tactile sensor that is challenging to analyse and test state-of-the-art predictive models and the only existing bespoke tactile prediction model. We compare the performance of these models with those of our proposed models. We perform the comparison study using our novel tactile-enabled dataset containing 51,000 tactile frames of a real-world robotic manipulation task with 11 flat-surfaced household objects. Our experimental results demonstrate the superiority of our proposed tactile prediction models in terms of qualitative, quantitative and slip prediction scores.

📄 PDF Abstract BibTeX arXiv:2205.09430

Code (1)

imanlab/action_conditioned_tactile_prediction 공식 구현 pytorch

Tasks

PredictionRobotic GraspingVideo Prediction

Similar Papers 제목 키워드 기반

TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation

2026-07-08 · Jianyi Zhou, Feiyang Hong, Yunhao Li, Yicheng Zhao 외 arxiv

Dexterous manipulation in everyday environments requires both anticipation and reaction: a robot must predict how contact should evolve while rapidly correcting local errors caused by slip, misalignment, unstable graspin…

TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation

2026-09-04 · Zipei Ma, Xiaofei Wei, Junzhe Jiang, Shunlin Lu 외 arxiv

World-action models guide action generation with predicted future observations, but vision-centric predictions miss the local contact cues that decide contact-rich manipulation. However, naively predicting future tactile…

Phy-Tac: Toward Human-Like Grasping via Physics-Conditioned Tactile Goals

2025-11-03 · Shipeng Lyu, Lijie Sheng, Fangyuan Wang, Wenyao Zhang 외 arxiv

Humans naturally grasp objects with minimal level required force for stability, whereas robots often rely on rigid, over-squeezing control. To narrow this gap, we propose a human-inspired physics-conditioned tactile meth…

TLA: Tactile-Language-Action Model for Contact-Rich Manipulation

2025-03-11 · Peng Hao, Chaofan Zhang, Dingzhe Li, Xiaoge Cao 외

Significant progress has been made in vision-language models. However, language-conditioned robotic manipulation for contact-rich tasks remains underexplored, particularly in terms of tactile sensing. To address this gap…

Action GenerationContact-rich ManipulationImitation Learning

Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation

2026-07-16 · Ruilin Chen, Jingkai Jia, Tong Yang, Xinyu Zhou 외 arxiv

Tactile-enhanced vision-language-action (VLA) policies have been introduced for contact-rich manipulation, where critical interaction states are often hidden from vision. Future tactile prediction is a promising way to u…