paper-with-me

홈 › Papers

FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation

2026-06-11 · Chengbo Yuan, Zicheng Zhang, Mingjie Zhou, Wendi Chen, Yi Wang, Zhuoyang Liu, Dantong Niu, Shuo Wang, Hui Zhang, Wenkang Zhang, Yingdong Hu, Yuanqing Gong, Wanli Xing, Chuan Wen, Cewu Lu, Kaifeng Zhang, Yang Gao arxiv

Despite the success of vision-based generalist robotic policies, existing tactile-based policies remain tied to fixed embodiments and sensor setups. This is because tactile signals are highly heterogeneous across hardware, making cross-sensor generalization difficult. We present FTP-1,the first generalist foundation tactile policy pretrained to acquire transferable tactile manipulation abilities across diverse sensors and embodiments. FTP-1 supports varied tactile inputs, including image-, array-, and state-based signals, by using heterogeneous encoders to project them into unified morphology-aware latent tokens that are jointly modeled by a shared tactile Transformer expert. Pretrained on around 3,000 hours of tactile manipulation data aggregated from 26 data sources, spanning human and robot demonstrations across 21 sensors, FTP-1 learns tactile skills that transfer beyond the sensors seen during pretraining. Across downstream finetuning experiments spanning 5 hardware configurations, FTP-1 improves contact-rich manipulation on seen sensor setups by +17.2% and, surprisingly, transfers to two previously unseen tactile-sensor setups, achieving a +31% gain in success rate. FTP-1 establishes the first unified foundation baseline for tactile manipulation, providing future tactile policies with a shared model-level starting point. Pretrained models, datasets, training code and more visualization at https://ftp1-policy.github.io.

📄 PDF Abstract BibTeX arXiv:2606.13102

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

N_0-VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokens

2026-07-26 · NeoteAI Team, Fudan TEAI Team hf

We present N_0-VTLA, a vision-tactile-language-action (VTLA) foundation model capable of (1) fine-grained contact-rich manipulation with tactile perception and tactile-feedback control, and (2) offline policy improvement…

Reinforcement Learning

TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation

2026-07-08 · Jianyi Zhou, Feiyang Hong, Yunhao Li, Yicheng Zhao 외 arxiv

Dexterous manipulation in everyday environments requires both anticipation and reaction: a robot must predict how contact should evolve while rapidly correcting local errors caused by slip, misalignment, unstable graspin…

ReTac-ACT: A State-Gated Vision-Tactile Fusion Transformer for Precision Assembly

2026-03-10 · Minchi Ruan, LiangQing Zhou, Hongtong Li, Zongtao Wang 외 arxiv

Precision assembly requires sub-millimeter corrections in contact-rich "last-millimeter" regions where visual feedback fails due to occlusion from the end-effector and workpiece. We present ReTac-ACT (Reconstruction-enha…

TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulation

2026-01-28 · Yuzhe Huang, Pei Lin, Wanlin Li, Daohan Li 외 arxiv

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition …

Physical Intuition

OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies

2026-07-04 · Kelin Yu, Haode Zhang, Harish Ravichandar, Yunhai Han 외 hf

Visual policies learned from human videos, teleoperation, and robot demonstrations offer scalable motion priors, but often fail in contact-rich manipulation, where success significantly depends on local force and contact…