paper-with-me

홈 › Papers

Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing

2024-07-10 · Jessica Yin, Haozhi Qi, Jitendra Malik, James Pikul, Mark Yim, Tess Hellebrekers

Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signals due to the gap between tactile simulation and the real world. We introduce a sensor model for tactile skin that enables zero-shot sim-to-real transfer of ternary shear and binary normal forces. Using this model, we develop an RL policy that leverages sliding contact for dexterous in-hand translation. We conduct extensive real-world experiments to assess how tactile sensing facilitates policy adaptation to various unseen object properties and robot hand orientations. We demonstrate that our 3-axis tactile policies consistently outperform baselines that use only shear forces, only normal forces, or only proprioception. Website: https://jessicayin.github.io/tactile-skin-rl/

📄 PDF Abstract BibTeX arXiv:2407.07885

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Similar Papers 제목 키워드 기반

TacSE3: Equivariant SE(3) Motion Estimation from Low-Texture Visuotactile Images for In-Gripper Tracking and Compensation

2026-05-18 · Zhongyuan Liao, Junzhe Wang, Qingyang Liu, Zhenmin Huang 외 arxiv

Robotic in-hand manipulation requires reliable object-motion tracking under frequent visual occlusion, yet low-texture visuotactile images provide few stable correspondences for conventional image- or geometry-matching m…

SimShear: Sim-to-Real Shear-based Tactile Servoing

2025-08-28 · Kipp McAdam Freud, Yijiong Lin, Nathan F. Lepora arxiv

We present SimShear, a sim-to-real pipeline for tactile control that enables the use of shear information without explicitly modeling shear dynamics in simulation. Shear, arising from lateral movements across contact sur…

Tactile Image-to-Image Disentanglement of Contact Geometry from Motion-Induced Shear

2021-09-08 · Anupam K. Gupta, Laurence Aitchison, Nathan F. Lepora

Robotic touch, particularly when using soft optical tactile sensors, suffers from distortion caused by motion-dependent shear. The manner in which the sensor contacts a stimulus is entangled with the tactile information …

DisentanglementObject Reconstruction

HydroShear: Hydroelastic Shear Simulation for Tactile Sim-to-Real Reinforcement Learning

2026-02-28 · An Dang, Jayjun Lee, Mustafa Mukadam, X. Alice Wu 외 arxiv

In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Existing methods primarily focus on vision-based sensors and emphasize image rendering quality while providing overly s…

Reinforcement Learning

Embodied Tactile Perception of Soft Objects Properties

2025-08-13 · Anirvan Dutta, Alexis WM Devillard, Zhihuan Zhang, Xiaoxiao Cheng 외 arxiv

To enable robots to develop human-like fine manipulation, it is essential to understand how mechanical compliance, multi-modal sensing, and purposeful interaction jointly shape tactile perception. In this study, we use a…