paper-with-me

Papers

DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity

2024-01-23 · Kang-Won Lee, Yuzhe Qin, Xiaolong Wang, Soo-Chul Lim

The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system designed to manipulate objects using the sense of touch, without relying on vision. For tasks that mimic daily life, the robot uses its sense of touch to manipulate randomly placed objects in dark. The objective of this study is to enable robots to perform blind manipulation by using tactile sensation to compensate for the information gap caused by the absence of vision, given the presence of prior information. Training the policy through reinforcement learning in simulation and transferring the trained policy to the real environment, we demonstrate that blind manipulation can be applied to robots without vision. In addition, the experiments showcase the importance of tactile sensing in the blind manipulation tasks. Our project page is available at https://lee-kangwon.github.io/dextouch/

📄 PDF Abstract BibTeX arXiv:2401.12496

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Play

2023-03-21 · Irmak Guzey, Ben Evans, Soumith Chintala, Lerrel Pinto

Teaching dexterity to multi-fingered robots has been a longstanding challenge in robotics. Most prominent work in this area focuses on learning controllers or policies that either operate on visual observations or state …

Representation Learning

Rotating without Seeing: Towards In-hand Dexterity through Touch

2023-03-20 · Zhao-Heng Yin, Binghao Huang, Yuzhe Qin, Qifeng Chen 외

Tactile information plays a critical role in human dexterity. It reveals useful contact information that may not be inferred directly from vision. In fact, humans can even perform in-hand dexterous manipulation without u…

Object

See to Touch: Learning Tactile Dexterity through Visual Incentives

2023-09-21 · Irmak Guzey, Yinlong Dai, Ben Evans, Soumith Chintala 외

Equipping multi-fingered robots with tactile sensing is crucial for achieving the precise, contact-rich, and dexterous manipulation that humans excel at. However, relying solely on tactile sensing fails to provide adequa…

HRDexDB: A Paired Human-Robot Dataset for Cross-Embodiment Dexterous Grasping

2026-04-16 · Jongbin Lim, Taeyun Ha, Mingi Choi, Jisoo Kim 외 arxiv

We present HRDexDB, a paired cross-embodiment dexterous grasping dataset of high-fidelity dexterous grasping sequences featuring both human and diverse robotic hands. Unlike existing datasets, HRDexDB provides a comprehe…

AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch

2024-05-12 · Max Yang, Chenghua Lu, Alex Church, Yijiong Lin 외

Human hands are capable of in-hand manipulation in the presence of different hand motions. For a robot hand, harnessing rich tactile information to achieve this level of dexterity still remains a significant challenge. I…