GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing
Camera-based tactile sensing is a low-cost, popular approach to obtain highly detailed contact geometry information. However, most existing camera-based tactile sensors are fingertip sensors, and longer fingers often require extraneous elements to obtain an extended sensing area similar to the full length of a human finger. Moreover, existing methods to estimate proprioceptive information such as total forces and torques applied on the finger from camera-based tactile sensors are not effective when the contact geometry is complex. We introduce GelSight Svelte, a curved, human finger-sized, single-camera tactile sensor that is capable of both tactile and proprioceptive sensing over a large area. GelSight Svelte uses curved mirrors to achieve the desired shape and sensing coverage. Proprioceptive information, such as the total bending and twisting torques applied on the finger, is reflected as deformations on the flexible backbone of GelSight Svelte, which are also captured by the camera. We train a convolutional neural network to estimate the bending and twisting torques from the captured images. We conduct gel deformation experiments at various locations of the finger to evaluate the tactile sensing capability and proprioceptive sensing accuracy. To demonstrate the capability and potential uses of GelSight Svelte, we conduct an object holding task with three different grasping modes that utilize different areas of the finger. More information is available on our website: https://gelsight-svelte.alanz.info
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Contrasting results of surface metrology techniques for three-dimensional human fingerprints
Fingerprints, otherwise known as dermatoglyphs, are most commonly thought of in the context of identification, but have myriad other roles in human biology. They are formed by the restricted ability of ridges and furrows…
GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger
Vision-based tactile sensors have the potential to provide important contact geometry to localize the objective with visual occlusion. However, it is challenging to measure high-resolution 3D contact geometry for a compa…
3D geometry3D ReconstructionPose TrackingSensing and Recognizing Surface Textures Using a GelSight Sensor
Sensing surface textures by tou ch is a valuable was difficult to build capability for robots. Until recently it a a compliant sensor with high sennnsitivity and high resolution. The GelSight sensor is cooompliant and of…
Material RecognitionTexture ClassificationAssembling Two Parts in One Hand
A hallmark of human dexterity is the cooperative use of fingers, where different fingers take on distinct yet coordinated roles to accomplish fine manipu- lation, such as capping a pen with the hand that holds it. We stu…
Reinforcement LearningContact-Based Fringe Projection Profilometry for High-Resolution 3-D Surface Measurement of Reflective and Transparent Objects
This paper presents a contact-based 3-D surface measurement method based on a Digital Fringe Projection (DFP) system, belonging to the vision-based tactile sensing family pioneered by the commercially successful GelSight…