Sensing and Recognizing Surface Textures Using a GelSight Sensor
Sensing surface textures by tou ch is a valuable was difficult to build capability for robots. Until recently it a a compliant sensor with high sennnsitivity and high resolution. The GelSight sensor is cooompliant and offers sensitivity and resolution exceeding that of the human fingertips. This opens the possibility of measuring and recognizing highly detailed surface texxxtures. The GelSight sensor, when pressed against a surfaccce, delivers a height map. This can be treated as an image, aaand processed using the tools of visual texture analysis. W WW have devised a simple yet effective texture recognitiooon system based on local binary patterns, and enhanced it by the use of a multi-scale pyramid and a Hellinger dddistance metric. We built a database with 40 classes of taaactile textures using materials such as fabric, wood, and sannndpaper. Our system can correctly categorize materials from m this database with high accuracy. This suggests that the G GelSight sensor can be useful for material recognition by rooobots.
Code (0)
등록된 구현이 없습니다.
Tasks
Material RecognitionTexture ClassificationSimilar Papers 제목 키워드 기반
Contact-Based Fringe Projection Profilometry for High-Resolution 3-D Surface Measurement of Reflective and Transparent Objects
This paper presents a contact-based 3-D surface measurement method based on a Digital Fringe Projection (DFP) system, belonging to the vision-based tactile sensing family pioneered by the commercially successful GelSight…
Object Recognition and Force Estimation with the GelSight Baby Fin Ray
Recent advances in soft robotic hands and tactile sensing have enabled both to perform an increasing number of complex tasks with the aid of machine learning. In particular, we presented the GelSight Baby Fin Ray in our …
Object RecognitionDevelopment and Evaluation of a Learning-based Model for Real-time Haptic Texture Rendering
Current Virtual Reality (VR) environments lack the rich haptic signals that humans experience during real-life interactions, such as the sensation of texture during lateral movement on a surface. Adding realistic haptic …
GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing
Camera-based tactile sensing is a low-cost, popular approach to obtain highly detailed contact geometry information. However, most existing camera-based tactile sensors are fingertip sensors, and longer fingers often req…
PneuGelSight: Soft Robotic Vision-Based Proprioception and Tactile Sensing
Soft pneumatic robot manipulators are popular in industrial and human-interactive applications due to their compliance and flexibility. However, deploying them in real-world scenarios requires advanced sensing for tactil…