paper-with-me

Papers

Learning efficient haptic shape exploration with a rigid tactile sensor array

2019-02-20 · Sascha Fleer, Alexandra Moringen, Roberta L. Klatzky, Helge Ritter

Haptic exploration is a key skill for both robots and humans to discriminate and handle unknown objects or to recognize familiar objects. Its active nature is evident in humans who from early on reliably acquire sophisticated sensory-motor capabilities for active exploratory touch and directed manual exploration that associates surfaces and object properties with their spatial locations. This is in stark contrast to robotics. In this field, the relative lack of good real-world interaction models - along with very restricted sensors and a scarcity of suitable training data to leverage machine learning methods - has so far rendered haptic exploration a largely underdeveloped skill. In the present work, we connect recent advances in recurrent models of visual attention with previous insights about the organisation of human haptic search behavior, exploratory procedures and haptic glances for a novel architecture that learns a generative model of haptic exploration in a simulated three-dimensional environment. The proposed algorithm simultaneously optimizes main perception-action loop components: feature extraction, integration of features over time, and the control strategy, while continuously acquiring data online. We perform a multi-module neural network training, including a feature extractor and a recurrent neural network module aiding pose control for storing and combining sequential sensory data. The resulting haptic meta-controller for the rigid $16 \times 16$ tactile sensor array moving in a physics-driven simulation environment, called the Haptic Attention Model, performs a sequence of haptic glances, and outputs corresponding force measurements. The resulting method has been successfully tested with four different objects. It achieved results close to $100 \%$ while performing object contour exploration that has been optimized for its own sensor morphology.

📄 PDF Abstract BibTeX arXiv:1902.07501

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Active 3D Shape Reconstruction from Vision and Touch

2021-07-20 · NeurIPS 2021 12 · Edward J. Smith, David Meger, Luis Pineda, Roberto Calandra 외

Humans build 3D understandings of the world through active object exploration, using jointly their senses of vision and touch. However, in 3D shape reconstruction, most recent progress has relied on static datasets of li…

3D Reconstruction3D Shape Reconstruction

A thin and soft optical tactile sensor for highly sensitive object perception

2026-02-03 · Yanchen Shen, Kohei Tsuji, Haruto Koizumi, Jiseon Hong 외 arxiv

Tactile sensing is crucial in robotics and wearable devices for safe perception and interaction with the environment. Optical tactile sensors have emerged as promising solutions, as they are immune to electromagnetic int…

Active Perception for Tactile Sensing: A Task-Agnostic Attention-Based Approach

2025-05-09 · Tim Schneider, Cristiana de Farias, Roberto Calandra, Liming Chen 외

Humans make extensive use of haptic exploration to map and identify the properties of the objects that we touch. In robotics, active tactile perception has emerged as an important research domain that complements vision …

Decision MakingPose EstimationReinforcement Learning (RL)

Haptic Sorter: A Unified Planning Framework for Online Shape Estimation and Real-Time Pose Inference

2026-05-29 · Zhuoyi Lu, Lin Yang, Sri Harsha Turlapati, Domenico Campolo arxiv

Robotics manipulation usually assumes that the shape and pose of the object are known to the robot prior to motion planning. However, precise geometric information is not always available in practice, and pose inference …

Motion Planning

ShapeGrasp: Simultaneous Visuo-Haptic Shape Completion and Grasping for Improved Robot Manipulation

2026-05-04 · Lukas Rustler, Matej Hoffmann arxiv

Humans grasp unfamiliar objects by combining an initial visual estimate with tactile and proprioceptive feedback during interaction. We present ShapeGrasp, a robotic implementation of this approach. The proposed method i…

3D Shape ReconstructionRobot Manipulation