Object Pose Estimation through Dexterous Touch
Robust object pose estimation is essential for manipulation and interaction tasks in robotics, particularly in scenarios where visual data is limited or sensitive to lighting, occlusions, and appearances. Tactile sensors often offer limited and local contact information, making it challenging to reconstruct the pose from partial data. Our approach uses sensorimotor exploration to actively control a robot hand to interact with the object. We train with Reinforcement Learning (RL) to explore and collect tactile data. The collected 3D point clouds are used to iteratively refine the object's shape and pose. In our setup, one hand holds the object steady while the other performs active exploration. We show that our method can actively explore an object's surface to identify critical pose features without prior knowledge of the object's geometry. Supplementary material and more demonstrations will be provided at https://amirshahid.github.io/BimanualTactilePose .
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningPose EstimationPoint CloudsSimilar Papers 제목 키워드 기반
Toward Human-Like Grasp: Dexterous Grasping via Semantic Representation of Object-Hand
In recent years, many dexterous robotic hands have been designed to assist or replace human hands in executing various tasks. But how to teach them to perform dexterous operations like human hands is still a challeng…
Text2Touch: Tactile In-Hand Manipulation with LLM-Designed Reward Functions
Large language models (LLMs) are beginning to automate reward design for dexterous manipulation. However, no prior work has considered tactile sensing, which is known to be critical for human-like dexterity. We present T…
Prompt EngineeringRotating without Seeing: Towards In-hand Dexterity through Touch
Tactile information plays a critical role in human dexterity. It reveals useful contact information that may not be inferred directly from vision. In fact, humans can even perform in-hand dexterous manipulation without u…
ObjectReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction
Fusing tactile signals has proven effective for contact-rich manipulation, enabling robots to perceive contact states and adapt to rapidly changing physical interactions. Yet effectively integrating tactile feedback into…
TactoFind: A Tactile Only System for Object Retrieval
We study the problem of object retrieval in scenarios where visual sensing is absent, object shapes are unknown beforehand and objects can move freely, like grabbing objects out of a drawer. Successful solutions require …
ObjectRetrieval