Estimating Mass Distribution of Articulated Objects using Non-prehensile Manipulation
We explore the problem of estimating the mass distribution of an articulated object by an interactive robotic agent. Our method predicts the mass distribution of an object by using the limited sensing and actuating capabilities of a robotic agent that is interacting with the object. We are inspired by the role of exploratory play in human infants. We take the combined approach of supervised and reinforcement learning to train an agent that learns to strategically interact with the object to estimate the object's mass distribution. Our method consists of two neural networks: (i) the policy network which decides how to interact with the object, and (ii) the predictor network that estimates the mass distribution given a history of observations and interactions. Using our method, we train a robotic arm to estimate the mass distribution of an object with moving parts (e.g. an articulated rigid body system) by pushing it on a surface with unknown friction properties. We also demonstrate how our training from simulations can be transferred to real hardware using a small amount of real-world data for fine-tuning. We use a UR10 robot to interact with 3D printed articulated chains with varying mass distributions and show that our method significantly outperforms the baseline system that uses random pushes to interact with the object.
Code (0)
등록된 구현이 없습니다.
Tasks
FrictionObjectReinforcement LearningSimilar Papers 제목 키워드 기반
DART: Learning-Enhanced Model Predictive Control for Dual-Arm Non-Prehensile Manipulation
What appears effortless to a human waiter remains a major challenge for robots. Manipulating objects nonprehensilely on a tray is inherently difficult, and the complexity is amplified in dual-arm settings. Such tasks are…
Reinforcement LearningArtiverse: A Diverse and Physically Grounded Dataset for Articulated Objects
We present Artiverse, a diverse and physically grounded dataset of high-quality articulated 3D objects designed for realistic functional modeling and simulation. Artiverse contains 5.4K human-authored objects across a br…
V-MAO: Generative Modeling for Multi-Arm Manipulation of Articulated Objects
Manipulating articulated objects requires multiple robot arms in general. It is challenging to enable multiple robot arms to collaboratively complete manipulation tasks on articulated objects. In this paper, we present $…
MuJoCoObjectNARF24: Estimating Articulated Object Structure for Implicit Rendering
Articulated objects and their representations pose a difficult problem for robots. These objects require not only representations of geometry and texture, but also of the various connections and joint parameters that mak…
Image SegmentationNeRFObjectSemantic SegmentationArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects
Robots operating in real-world environments frequently encounter unknown objects with complex structures and articulated components, such as doors, drawers, cabinets, and tools. The ability to perceive, track, and manipu…
Point Cloud RegistrationPose TrackingPoint Clouds