Volumetric Reconstruction From Partial Views for Task-Oriented Grasping
Object affordance and volumetric information are essential in devising effective grasping strategies under task-specific constraints. This paper presents an approach for inferring suitable grasping strategies from limited partial views of an object. To achieve this, a recurrent generative adversarial network (R-GAN) was proposed by incorporating a recurrent generator with long short-term memory (LSTM) units for it to process a variable number of depth scans. To determine object affordances, the AffordPose knowledge dataset is utilized as prior knowledge. Affordance retrieving is defined by the volume similarity measured via Chamfer Distance and action similarities. A Proximal Policy Optimization (PPO) reinforcement learning model is further implemented to refine the retrieved grasp strategies for task-oriented grasping. The retrieved grasp strategies were evaluated on a dual-arm mobile manipulation robot with an overall grasping accuracy of 89% for four tasks: lift, handle grasp, wrap grasp, and press.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkObjectSimilar Papers 제목 키워드 기반
Volumetric Disentanglement for 3D Scene Manipulation
Recently, advances in differential volumetric rendering enabled significant breakthroughs in the photo-realistic and fine-detailed reconstruction of complex 3D scenes, which is key for many virtual reality applications. …
DisentanglementObjectVisual Tomography: Physically Faithful Volumetric Models of Partially Translucent Objects
When created faithfully from real-world data, Digital 3D representations of objects can be useful for human or computer-assisted analysis. Such models can also serve for generating training data for machine learning appr…
3D ReconstructionNeRFStochastic Poisson Surface Reconstruction with One Solve using Geometric Gaussian Processes
Poisson Surface Reconstruction is a widely-used algorithm for reconstructing a surface from an oriented point cloud. To facilitate applications where only partial surface information is available, or scanning is performe…
Gaussian ProcessesSurface ReconstructionCloak of Invisibility: Real-Time Privacy-Preserving Volumetric Video Streaming
Volumetric video streaming turns privacy into a 3D, multi-view problem. Unlike ordinary video, where sensitive content can often be redacted frame by frame, RGB-D volumetric pipelines capture people, rooms, and personal …
Object DetectionPoint CloudsAssociative3D: Volumetric Reconstruction from Sparse Views
This paper studies the problem of 3D volumetric reconstruction from two views of a scene with an unknown camera. While seemingly easy for humans, this problem poses many challenges for computers since it requires simulta…
3D Volumetric Reconstruction