paper-with-me

Papers

Perceiving Unseen 3D Objects by Poking the Objects

2023-02-26 · Linghao Chen, Yunzhou Song, Hujun Bao, Xiaowei Zhou

We present a novel approach to interactive 3D object perception for robots. Unlike previous perception algorithms that rely on known object models or a large amount of annotated training data, we propose a poking-based approach that automatically discovers and reconstructs 3D objects. The poking process not only enables the robot to discover unseen 3D objects but also produces multi-view observations for 3D reconstruction of the objects. The reconstructed objects are then memorized by neural networks with regular supervised learning and can be recognized in new test images. The experiments on real-world data show that our approach could unsupervisedly discover and reconstruct unseen 3D objects with high quality, and facilitate real-world applications such as robotic grasping. The code and supplementary materials are available at the project page: https://zju3dv.github.io/poking_perception.

📄 PDF Abstract BibTeX arXiv:2302.13375

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionRobotic Grasping

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Understanding Object Dynamics for Interactive Image-to-Video Synthesis

2021-06-21 · CVPR 2021 1 · Andreas Blattmann, Timo Milbich, Michael Dorkenwald, Björn Ommer

What would be the effect of locally poking a static scene? We present an approach that learns naturally-looking global articulations caused by a local manipulation at a pixel level. Training requires only videos of movin…

ObjectVideo Prediction

Learning to Poke by Poking: Experiential Learning of Intuitive Physics

2016-06-23 · NeurIPS 2016 12 · Pulkit Agrawal, Ashvin Nair, Pieter Abbeel, Jitendra Malik 외

We investigate an experiential learning paradigm for acquiring an internal model of intuitive physics. Our model is evaluated on a real-world robotic manipulation task that requires displacing objects to target locations…

Decision Making

One-Shot Affordance Detection

2021-06-28 · Hongchen Luo, Wei Zhai, Jing Zhang, Yang Cao 외

Affordance detection refers to identifying the potential action possibilities of objects in an image, which is an important ability for robot perception and manipulation. To empower robots with this ability in unseen sce…

4kAffordance Detection

PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Robotics

2024-10-10 · Jan Obrist, Miguel Zamora, Hehui Zheng, Ronan Hinchet 외

Data-driven methods have shown great potential in solving challenging manipulation tasks; however, their application in the domain of deformable objects has been constrained, in part, by the lack of data. To address this…

Convolutional Occupancy Models for Dense Packing of Complex, Novel Objects

2023-07-31 · Nikhil Mishra, Pieter Abbeel, Xi Chen, Maximilian Sieb

Dense packing in pick-and-place systems is an important feature in many warehouse and logistics applications. Prior work in this space has largely focused on planning algorithms in simulation, but real-world packing perf…