Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Dataset
Building robots that can automate labor-intensive tasks has long been the core motivation behind the advancements in computer vision and the robotics community. Recent interest in leveraging 3D algorithms, particularly neural fields, has led to advancements in robot perception and physical understanding in manipulation scenarios. However, the real world's complexity poses significant challenges. To tackle these challenges, we present Robo360, a dataset that features robotic manipulation with a dense view coverage, which enables high-quality 3D neural representation learning, and a diverse set of objects with various physical and optical properties and facilitates research in various object manipulation and physical world modeling tasks. We confirm the effectiveness of our dataset using existing dynamic NeRF and evaluate its potential in learning multi-view policies. We hope that Robo360 can open new research directions yet to be explored at the intersection of understanding the physical world in 3D and robot control.
Code (0)
등록된 구현이 없습니다.
Tasks
NeRFRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reconfigurable Auxetic Devices (RADs) for Robotic Surface Manipulation
Robotic surfaces traditionally use materials with a positive Poisson's ratio to push and pull on a manipulation interface. Auxetic materials with a negative Poisson's ratio may expand in multiple directions when stretche…
Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materials
Robotic manipulation of volumetric elastoplastic deformable materials, from foods such as dough to construction materials like clay, is in its infancy, largely due to the difficulty of modelling and perception in a high-…
FrictionClassification of Household Materials via Spectroscopy
Recognizing an object's material can inform a robot on the object's fragility or appropriate use. To estimate an object's material during manipulation, many prior works have explored the use of haptic sensing. In this pa…
ClassificationGeneral ClassificationMaterial ClassificationMaterial Recognition+1Robot Excavation and Manipulation of Geometrically Cohesive Granular Media
Construction throughout history typically assumes that its blueprints and building blocks are pre-determined. However, recent work suggests that alternative approaches can enable new paradigms for structure formation. Al…
EMPM: Embodied MPM for Modeling and Simulation of Deformable Objects
Modeling deformable objects - especially continuum materials - in a way that is physically plausible, generalizable, and data-efficient remains challenging across 3D vision, graphics, and robotic manipulation. Many exist…