paper-with-me

홈 › Papers

CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation

2023-04-18 · Adithyavairavan Murali, Arsalan Mousavian, Clemens Eppner, Adam Fishman, Dieter Fox

We address the important problem of generalizing robotic rearrangement to clutter without any explicit object models. We first generate over 650K cluttered scenes - orders of magnitude more than prior work - in diverse everyday environments, such as cabinets and shelves. We render synthetic partial point clouds from this data and use it to train our CabiNet model architecture. CabiNet is a collision model that accepts object and scene point clouds, captured from a single-view depth observation, and predicts collisions for SE(3) object poses in the scene. Our representation has a fast inference speed of 7 microseconds per query with nearly 20% higher performance than baseline approaches in challenging environments. We use this collision model in conjunction with a Model Predictive Path Integral (MPPI) planner to generate collision-free trajectories for picking and placing in clutter. CabiNet also predicts waypoints, computed from the scene's signed distance field (SDF), that allows the robot to navigate tight spaces during rearrangement. This improves rearrangement performance by nearly 35% compared to baselines. We systematically evaluate our approach, procedurally generate simulated experiments, and demonstrate that our approach directly transfers to the real world, despite training exclusively in simulation. Robot experiment demos in completely unknown scenes and objects can be found at this http https://cabinet-object-rearrangement.github.io

📄 PDF Abstract BibTeX arXiv:2304.09302

Code (0)

등록된 구현이 없습니다.

Tasks

NavigateObjectObject RearrangementScene Generation

Methods 이 논문이 사용한 방법론

CABiNet With the increasing demand of autonomous systems, pixelwise semantic segmentation for visual scene understanding needs to be not only accurate but also efficient for potential…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Object Rearrangement Using Learned Implicit Collision Functions

2020-11-21 · Michael Danielczuk, Arsalan Mousavian, Clemens Eppner, Dieter Fox

Robotic object rearrangement combines the skills of picking and placing objects. When object models are unavailable, typical collision-checking models may be unable to predict collisions in partial point clouds with occl…

ObjectObject Rearrangement

PaiP: An Operational Aware Interactive Planner for Unknown Cabinet Environments

2025-09-15 · Chengjin Wang, Zheng Yan, Yanmin Zhou, Runjie Shen 외 arxiv

Box/cabinet scenarios with stacked objects pose significant challenges for robotic motion due to visual occlusions and constrained free space. Traditional collision-free trajectory planning methods often fail when no col…

Trajectory Planning

VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement

2022-10-11 · Erik Wijmans, Irfan Essa, Dhruv Batra

We present Variable Experience Rollout (VER), a technique for efficiently scaling batched on-policy reinforcement learning in heterogenous environments (where different environments take vastly different times to generat…

GPUNavigateObjectGoal NavigationOut-of-Distribution Generalization+1

Uniform Object Rearrangement: From Complete Monotone Primitives to Efficient Non-Monotone Informed Search

2021-01-28 · Rui Wang, Kai Gao, Daniel Nakhimovich, Jingjin Yu 외

Object rearrangement is a widely-applicable and challenging task for robots. Geometric constraints must be carefully examined to avoid collisions and combinatorial issues arise as the number of objects increases. This wo…

ObjectObject Rearrangement

MINSU (Mobile Inventory And Scanning Unit):Computer Vision and AI

2022-04-14 · Jihoon Ryoo, Byungkon Kang, Dongyeob Lee, Seunghyeon Kim 외

The MINSU(Mobile Inventory and Scanning Unit) algorithm uses the computational vision analysis method to record the residual quantity/fullness of the cabinet. To do so, it goes through a five-step method: object detectio…

ClusteringManagementobject-detectionObject Detection