Challenges for Monocular 6D Object Pose Estimation in Robotics
Object pose estimation is a core perception task that enables, for example, object grasping and scene understanding. The widely available, inexpensive and high-resolution RGB sensors and CNNs that allow for fast inference based on this modality make monocular approaches especially well suited for robotics applications. We observe that previous surveys on object pose estimation establish the state of the art for varying modalities, single- and multi-view settings, and datasets and metrics that consider a multitude of applications. We argue, however, that those works' broad scope hinders the identification of open challenges that are specific to monocular approaches and the derivation of promising future challenges for their application in robotics. By providing a unified view on recent publications from both robotics and computer vision, we find that occlusion handling, novel pose representations, and formalizing and improving category-level pose estimation are still fundamental challenges that are highly relevant for robotics. Moreover, to further improve robotic performance, large object sets, novel objects, refractive materials, and uncertainty estimates are central, largely unsolved open challenges. In order to address them, ontological reasoning, deformability handling, scene-level reasoning, realistic datasets, and the ecological footprint of algorithms need to be improved.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose Estimation using RGBObjectOcclusion HandlingPose EstimationScene UnderstandingSimilar Papers 제목 키워드 기반
Open Challenges for Monocular Single-shot 6D Object Pose Estimation
Object pose estimation is a non-trivial task that enables robotic manipulation, bin picking, augmented reality, and scene understanding, to name a few use cases. Monocular object pose estimation gained considerable momen…
6D Pose Estimation using RGBObjectOcclusion HandlingPose Estimation+1Lightweight Monocular Depth Estimation via Token-Sharing Transformer
Depth estimation is an important task in various robotics systems and applications. In mobile robotics systems, monocular depth estimation is desirable since a single RGB camera can be deployable at a low cost and compac…
Depth EstimationDepth PredictionMonocular Depth EstimationLift-Attend-Splat: Bird's-eye-view camera-lidar fusion using transformers
Combining complementary sensor modalities is crucial to providing robust perception for safety-critical robotics applications such as autonomous driving (AD). Recent state-of-the-art camera-lidar fusion methods for AD re…
3D Object DetectionAutonomous DrivingDepth EstimationMonocular Depth Estimation+3Dyna-DM: Dynamic Object-aware Self-supervised Monocular Depth Maps
Self-supervised monocular depth estimation has been a subject of intense study in recent years, because of its applications in robotics and autonomous driving. Much of the recent work focuses on improving depth estimatio…
Autonomous DrivingDepth EstimationGPUMonocular Depth Estimation+1EdgeConv with Attention Module for Monocular Depth Estimation
Monocular depth estimation is an especially important task in robotics and autonomous driving, where 3D structural information is essential. However, extreme lighting conditions and complex surface objects make it diffic…
Autonomous DrivingDepth EstimationMonocular Depth Estimation