paper-with-me

홈 › Papers

Challenges for Monocular 6D Object Pose Estimation in Robotics

2023-07-22 · Stefan Thalhammer, Dominik Bauer, Peter Hönig, Jean-Baptiste Weibel, José García-Rodríguez, Markus Vincze

Object pose estimation is a core perception task that enables, for example, object grasping and scene understanding. The widely available, inexpensive and high-resolution RGB sensors and CNNs that allow for fast inference based on this modality make monocular approaches especially well suited for robotics applications. We observe that previous surveys on object pose estimation establish the state of the art for varying modalities, single- and multi-view settings, and datasets and metrics that consider a multitude of applications. We argue, however, that those works' broad scope hinders the identification of open challenges that are specific to monocular approaches and the derivation of promising future challenges for their application in robotics. By providing a unified view on recent publications from both robotics and computer vision, we find that occlusion handling, novel pose representations, and formalizing and improving category-level pose estimation are still fundamental challenges that are highly relevant for robotics. Moreover, to further improve robotic performance, large object sets, novel objects, refractive materials, and uncertainty estimates are central, largely unsolved open challenges. In order to address them, ontological reasoning, deformability handling, scene-level reasoning, realistic datasets, and the ecological footprint of algorithms need to be improved.

📄 PDF Abstract BibTeX arXiv:2307.12172

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose Estimation using RGBObjectOcclusion HandlingPose EstimationScene Understanding

Similar Papers 제목 키워드 기반

Open Challenges for Monocular Single-shot 6D Object Pose Estimation

2023-02-23 · Stefan Thalhammer, Peter Hönig, Jean-Baptiste Weibel, Markus Vincze

Object pose estimation is a non-trivial task that enables robotic manipulation, bin picking, augmented reality, and scene understanding, to name a few use cases. Monocular object pose estimation gained considerable momen…

6D Pose Estimation using RGBObjectOcclusion HandlingPose Estimation+1

Lightweight Monocular Depth Estimation via Token-Sharing Transformer

2023-06-09 · Dong-Jae Lee, Jae Young Lee, Hyounguk Shon, Eojindl Yi 외

Depth estimation is an important task in various robotics systems and applications. In mobile robotics systems, monocular depth estimation is desirable since a single RGB camera can be deployable at a low cost and compac…

Depth EstimationDepth PredictionMonocular Depth Estimation

Lift-Attend-Splat: Bird's-eye-view camera-lidar fusion using transformers

2023-12-22 · James Gunn, Zygmunt Lenyk, Anuj Sharma, Andrea Donati 외

Combining complementary sensor modalities is crucial to providing robust perception for safety-critical robotics applications such as autonomous driving (AD). Recent state-of-the-art camera-lidar fusion methods for AD re…

3D Object DetectionAutonomous DrivingDepth EstimationMonocular Depth Estimation+3

Dyna-DM: Dynamic Object-aware Self-supervised Monocular Depth Maps

2022-06-08 · Kieran Saunders, George Vogiatzis, Luis J. Manso

Self-supervised monocular depth estimation has been a subject of intense study in recent years, because of its applications in robotics and autonomous driving. Much of the recent work focuses on improving depth estimatio…

Autonomous DrivingDepth EstimationGPUMonocular Depth Estimation+1

EdgeConv with Attention Module for Monocular Depth Estimation

2021-06-16 · Minhyeok Lee, Sangwon Hwang, Chaewon Park, Sangyoun Lee

Monocular depth estimation is an especially important task in robotics and autonomous driving, where 3D structural information is essential. However, extreme lighting conditions and complex surface objects make it diffic…

Autonomous DrivingDepth EstimationMonocular Depth Estimation