MaskedFusion: Mask-based 6D Object Pose Estimation
MaskedFusion is a framework to estimate the 6D pose of objects using RGB-D data, with an architecture that leverages multiple sub-tasks in a pipeline to achieve accurate 6D poses. 6D pose estimation is an open challenge due to complex world objects and many possible problems when capturing data from the real world, e.g., occlusions, truncations, and noise in the data. Achieving accurate 6D poses will improve results in other open problems like robot grasping or positioning objects in augmented reality. MaskedFusion improves the state-of-the-art by using object masks to eliminate non-relevant data. With the inclusion of the masks on the neural network that estimates the 6D pose of an object we also have features that represent the object shape. MaskedFusion is a modular pipeline where each sub-task can have different methods that achieve the objective. MaskedFusion achieved 97.3% on average using the ADD metric on the LineMOD dataset and 93.3% using the ADD-S AUC metric on YCB-Video Dataset, which is an improvement, compared to the state-of-the-art methods. The code is available on GitHub (https://github.com/kroglice/MaskedFusion).
Code (1)
Tasks
6D Pose Estimation6D Pose Estimation using RGBDObjectPose EstimationSimilar Papers 제목 키워드 기반
MaskedFusion360: Reconstruct LiDAR Data by Querying Camera Features
In self-driving applications, LiDAR data provides accurate information about distances in 3D but lacks the semantic richness of camera data. Therefore, state-of-the-art methods for perception in urban scenes fuse data fr…
Sensor FusionMaskFlow: Object-Aware Motion Estimation
We introduce a novel motion estimation method, MaskFlow, that is capable of estimating accurate motion fields, even in very challenging cases with small objects, large displacements and drastic appearance changes. In add…
Motion EstimationObjectTranslationMask6D: Masked Pose Priors For 6D Object Pose Estimation
Robust 6D object pose estimation in cluttered or occluded conditions using monocular RGB images remains a challenging task. One reason is that current pose estimation networks struggle to extract discriminative, pose-awa…
Pose EstimationPose PredictionDSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency
Compared to 2D object bounding-box labeling, it is very difficult for humans to annotate 3D object poses, especially when depth images of scenes are unavailable. This paper investigates whether we can estimate the object…
ObjectPose EstimationD$^3$epth: Self-Supervised Depth Estimation with Dynamic Mask in Dynamic Scenes
Depth estimation is a crucial technology in robotics. Recently, self-supervised depth estimation methods have demonstrated great potential as they can efficiently leverage large amounts of unlabelled real-world data. How…
Depth EstimationMonocular Depth Estimation