Pose Estimation of Specular and Symmetrical Objects
In the robotic industry, specular and textureless metallic components are ubiquitous. The 6D pose estimation of such objects with only a monocular RGB camera is difficult because of the absence of rich texture features. Furthermore, the appearance of specularity heavily depends on the camera viewpoint and environmental light conditions making traditional methods, like template matching, fail. In the last 30 years, pose estimation of the specular object has been a consistent challenge, and most related works require massive knowledge modeling effort for light setups, environment, or the object surface. On the other hand, recent works exhibit the feasibility of 6D pose estimation on a monocular camera with convolutional neural networks(CNNs) however they mostly use opaque objects for evaluation. This paper provides a data-driven solution to estimate the 6D pose of specular objects for grasping them, proposes a cost function for handling symmetry, and demonstrates experimental results showing the system's feasibility.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose EstimationPose EstimationTemplate MatchingSimilar Papers 제목 키워드 기반
On Object Symmetries and 6D Pose Estimation from Images
Objects with symmetries are common in our daily life and in industrial contexts, but are often ignored in the recent literature on 6D pose estimation from images. In this paper, we study in an analytical way the link bet…
6D Pose EstimationObjectPose EstimationSingle-Image Specular Highlight Removal via Real-World Dataset Construction
Specular reflections pose great challenges on various multimedia and computer vision tasks, e.g. , image segmentation, detection and matching. In this paper, we build a large-scale Paired Specular-Diffuse (PSD) image dat…
Generative Adversarial NetworkHighlight Detectionhighlight removalImage Segmentation+1NeRF-DS: Neural Radiance Fields for Dynamic Specular Objects
Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the ob…
NeRFNovel View SynthesisLIME: Live Intrinsic Material Estimation
We present the first end to end approach for real time material estimation for general object shapes with uniform material that only requires a single color image as input. In addition to Lambertian surface properties, o…
DecoderForeground SegmentationImage-to-Image TranslationInverse Rendering+23D Gaussian Splatting with Deferred Reflection
The advent of neural and Gaussian-based radiance field methods have achieved great success in the field of novel view synthesis. However, specular reflection remains non-trivial, as the high frequency radiance field is n…
Novel View Synthesis