Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data
6D pose estimation pipelines that rely on RGB-only or RGB-D data show limitations for photometrically challenging objects with e.g. textureless surfaces, reflections or transparency. A supervised learning-based method utilising complementary polarisation information as input modality is proposed to overcome such limitations. This supervised approach is then extended to a self-supervised paradigm by leveraging physical characteristics of polarised light, thus eliminating the need for annotated real data. The methods achieve significant advancements in pose estimation by leveraging geometric information from polarised light and incorporating shape priors and invertible physical constraints.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
DPS-Net: Deep Polarimetric Stereo Depth Estimation
Stereo depth estimation usually struggles to deal with textureless scenes for both traditional and learning-based methods due to the inherent dependence on image correspondence matching. In this paper, we propose a n…
Depth EstimationStereo Depth EstimationLearning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesis
Neural rendering techniques allow for accurate reconstruction of the geometry and color appearance of 3D scenes. Some methods have extended their use to additional imaging modalities, such as multispectral, infrared, or …
Novel View SynthesisPola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization
Polarization information of the light can provide rich cues for computer vision and scene understanding tasks, such as the type of material, pose, and shape of the objects. With the advent of new and cheap polarimetric s…
3D ReconstructionDepth EstimationPose EstimationScene UnderstandingThe Orientation Estimation of Elongated Underground Objects via Multi-Polarization Aggregation and Selection Neural Network
The horizontal orientation angle and vertical inclination angle of an elongated subsurface object are key parameters for object identification and imaging in ground penetrating radar (GPR) applications. Conventional meth…
GPRObjectLinear Differential Constraints for Photo-polarimetric Height Estimation
In this paper we present a differential approach to photo-polarimetric shape estimation. We propose several alternative differential constraints based on polarisation and photometric shading information and show how to e…