Deep Polarization Cues for Transparent Object Segmentation
Segmentation of transparent objects is a hard, open problem in computer vision. Transparent objects lack texture of their own, adopting instead the texture of scene background. This paper reframes the problem of transparent object segmentation into the realm of light polarization, i.e., the rotation of light waves. We use a polarization camera to capture multi-modal imagery and couple this with a unique deep learning backbone for processing polarization input data. Our method achieves instance segmentation on cluttered, transparent objects in various scene and background conditions, demonstrating an improvement over traditional image-based approaches. As an application we use this for robotic bin picking of transparent objects.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationObjectSegmentationSemantic SegmentationTransparent objectsSimilar Papers 제목 키워드 기반
Glass Segmentation Using Intensity and Spectral Polarization Cues
Transparent and semi-transparent materials pose significant challenges for existing scene understanding and segmentation algorithms due to their lack of RGB texture which impedes the extraction of meaningful features…
Camouflaged Object SegmentationScene UnderstandingSegmentationSemantic SegmentationPolarimetric Inverse Rendering for Transparent Shapes Reconstruction
In this work, we propose a novel method for the detailed reconstruction of transparent objects by exploiting polarimetric cues. Most of the existing methods usually lack sufficient constraints and suffer from the over-sm…
Inverse RenderingTransparent objectsThermal Polarimetric Multi-view Stereo
This paper introduces a novel method for detailed 3D shape reconstruction utilizing thermal polarization cues. Unlike state-of-the-art methods, the proposed approach is independent of illumination and material properties…
3D Shape ReconstructionMulti-view Spectral Polarization Propagation for Video Glass Segmentation
In this paper, we present the first polarization-guided video glass segmentation propagation solution (PGVS-Net) that can robustly and coherently propagate glass segmentation in RGB-P video sequences. By leveraging s…
Image SegmentationSegmentationSemantic SegmentationPower of Boundary and Reflection: Semantic Transparent Object Segmentation using Pyramid Vision Transformer with Transparent Cues
Glass is a prevalent material among solid objects in everyday life, yet segmentation methods struggle to distinguish it from opaque materials due to its transparency and reflection. While it is known that human perceptio…
Semantic SegmentationObject Segmentation