Angular Luminance for Material Segmentation
Moving cameras provide multiple intensity measurements per pixel, yet often semantic segmentation, material recognition, and object recognition do not utilize this information. With basic alignment over several frames of a moving camera sequence, a distribution of intensities over multiple angles is obtained. It is well known from prior work that luminance histograms and the statistics of natural images provide a strong material recognition cue. We utilize per-pixel {\it angular luminance distributions} as a key feature in discriminating the material of the surface. The angle-space sampling in a multiview satellite image sequence is an unstructured sampling of the underlying reflectance function of the material. For real-world materials there is significant intra-class variation that can be managed by building a angular luminance network (AngLNet). This network combines angular reflectance cues from multiple images with spatial cues as input to fully convolutional networks for material segmentation. We demonstrate the increased performance of AngLNet over prior state-of-the-art in material segmentation from satellite imagery.
Code (0)
등록된 구현이 없습니다.
Tasks
Material RecognitionMaterial SegmentationObject RecognitionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Shadow Removal Refinement via Material-Consistent Shadow Edges
Shadow boundaries can be confused with material boundaries as both exhibit sharp changes in luminance or contrast within a scene. However, shadows do not modify the intrinsic color or texture of surfaces. Therefore, on b…
Image SegmentationSegmentationSemantic SegmentationShadow RemovalUncalibrated Photometric Stereo for Unknown Isotropic Reflectances
We propose an uncalibrated photometric stereo method that works with general and unknown isotropic reflectances. Our method uses a pixel intensity profile, which is a sequence of radiance intensities recorded at a pixel …
Luminance Attentive Networks for HDR Image and Panorama Reconstruction
It is very challenging to reconstruct a high dynamic range (HDR) from a low dynamic range (LDR) image as an ill-posed problem. This paper proposes a luminance attentive network named LANet for HDR reconstruction from a s…
HDR Reconstructioninverse tone mappingInverse-Tone-MappingTone MappingDifferential Angular Imaging for Material Recognition
Material recognition for real-world outdoor surfaces has become increasingly important for computer vision to support its operation "in the wild." Computational surface modeling that underlies material recognition has tr…
Material RecognitionDifferential Viewpoints for Ground Terrain Material Recognition
Computational surface modeling that underlies material recognition has transitioned from reflectance modeling using in-lab controlled radiometric measurements to image-based representations based on internet-mined single…
Autonomous DrivingMaterial RecognitionRobot Navigation