Hierarchical Material Recognition from Local Appearance
We introduce a taxonomy of materials for hierarchical recognition from local appearance. Our taxonomy is motivated by vision applications and is arranged according to the physical traits of materials. We contribute a diverse, in-the-wild dataset with images and depth maps of the taxonomy classes. Utilizing the taxonomy and dataset, we present a method for hierarchical material recognition based on graph attention networks. Our model leverages the taxonomic proximity between classes and achieves state-of-the-art performance. We demonstrate the model's potential to generalize to adverse, real-world imaging conditions, and that novel views rendered using the depth maps can enhance this capability. Finally, we show the model's capacity to rapidly learn new materials in a few-shot learning setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningGraph AttentionMaterial RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Integrating Local Material Recognition with Large-Scale Perceptual Attribute Discovery
Material attributes have been shown to provide a discriminative intermediate representation for recognizing materials, especially for the challenging task of recognition from local material appearance (i.e., regardless o…
AttributeMaterial RecognitionMaterial Recognition from Local Appearance in Global Context
Recognition of materials has proven to be a challenging problem due to the wide variation in appearance within and between categories. Global image context, such as where the material is or what object it makes up, can b…
Material RecognitionProbabilistic Visual Place Recognition for Hierarchical Localization
Visual localization techniques often comprise a hierarchical localization pipeline, with a visual place recognition module used as a coarse localizer to initialize a pose refinement stage. While improving the pose refine…
Image RetrievalRetrievalState EstimationVisual Localization+1Differential Angular Imaging for Material Recognition
Material recognition for real-world outdoor surfaces has become increasingly important for computer vision to support its operation "in the wild." Computational surface modeling that underlies material recognition has tr…
Material RecognitionA Hierarchical Architecture for Neural Materials
Neural reflectance models are capable of reproducing the spatially-varying appearance of many real-world materials at different scales. Unfortunately, existing techniques such as NeuMIP have difficulties handling materia…