Centroid Based Concept Learning for RGB-D Indoor Scene Classification
This paper contributes a novel cognitively-inspired method for RGB-D indoor scene classification. High intra-class variance and low inter-class variance make indoor scene classification an extremely challenging task. To cope with this problem, we propose a clustering approach inspired by the concept learning model of the hippocampus and the neocortex, to generate clusters and centroids for different scene categories. Test images depicting different scenes are classified by using their distance to the closest centroids (concepts). Modeling of RGB-D scenes as centroids not only leads to state-of-the-art classification performance on benchmark datasets (SUN RGB-D and NYU Depth V2), but also offers a method for inspecting and interpreting the space of centroids. Inspection of the centroids generated by our approach on RGB-D datasets leads us to propose a method for merging conceptually similar categories, resulting in improved accuracy for all approaches.
Code (1)
Tasks
ClassificationClusteringGeneral ClassificationHippocampusScene ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An embarrassingly simple comparison of machine learning algorithms for indoor scene classification
With the emergence of autonomous indoor robots, the computer vision task of indoor scene recognition has gained the spotlight. Indoor scene recognition is a challenging problem in computer vision that relies on local and…
BIG-bench Machine LearningClassificationScene ClassificationScene RecognitionIndoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologies
This paper proposes an approach to build 3D scene graphs in arbitrary indoor and outdoor environments. Such extension is challenging; the hierarchy of concepts that describe an outdoor environment is more complex than fo…
3d scene graph generationgraph constructionGraph GenerationLanguage Modelling+4VIDES: Virtual Interior Design via Natural Language and Visual Guidance
Interior design is crucial in creating aesthetically pleasing and functional indoor spaces. However, developing and editing interior design concepts requires significant time and expertise. We propose Virtual Interior DE…
Neural Scene Decoration from a Single Photograph
Furnishing and rendering indoor scenes has been a long-standing task for interior design, where artists create a conceptual design for the space, build a 3D model of the space, decorate, and then perform rendering. Altho…
Image GenerationScene GenerationInstaIndoor and Multi-modal Deep Learning for Indoor Scene Recognition
Indoor scene recognition is a growing field with great potential for behaviour understanding, robot localization, and elderly monitoring, among others. In this study, we approach the task of scene recognition from a nove…
BenchmarkingDeep LearningScene RecognitionSpeech-to-Text