Semantic Labeling of 3D Point Clouds for Indoor Scenes

2011-12-01 · NeurIPS 2011 12 · Hema S. Koppula, Abhishek Anand, Thorsten Joachims, Ashutosh Saxena

Inexpensive RGB-D cameras that give an RGB image together with depth data have become widely available. In this paper, we use this data to build 3D point clouds of full indoor scenes such as an office and address the task of semantic labeling of these 3D point clouds. We propose a graphical model that captures various features and contextual relations, including the local visual appearance and shape cues, object co-occurence relationships and geometric relationships. With a large number of object classes and relations, the model’s parsimony becomes important and we address that by using multiple types of edge potentials. The model admits efficient approximate inference, and we train it using a maximum-margin learning approach. In our experiments over a total of 52 3D scenes of homes and offices (composed from about 550 views, having 2495 segments labeled with 27 object classes), we get a performance of 84.06% in labeling 17 object classes for offices, and 73.38% in labeling 17 object classes for home scenes. Finally, we applied these algorithms successfully on a mobile robot for the task of finding objects in large cluttered rooms.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Object

LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds

2022-10-14 · Minghua Liu, Yin Zhou, Charles R. Qi, Boqing Gong 외

Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical …

3D Semantic Segmentation Autonomous Driving Descriptive Segmentation+2

3DSES: an indoor Lidar point cloud segmentation dataset with real and pseudo-labels from a 3D model

2025-01-29 · Maxime Mérizette, Nicolas Audebert, Pierre Kervella, Jérôme Verdun

Semantic segmentation of indoor point clouds has found various applications in the creation of digital twins for robotics, navigation and building information modeling (BIM). However, most existing datasets of labeled in…

Point Cloud Segmentation Semantic Segmentation

BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation

2024-11-20 · Umamaheswaran Raman Kumar, Abdur Razzaq Fayjie, Jurgen Hannaert, Patrick Vandewalle

Large-scale 2D datasets have been instrumental in advancing machine learning; however, progress in 3D vision tasks has been relatively slow. This disparity is largely due to the limited availability of 3D benchmarking da…

Benchmarking Point Cloud Segmentation Segmentation Semantic Segmentation

Classification of Point Cloud Scenes with Multiscale Voxel Deep Network

2018-04-10 · Xavier Roynard, Jean-Emmanuel Deschaud, François Goulette

In this article we describe a new convolutional neural network (CNN) to classify 3D point clouds of urban or indoor scenes. Solutions are given to the problems encountered working on scene point clouds, and a network is …

Classification General Classification Position Semantic Segmentation

From CAD models to soft point cloud labels: An automatic annotation pipeline for cheaply supervised 3D semantic segmentation

2023-02-06 · Galadrielle Humblot-Renaux, Simon Buus Jensen, Andreas Møgelmose

We propose a fully automatic annotation scheme that takes a raw 3D point cloud with a set of fitted CAD models as input and outputs convincing point-wise labels that can be used as cheap training data for point cloud seg…

3D Semantic Segmentation Point Cloud Segmentation Semantic Segmentation