3D Semantic Segmentation of Modular Furniture using rjMCMC
In this paper we propose a novel approach to identify and label the structural elements of furniture e.g. wardrobes, cabinets etc. Given a furniture item, the subdivision into its structural components like doors, drawers and shelves is difficult as the number of components and their spatial arrangements varies severely. Furthermore, structural elements are primarily distinguished by their function rather than by unique color or texture based appearance features. It is therefore difficult to classify them, even if their correct spatial extent were known. In our approach we jointly estimate the number of functional units, their spatial structure, and their corresponding labels by using reversible jump MCMC (rjMCMC), a method well suited for optimization on spaces of varying dimensions (the number of structural elements). Optionally, our system permits to invoke depth information e.g. from RGB-D cameras, which are already frequently mounted on mobile robot platforms. We show a considerable improvement over a baseline method even without using depth data, and an additional performance gain when depth input is enabled.
Code (1)
Tasks
3D Semantic Segmentationfurniture segmentationRobotic GraspingScene UnderstandingSemantic SegmentationSimilar Papers 제목 키워드 기반
Beyond trans-dimensional RJMCMC with a case study in impulsive data modeling
Reversible jump Markov chain Monte Carlo (RJMCMC) is a Bayesian model estimation method which has been used for trans-dimensional sampling. In this study, we propose utilization of RJMCMC beyond trans-dimensional samplin…
Transport Reversible Jump Proposals
Reversible jump Markov chain Monte Carlo (RJMCMC) proposals that achieve reasonable acceptance rates and mixing are notoriously difficult to design in most applications. Inspired by recent advances in deep neural network…
Density EstimationSegmentation of Drilled Holes in Texture Wooden Furniture Panels Using Deep Neural Network
Drilling operations are an essential part of furniture from MDF laminated boards required for product assembly. Faults in the process might introduce adverse effects to the furniture. Inspection of the drilling quality c…
2D Semantic SegmentationDecoderobject-detectionObject Detection+3Fully Bayesian Wideband Direction-of-Arrival Estimation and Detection via RJMCMC
We propose a fully Bayesian approach to wideband, or broadband, direction-of-arrival (DoA) estimation and signal detection. Unlike previous works in wideband DoA estimation and detection, where the signals were modeled i…
Direction of Arrival EstimationSemantic Layering in Room Segmentation via LLMs
In this paper, we introduce Semantic Layering in Room Segmentation via LLMs (SeLRoS), an advanced method for semantic room segmentation by integrating Large Language Models (LLMs) with traditional 2D map-based segmentati…
Segmentation