Bayesian Semantic Instance Segmentation in Open Set World
This paper addresses the semantic instance segmentation task in the open-set conditions, where input images can contain known and unknown object classes. The training process of existing semantic instance segmentation methods requires annotation masks for all object instances, which is expensive to acquire or even infeasible in some realistic scenarios, where the number of categories may increase boundlessly. In this paper, we present a novel open-set semantic instance segmentation approach capable of segmenting all known and unknown object classes in images, based on the output of an object detector trained on known object classes. We formulate the problem using a Bayesian framework, where the posterior distribution is approximated with a simulated annealing optimization equipped with an efficient image partition sampler. We show empirically that our method is competitive with state-of-the-art supervised methods on known classes, but also performs well on unknown classes when compared with unsupervised methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationObjectSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
3D Indoor Instance Segmentation in an Open-World
Existing 3D instance segmentation methods typically assume that all semantic classes to be segmented would be available during training and only seen categories are segmented at inference. We argue that such a closed-wor…
3D Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationBiSeg: Simultaneous Instance Segmentation and Semantic Segmentation with Fully Convolutional Networks
We present a simple and effective framework for simultaneous semantic segmentation and instance segmentation with Fully Convolutional Networks (FCNs). The method, called BiSeg, predicts instance segmentation as a posteri…
Bayesian InferenceInstance SegmentationPositionSegmentation+1Open-World Panoptic Segmentation
Perception is a key building block of autonomously acting vision systems such as autonomous vehicles. It is crucial that these systems are able to understand their surroundings in order to operate safely and robustly. Ad…
Autonomous DrivingAutonomous VehiclesPanoptic SegmentationSegmentation+1WOW-Seg: A Word-free Open World Segmentation Model
Open world image segmentation aims to achieve precise segmentation and semantic understanding of targets within images by addressing the infinitely open set of object categories encountered in the real world. However, tr…
Semantic SimilarityImage SegmentationLowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding
Open-world instance-level scene understanding aims to locate and recognize unseen object categories that are not present in the annotated dataset. This task is challenging because the model needs to both localize novel 3…
3D geometry3D Open-Vocabulary Instance SegmentationInstance SegmentationPanoptic Segmentation+4