From Image-level to Pixel-level Labeling with Convolutional Networks
We are interested in inferring object segmentation by leveraging only object class information, and by considering only minimal priors on the object segmentation task. This problem could be viewed as a kind of weakly supervised segmentation task, and naturally fits the Multiple Instance Learning (MIL) framework: every training image is known to have (or not) at least one pixel corresponding to the image class label, and the segmentation task can be rewritten as inferring the pixels belonging to the class of the object (given one image, and its object class). We propose a Convolutional Neural Network-based model, which is constrained during training to put more weight on pixels which are important for classifying the image. We show that at test time, the model has learned to discriminate the right pixels well enough, such that it performs very well on an existing segmentation benchmark, by adding only few smoothing priors. Our system is trained using a subset of the Imagenet dataset and the segmentation experiments are performed on the challenging Pascal VOC dataset (with no fine-tuning of the model on Pascal VOC). Our model beats the state of the art results in weakly supervised object segmentation task by a large margin. We also compare the performance of our model with state of the art fully-supervised segmentation approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple Instance LearningObjectSegmentationSemantic SegmentationWeakly-Supervised Object SegmentationWeakly supervised segmentationWeakly-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Pixel-level Encoding and Depth Layering for Instance-level Semantic Labeling
Recent approaches for instance-aware semantic labeling have augmented convolutional neural networks (CNNs) with complex multi-task architectures or computationally expensive graphical models. We present a method that lev…
Instance SegmentationSemantic SegmentationAerial Scene Parsing: From Tile-level Scene Classification to Pixel-wise Semantic Labeling
Given an aerial image, aerial scene parsing (ASP) targets to interpret the semantic structure of the image content, e.g., by assigning a semantic label to every pixel of the image. With the popularization of data-driven …
Aerial Scene ClassificationBenchmarkingClassificationMulti-Task Learning+2Dense semantic labeling of sub-decimeter resolution images with convolutional neural networks
Semantic labeling (or pixel-level land-cover classification) in ultra-high resolution imagery (< 10cm) requires statistical models able to learn high level concepts from spatial data, with large appearance variations. Co…
General ClassificationLand Cover ClassificationSuperpixelsA Joint Convolutional Neural Networks and Context Transfer for Street Scenes Labeling
Street scene understanding is an essential task for autonomous driving. One important step towards this direction is scene labeling, which annotates each pixel in the images with a correct class label. Although many appr…
Autonomous DrivingData AugmentationScene LabelingScene UnderstandingCombining Multi-level Contexts of Superpixel using Convolutional Neural Networks to perform Natural Scene Labeling
Modern deep learning algorithms have triggered various image segmentation approaches. However most of them deal with pixel based segmentation. However, superpixels provide a certain degree of contextual information while…
Image SegmentationScene LabelingSegmentationSemantic Segmentation+1