Weakly Supervised Image Annotation and Segmentation with Objects and Attributes
We propose to model complex visual scenes using a non-parametric Bayesian model learned from weakly labelled images abundant on media sharing sites such as Flickr. Given weak image-level annotations of objects and attributes without locations or associations between them, our model aims to learn the appearance of object and attribute classes as well as their association on each object instance. Once learned, given an image, our model can be deployed to tackle a number of vision problems in a joint and coherent manner, including recognising objects in the scene (automatic object annotation), describing objects using their attributes (attribute prediction and association), and localising and delineating the objects (object detection and semantic segmentation). This is achieved by developing a novel Weakly Supervised Markov Random Field Stacked Indian Buffet Process (WS-MRF-SIBP) that models objects and attributes as latent factors and explicitly captures their correlations within and across superpixels. Extensive experiments on benchmark datasets demonstrate that our weakly supervised model significantly outperforms weakly supervised alternatives and is often comparable with existing strongly supervised models on a variety of tasks including semantic segmentation, automatic image annotation and retrieval based on object-attribute associations.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeObjectobject-detectionObject DetectionRetrievalSemantic SegmentationSuperpixelsSimilar Papers 제목 키워드 기반
Inter Extreme Points Geodesics for End-to-End Weakly Supervised Image Segmentation
We introduce $\textit{InExtremIS}$, a weakly supervised 3D approach to train a deep image segmentation network using particularly weak train-time annotations: only 6 extreme clicks at the boundary of the objects of inter…
Image SegmentationSegmentationSemantic SegmentationWeakly supervised segmentationNoPeopleAllowed: The Three-Step Approach to Weakly Supervised Semantic Segmentation
We propose a novel approach to weakly supervised semantic segmentation, which consists of three consecutive steps. The first two steps extract high-quality pseudo masks from image-level annotated data, which are then use…
Missing LabelsSegmentationSemantic SegmentationWeakly supervised Semantic Segmentation+1Weakly Supervised Instance Segmentation using Motion Information via Optical Flow
Weakly supervised instance segmentation has gained popularity because it reduces high annotation cost of pixel-level masks required for model training. Recent approaches for weakly supervised instance segmentation detect…
Instance SegmentationOptical Flow EstimationSegmentationSemantic Segmentation+1CaCL: Class-aware Codebook Learning for Weakly Supervised Segmentation on Diffuse Image Patterns
Weakly supervised learning has been rapidly advanced in biomedical image analysis to achieve pixel-wise labels (segmentation) from image-wise annotations (classification), as biomedical images naturally contain image-wis…
Image ReconstructionSegmentationWeakly-supervised LearningWeakly supervised segmentationWeakly-Supervised Semantic Segmentation using Motion Cues
Fully convolutional neural networks (FCNNs) trained on a large number of images with strong pixel-level annotations have become the new state of the art for the semantic segmentation task. While there have been recent at…
Image SegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation