Deep Interactive Object Selection
Interactive object selection is a very important research problem and has many applications. Previous algorithms require substantial user interactions to estimate the foreground and background distributions. In this paper, we present a novel deep learning based algorithm which has a much better understanding of objectness and thus can reduce user interactions to just a few clicks. Our algorithm transforms user provided positive and negative clicks into two Euclidean distance maps which are then concatenated with the RGB channels of images to compose (image, user interactions) pairs. We generate many of such pairs by combining several random sampling strategies to model user click patterns and use them to fine tune deep Fully Convolutional Networks (FCNs). Finally the output probability maps of our FCN 8s model is integrated with graph cut optimization to refine the boundary segments. Our model is trained on the PASCAL segmentation dataset and evaluated on other datasets with different object classes. Experimental results on both seen and unseen objects clearly demonstrate that our algorithm has a good generalization ability and is superior to all existing interactive object selection approaches.
Code (3)
Tasks
Interactive SegmentationObjectSimilar Papers 제목 키워드 기반
Getting to 99% Accuracy in Interactive Segmentation
Interactive object cutout tools are the cornerstone of the image editing workflow. Recent deep-learning based interactive segmentation algorithms have made significant progress in handling complex images and rough binary…
Deep LearningInteractive SegmentationInteractive Visual Exploration of Latent Space (IVELS) for peptide auto-encoder model selection
We present a tool for Interactive Visual Exploration of Latent Space (IVELS) for model selection. Evaluating generative models of discrete sequences from a continuous latent space is a challenging problem, since…
Model SelectionLarge Language Model-assisted Speech and Pointing Benefits Multiple 3D Object Selection in Virtual Reality
Selection of occluded objects is a challenging problem in virtual reality, even more so if multiple objects are involved. With the advent of new artificial intelligence technologies, we explore the possibility of leverag…
Language ModelingLanguage ModellingLarge Language ModelUnbiased Scene Graph Generation by Type-Aware Message Passing on Heterogeneous and Dual Graphs
Although great progress has been made in the research of unbiased scene graph generation, issues still hinder improving the predictive performance of both head and tail classes. An unbiased scene graph generation (TA-HDG…
graph constructionGraph GenerationScene Graph GenerationUnbiased Scene Graph GenerationSemantic Object Selection
Interactive object segmentation has great practical importance in computer vision. Many interactive methods have been proposed utilizing user input in the form of mouse clicks and mouse strokes, and often requiring a lot…
Image RetrievalObjectobject-detectionObject Detection+3