Ego-Object Discovery
Lifelogging devices are spreading faster everyday. This growth can represent great benefits to develop methods for extraction of meaningful information about the user wearing the device and his/her environment. In this paper, we propose a semi-supervised strategy for easily discovering objects relevant to the person wearing a first-person camera. Given an egocentric video/images sequence acquired by the camera, our algorithm uses both the appearance extracted by means of a convolutional neural network and an object refill methodology that allows to discover objects even in case of small amount of object appearance in the collection of images. An SVM filtering strategy is applied to deal with the great part of the False Positive object candidates found by most of the state of the art object detectors. We validate our method on a new egocentric dataset of 4912 daily images acquired by 4 persons as well as on both PASCAL 2012 and MSRC datasets. We obtain for all of them results that largely outperform the state of the art approach. We make public both the EDUB dataset and the algorithm code.
Code (1)
Tasks
ObjectObject DiscoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Large-Scale Object Mining for Object Discovery from Unlabeled Video
This paper addresses the problem of object discovery from unlabeled driving videos captured in a realistic automotive setting. Identifying recurring object categories in such raw video streams is a very challenging probl…
ClusteringObjectObject DiscoveryThe Background Also Matters: Background-Aware Motion-Guided Objects Discovery
Recent works have shown that objects discovery can largely benefit from the inherent motion information in video data. However, these methods lack a proper background processing, resulting in an over-segmentation of the …
ObjectObject DiscoveryOptical Flow EstimationObject Discovery in Videos as Foreground Motion Clustering
We consider the problem of providing dense segmentation masks for object discovery in videos. We formulate the object discovery problem as foreground motion clustering, where the goal is to cluster foreground pixels in v…
ClusteringMotion SegmentationObjectObject Discovery+2Simultaneous Localization, Mapping, and Manipulation for Unsupervised Object Discovery
We present an unsupervised framework for simultaneous appearance-based object discovery, detection, tracking and reconstruction using RGBD cameras and a robot manipulator. The system performs dense 3D simultaneous locali…
Motion SegmentationObjectObject DiscoverySimultaneous Localization and MappingImage Segmentation-based Unsupervised Multiple Objects Discovery
Unsupervised object discovery aims to localize objects in images, while removing the dependence on annotations required by most deep learning-based methods. To address this problem, we propose a fully unsupervised, botto…
Class-agnostic Object DetectionImage SegmentationObjectobject-detection+4