Invisible Marker: Automatic Annotation of Segmentation Masks for Object Manipulation
We propose a method to annotate segmentation masks accurately and automatically using invisible marker for object manipulation. Invisible marker is invisible under visible (regular) light conditions, but becomes visible under invisible light, such as ultraviolet (UV) light. By painting objects with the invisible marker, and by capturing images while alternately switching between regular and UV light at high speed, massive annotated datasets are created quickly and inexpensively. We show a comparison between our proposed method and manual annotations. We demonstrate semantic segmentation for deformable objects including clothes, liquids, and powders under controlled environmental light conditions. In addition, we show demonstrations of liquid pouring tasks under uncontrolled environmental light conditions in complex environments such as inside the office, house, and outdoors. Furthermore, it is possible to capture data while the camera is in motion so it becomes easier to capture large datasets, as shown in our demonstration.
Code (1)
Tasks
SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Human De-occlusion: Invisible Perception and Recovery for Humans
In this paper, we tackle the problem of human de-occlusion which reasons about occluded segmentation masks and invisible appearance content of humans. In particular, a two-stage framework is proposed to estimate the invi…
Human ParsingInstance SegmentationSemantic SegmentationLearning Invisible Markers for Hidden Codes in Offline-to-Online Photography
QR (quick response) codes are widely used as an offline-to-online channel to convey information (e.g., links) from publicity materials (e.g., display and print) to mobile devices. However, QR Codes are not favorable …
Learning Wall Segmentation in 3D Vessel Trees using Sparse Annotations
We propose a novel approach that uses sparse annotations from clinical studies to train a 3D segmentation of the carotid artery wall. We use a centerline annotation to sample perpendicular cross-sections of the carotid a…
Pseudo LabelSegmentationLarge-scale interactive object segmentation with human annotators
Manually annotating object segmentation masks is very time consuming. Interactive object segmentation methods offer a more efficient alternative where a human annotator and a machine segmentation model collaborate. In th…
Instance SegmentationInteractive SegmentationObjectSegmentation+1Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentation
Semantic amodal segmentation is a recently proposed extension to instance-aware segmentation that includes the prediction of the invisible region of each object instance. We present the first all-in-one end-to-end traina…
Amodal Instance SegmentationData AugmentationInstance SegmentationSegmentation+1