An EEG-based Image Annotation System
The success of deep learning in computer vision has greatly increased the need for annotated image datasets. We propose an EEG (Electroencephalogram)-based image annotation system. While humans can recognize objects in 20-200 milliseconds, the need to manually label images results in a low annotation throughput. Our system employs brain signals captured via a consumer EEG device to achieve an annotation rate of up to 10 images per second. We exploit the P300 event-related potential (ERP) signature to identify target images during a rapid serial visual presentation (RSVP) task. We further perform unsupervised outlier removal to achieve an F1-score of 0.88 on the test set. The proposed system does not depend on category-specific EEG signatures enabling the annotation of any new image category without any model pre-training.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGElectroencephalogram (EEG)ERPSimilar Papers 제목 키워드 기반
Learning Semantics for Image Annotation
Image search and retrieval engines rely heavily on textual annotation in order to match word queries to a set of candidate images. A system that can automatically annotate images with meaningful text can be highly benefi…
Image RetrievalRetrievalFeature-Independent Context Estimation for Automatic Image Annotation
Automatic image annotation is a highly valuable tool for image search, retrieval and archival systems. In the absence of an annotation tool, such systems have to rely on either users' input or large amount of text on the…
Image RetrievalRetrievalTensor DecompositionLean Crowdsourcing: Combining Humans and Machines in an Online System
We introduce a method to greatly reduce the amount of redundant annotations required when crowdsourcing annotations such as bounding boxes, parts, and class labels. For example, if two Mechanical Turkers happen to click …
Assistive Image Annotation Systems with Deep Learning and Natural Language Capabilities: A Review
While supervised learning has achieved significant success in computer vision tasks, acquiring high-quality annotated data remains a bottleneck. This paper explores both scholarly and non-scholarly works in AI-assistive …
Active LearningImage Captioningimage-classificationImage Classification+7Image Annotation using Multi-Layer Sparse Coding
Automatic annotation of images with descriptive words is a challenging problem with vast applications in the areas of image search and retrieval. This problem can be viewed as a label-assignment problem by a classifier d…
DescriptiveImage RetrievalRetrieval