Images from the Mind: BCI image evolution based on Rapid Serial Visual Presentation of polygon primitives
This paper provides a proof of concept for an EEG-based reconstruction of a visual image which is on a user's mind. Our approach is based on the Rapid Serial Visual Presentation (RSVP) of polygon primitives and Brain-Computer Interface (BCI) technology. The presentation of polygons that contribute to build a target image (because they match the shape and/or color of the target) trigger attention-related EEG patterns. Accordingly, these target primitives can be determined using BCI classification of Event-Related Potentials (ERPs). They are then accumulated in the display until a satisfactory reconstruction is reached. Selection steps have an average classification accuracy of $75\%$. $25\%$ of the images could be reconstructed completely, while more than $65\%$ of the available visual details could be captured on average. Most of the misclassifications were not misinterpretations of the BCI concerning users' intent; rather, users tried to select polygons that were different than what was intended by the experimenters. Open problems and alternatives to develop a practical BCI-based image reconstruction application are discussed.
Code (0)
등록된 구현이 없습니다.
Tasks
Brain Computer InterfaceEEGElectroencephalogram (EEG)Image ReconstructionSimilar Papers 제목 키워드 기반
Spatial Filtering Pipeline Evaluation of Cortically Coupled Computer Vision System for Rapid Serial Visual Presentation
Rapid Serial Visual Presentation (RSVP) is a paradigm that supports the application of cortically coupled computer vision to rapid image search. In RSVP, images are presented to participants in a rapid serial sequence wh…
EEGElectroencephalogram (EEG)General ClassificationImage Retrieval+1MIND: Multimodal Intent-Driven Network via Diffusion Transformers for Medical Image Fusion
Medical image fusion aims to integrate complementary information from diverse imaging modalities to support clinical diagnosis. Existing methods typically apply uniform fusion rules globally, lacking a deep understanding…
Brain Tumor SegmentationSerialGen: Personalized Image Generation by First Standardization Then Personalization
In this work, we are interested in achieving both high text controllability and whole-body appearance consistency in the generation of personalized human characters. We propose a novel framework, named SerialGen, which i…
Image GenerationPersonalized Image GenerationAn EEG-based Image Annotation System
The success of deep learning in computer vision has greatly increased the need for annotated image datasets. We propose an EEG (Electroencephalogram)-based image annotation system. While humans can recognize objects in 2…
EEGElectroencephalogram (EEG)ERPThoth: Improved Rapid Serial Visual Presentation using Natural Language Processing
Thoth is a tool designed to combine many different types of speed reading technology. The largest insight is using natural language parsing for more optimal rapid serial visual presentation and more effective reading inf…