Deep Learning-Based Perceptual Stimulus Encoder for Bionic Vision
Retinal implants have the potential to treat incurable blindness, yet the quality of the artificial vision they produce is still rudimentary. An outstanding challenge is identifying electrode activation patterns that lead to intelligible visual percepts (phosphenes). Here we propose a PSE based on CNN that is trained in an end-to-end fashion to predict the electrode activation patterns required to produce a desired visual percept. We demonstrate the effectiveness of the encoder on MNIST using a psychophysically validated phosphene model tailored to individual retinal implant users. The present work constitutes an essential first step towards improving the quality of the artificial vision provided by retinal implants.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningSimilar Papers 제목 키워드 기반
Hybrid Neural Autoencoders for Stimulus Encoding in Visual and Other Sensory Neuroprostheses
Sensory neuroprostheses are emerging as a promising technology to restore lost sensory function or augment human capabilities. However, sensations elicited by current devices often appear artificial and distorted. Althou…
Using Visual Language Models to Control Bionic Hands: Assessment of Object Perception and Grasp Inference
This study examines the potential of utilizing Vision Language Models (VLMs) to improve the perceptual capabilities of semi-autonomous prosthetic hands. We introduce a unified benchmark for end-to-end perception and gras…
Object DetectionPose EstimationHuman-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differ…
Bayesian OptimizationThe Brain Uses Reliability of Stimulus Information when Making Perceptual Decisions
In simple perceptual decisions the brain has to identify a stimulus based on noisy sensory samples from the stimulus. Basic statistical considerations state that the reliability of the stimulus information, i.e., the amo…
Decision MakingThe contribution of local variations in hue or contrast to symmetry of things in a thing
Symmetry contributes to processes of perceptual organization in biological vision and influences the quality and time of goal directed decision making in animals and humans, as discussed in recent work on the examples of…
Decision MakingSymmetry Detection