A Deep Learning-based in silico Framework for Optimization on Retinal Prosthetic Stimulation
Abstract
We propose a neural network-based framework to optimize the perceptions simulated by the in silico retinal implant model pulse2percept. The overall pipeline consists of a trainable encoder, a pre-trained retinal implant model and a pre-trained evaluator. The encoder is a U-Net, which takes the original image and outputs the stimulus. The pre-trained retinal implant model is also a U-Net, which is trained to mimic the biomimetic perceptual model implemented in pulse2percept. The evaluator is a shallow VGG classifier, which is trained with original images. Based on 10,000 test images from the MNIST dataset, we show that the convolutional neural network-based encoder performs significantly better than the trivial downsampling approach, yielding a boost in the weighted F1-Score by 36.17% in the pre-trained classifier with 6x10 electrodes. With this fully neural network-based encoder, the quality of the downstream perceptions can be fine-tuned using gradient descent in an end-to-end fashion.
Authors 5
-
Affiliation as printed
Institute of Imaging and Computer Vision , RWTH Aachen University , Germany
-
Affiliation as printed
Institute of Imaging and Computer Vision , RWTH Aachen University , Germany
NeuroTX Aachen e.V ., Germany
-
Affiliation as printed
Institute of Imaging and Computer Vision , RWTH Aachen University , Germany
-
Affiliation as printed
Department of Ophthalmology , RWTH Aachen University , Germany
-
Affiliation as printed
Institute of Image Analysis and Computer Vision , University of Regens- burg , Germany
Cited by 0 stored of 0
No patents citing this paper on Lens.org (checked 2026-10-06).