Vision substitution and moving objects tracking in 2 and 3 dimensions via vectorial electro-stimulation of the tongue Abdessalem Chekhchoukh1,2 , Nicolas Vuillerme1 , and Nicolas Glade1 1

AGIM (AGeing and IMagery) CNRS FRE3405 2 TIMC–IMAG CNRS UMR5525, Faculty of medicine of Grenoble Domaine de la Merci, 38700 La Tronche, France [email protected]

Abstract. Vision substitution by electro-stimulation has been studied since the 60’s. Camera pictures or movies encoded in gray levels are displayed via an electro-stimulation device at the surface of a body part, e.g. the skin or the tongue. Medico-technical devices are developed on this principle to take care of sensorimotor handicaps like blindness [1–3] or equilibrium [4], or to guide precise acts like in surgery. We propose here to reduce the complexity of the displayed information to vectorial encoded 2D, but also 3D, scenes projected on the tongue via a Tongue Display Unit of 12×12 electrodes. Such vectorial encoding presents the advantage to furnish to the subjects only useful informations so as to increase the quality of recognition of 2D or 3D scenes and to reduce their cognitive load, i.e. the latency of time-to-recognition of such scenes. In the present experimental trimodal (normal vision, TDU vision substitution, or both) study on healthy people we show that the subjects are able to perceive correctly the orientation of motionless sparkling lines and to follow the trajectory of moving objects into dynamic 2D or 3D scenes. These experiments also allowed us to show the influence of the vision modality: standard deviations on the answers, moving object tracking accuracy, and response times increased consequently in case of bimodal stimulation. Keywords: Vision, sensory substitution, electro-stimulation, tongue, TDU, object tracking, vision modality

References 1.

Bach-y-Rita, P., Collins, C.C, Saunders, F.A., White, B., Scadden, L.: Vision substitution by tactile image projection. Nature. 221, 963–964 (1969). Sampaio, E., Maris, S., Bach-y-Rita, P.: Brain plasticity: ’visual’ acuity of blind persons via the tongue. Brain Res.908, 204–207 (2001). 3. Ptito, M., Moesgaard, S., M., Gjedde, A., Kupers, R.: Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenital blind. Brain. 128, 606–614 (2005). 4. Vuillerme N, Cuisinier R. Head position-based electrotactile tongue biofeedback affects postural responses to Achilles tendon vibration in humans. Exp Brain Res. 2008;186:503-8. 2.