In this paper, the Virtually Enhanced Senses (VES) System is described. It is an ARCore-based, mixed-reality system meant to assist blind and visually impaired people's navigation. VES operates in indoor and outdoor environments without any previous in-situ installation. It provides users with specific, runtime-configurable stimuli according to their pose, i.e., position and orientation, and the information of the environment recorded in a virtual replica. It implements three output data modalities: wall-tracking assistance, acoustic compass, and a novel sensory substitution algorithm, Geometry-based Virtual Acoustic Space (GbVAS). The multimodal output of this algorithm takes advantage of natural human perception encoding of spatial data. Preliminary experiments of GbVAS have been conducted with sixteen subjects in three different scenarios, demonstrating basic orientation and mobility skills after six minutes training.
VES: A mixed-reality system to assist multisensory spatial perception and cognition for blind and visually impaired people
2020-01-01
Applied Sciences-Basel, ISSN 2076-3417, 2020-01, Vol. 10, No. 523
Article (Journal)
Electronic Resource
English
DDC: | 629 |
Public Transport Information System for Visually Impaired and Blind People
British Library Conference Proceedings | 2010
|Public Transport Information System for Visually Impaired and Blind People
Springer Verlag | 2010
|Connected vehicle technology to assist visually impaired
European Patent Office | 2019
|The city the blind person "sees" - architectonic barriers for visually impaired people
British Library Conference Proceedings | 1995
|