In this paper, the Virtually Enhanced Senses (VES) System is described. It is an ARCore-based, mixed-reality system meant to assist blind and visually impaired people's navigation. VES operates in indoor and outdoor environments without any previous in-situ installation. It provides users with specific, runtime-configurable stimuli according to their pose, i.e., position and orientation, and the information of the environment recorded in a virtual replica. It implements three output data modalities: wall-tracking assistance, acoustic compass, and a novel sensory substitution algorithm, Geometry-based Virtual Acoustic Space (GbVAS). The multimodal output of this algorithm takes advantage of natural human perception encoding of spatial data. Preliminary experiments of GbVAS have been conducted with sixteen subjects in three different scenarios, demonstrating basic orientation and mobility skills after six minutes training.


    Access

    Download


    Export, share and cite



    Title :

    VES: A mixed-reality system to assist multisensory spatial perception and cognition for blind and visually impaired people



    Publication date :

    2020-01-01


    Remarks:

    Applied Sciences-Basel, ISSN 2076-3417, 2020-01, Vol. 10, No. 523


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Public Transport Information System for Visually Impaired and Blind People

    Markiewicz, M. / Skomorowski, M. | British Library Conference Proceedings | 2010


    Public Transport Information System for Visually Impaired and Blind People

    Markiewicz, Michał / Skomorowski, Marek | Springer Verlag | 2010


    Connected vehicle technology to assist visually impaired

    SORYAL JOSEPH / RAO LALITA V / SERBAN CRISTINA et al. | European Patent Office | 2019

    Free access

    The city the blind person "sees" - architectonic barriers for visually impaired people

    Flavia de Rezende Melo, H. | British Library Conference Proceedings | 1995


    A Blind Spot in Indoor Navigation - Needs and Requirements of Visually Impaired People

    Franzkowiak, Lena / Tauchmann, Nico / Costantino, Maria et al. | DataCite | 2022