This paper presents a cloud-based and deep learning-driven sign language recognition AR glasses system aiming to achieve real-time and accurate sign language recognition and communication. The system consists of three parts: information acquisition, algorithm processing, and output. In the information acquisition part, the glasses' camera is utilized to capture sign language images, and the data is transmitted to the K210 microprocessor for further processing. The algorithm processing part combines YOLO (you only look once) and RNN algorithms to address issues like object occlusion and motion blur, enhancing the accuracy and robustness of target detection. The output part visualizes the recognized sign language signals on the AR display of the glasses. Experimental results demonstrate that the proposed system achieves favorable performance and effectiveness in sign language recognition, opening up new possibilities for barrier-free communication between the deaf and non-deaf individuals.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    AR glasses for sign language recognition based on deep learning


    Contributors:


    Publication date :

    2023-10-11


    Size :

    1576663 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Australian sign language recognition

    Holden, E. J. / Lee, G. / Owens, R. | British Library Online Contents | 2005


    Viewpoint invariant sign language recognition

    Wang, Q. / Chen, X. / Zhang, L. G. et al. | British Library Online Contents | 2007


    Viewpoint invariant sign language recognition

    Qi Wang, / Xilin Chen, / Liangguo Zhang, et al. | IEEE | 2005


    Viewpoint Invariant Sign Language Recognition

    Wang, Q. / Chen, X. / Zhang, L. et al. | British Library Conference Proceedings | 2005


    Traffic Sign Detection and Recognition Using Deep Learning

    Kumar, P. Puneeth / Kishen, R. C. / Ravikumar, M. | Springer Verlag | 2022