This paper presents a cloud-based and deep learning-driven sign language recognition AR glasses system aiming to achieve real-time and accurate sign language recognition and communication. The system consists of three parts: information acquisition, algorithm processing, and output. In the information acquisition part, the glasses' camera is utilized to capture sign language images, and the data is transmitted to the K210 microprocessor for further processing. The algorithm processing part combines YOLO (you only look once) and RNN algorithms to address issues like object occlusion and motion blur, enhancing the accuracy and robustness of target detection. The output part visualizes the recognized sign language signals on the AR display of the glasses. Experimental results demonstrate that the proposed system achieves favorable performance and effectiveness in sign language recognition, opening up new possibilities for barrier-free communication between the deaf and non-deaf individuals.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    AR glasses for sign language recognition based on deep learning


    Beteiligte:
    Wang, Kangheng (Autor:in) / Huang, Lisha (Autor:in) / Liu, Hongtao (Autor:in)


    Erscheinungsdatum :

    11.10.2023


    Format / Umfang :

    1576663 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Australian sign language recognition

    Holden, E. J. / Lee, G. / Owens, R. | British Library Online Contents | 2005


    Viewpoint invariant sign language recognition

    Wang, Q. / Chen, X. / Zhang, L. G. et al. | British Library Online Contents | 2007


    Viewpoint invariant sign language recognition

    Qi Wang, / Xilin Chen, / Liangguo Zhang, et al. | IEEE | 2005


    Viewpoint Invariant Sign Language Recognition

    Wang, Q. / Chen, X. / Zhang, L. et al. | British Library Conference Proceedings | 2005


    Deep Learning Based Traffic Sign Recognition using CNN and TensorFlow

    Gowtham, P.Srinivasa / Bhargavi, Maridu / Kavyanjali, P. et al. | IEEE | 2024