Deaf people cause inconvenience to their daily communication due to different degrees of hearing loss, and their hearing loss may also affect their ability to recognize facial emotions, thereby further affecting their interpersonal communication. Therefore, the use of emerging information technology to solve the hearing impairments of deaf and dumb people, language barriers of deaf and dumb people, regional language barriers, and emotional barriers of deaf and dumb people contributes to the smooth communication between deaf and dumb people and hearing people. And improving the education system for all has important practical significance. Based on this research background, the paper uses eye movement and event-related potential analysis methods to try to study the characteristics of deaf people’s potential cognitive abilities in face emotion recognition and sign language recognition tasks from different experimental paradigms, extract the target area by means of image processing, and Use appropriate feature description, sign language video recognition technology, emotional speech synthesis technology, speech recognition technology and machine learning methods to make further accurate judgments, and finally perform sign language and emotion recognition. Finally, the APP software was tested for running. Through experiments on 630 gesture images, the recognition rate reached 94.22% and the speed reached 0. 29s/frame. The results show that the proposed algorithm effectively improves the recognition rate and can meet the realtime performance of dumb language communication.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Research on Communication APP for Deaf and Mute People Based on Face Emotion Recognition Technology


    Beteiligte:
    Tao, Yuan (Autor:in) / Huo, Shihang (Autor:in) / Zhou, Wenyu (Autor:in)


    Erscheinungsdatum :

    14.10.2020


    Format / Umfang :

    523444 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Auxiliary cockpit of vehicle for deaf-mute

    ZHANG FAN | Europäisches Patentamt | 2021

    Freier Zugriff

    Vehicle-mounted multimode interaction and barrier-free communication method and system for deaf-mute

    XIE YANPING / PAN TAO / LUO TANYUE et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Control method and system for assisting deaf-mute in driving and vehicle

    YAN XIAOHAN / GONG XIUMEI / ZHANG SHINING et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Mute roller

    CHEN JIANDAO | Europäisches Patentamt | 2020

    Freier Zugriff

    Mute zur Luecke - E Auto Projekt Mute

    Priemer,B. / Tech.Univ.Muenchen,DE | Kraftfahrwesen | 2012